It is entirely up to you to remove all security layers. It of course speeds up things at the cost of increased risk of not catching corrupted transfer.
It is like backup and verify vs backup only. Only you can decide if it is acceptable for you.
I have seen recently very interesting story (link below). I think it is worth reading in this context.
For transfer between two local network machines you could use rsync - then checksums can be calculated locally (at either end). But it does not do parallel transfers so it is balancing act here.
Or use rclone for massive parallel transfer and then rsync for verification - this is I think what I would do for local machines as it would remove network bottleneck. Of course all is relative and I can picture mechanical HDD storage and 25G network link or NVME SSD storage and 1G network (to sort of highlight two extremes) which would change all equation. It depends if you are benchmarks freak or very data integrity conscious person:)
It all boils down to the question do you want to verify what you transferred or not.