Thanks for the info those other parameters do sound like they might affect the actual disk fragmentation.
I do agree finding out if the drive is an SSD or not is not the same on each OS which makes things complicated. Windows has the media type which is easy, linux has the rotational speed 0=SSD thing which is maybe easy, MacOS which also seems to have a media type thing that can be accessed. Although it would possibly prevent a hard drive from dying early (they get very clickly clacky and warmer during 100% busy pure random workload) and would greatly improve default performance when downloading to slow HDDs. This detection would obviously break for RAID/network mounted/crappy USB enclosures... and many other cases.
4, random 1GB files downloaded from google drive to a local HDD over a 1gbps link.
USN Journal Disabled Sanity Check
rclone copy GoogleDrive1:test A:\Test --create-empty-src-dirs --fast-list --progress -vv
Sanity Check still very fragmented baseline default config. I don't think the USN journal will have much traffic because in the mode it is in only new files generally create any entry and the way it is allocated keeps it far away from the data part of the NTFS volume. Verifying took forever possibly because they are all trying to read very random fragments.
Runtime 4m36s
Write 80MB/s USN off
Verify ~16MB/s 100% Busy
FastCopy Read 65MB/s 100% Busy
Fragmentation 4800 frags/file (1GB)
Chunk Size, Write Buffer To 64Mi
--multi-thread-write-buffer-size 64Mi
Verify still took a long time but the read afterward is better and the fragmentation did get reduced.
Runtime 4m18s
Write 86MB/s USN off
Verify ~18MB/s 100% Busy
Read 120MB/s 100% Busy
Fragmentation 1742 frags/file (1GB)
Write Buffer To Disabled
--multi-thread-write-buffer-size 0
Much reduced fragmentation verify still not super fast files still quite fragmentated.
Runtime 3m54s
Write 87MB/s USN off
Verify ~22MB/s 100% Busy
Read 155MB/s 100% Busy
Fragmentation 295 frags/file (1GB)
Chunk Size 32Mi
Runtime 2m59s
Write 83MB/s USN off
Verify 27MB/s 100% Busy
Read 52MB/s 100% Busy
Fragmentation 5698 frags/file (1GB)
Chunk Size 128Mi
Runtime 4m9s
Write 82MB/s USN off
Verify 25MB/s 100% Busy
Read 52MB/s 100% Busy
Fragmentation 5144 frags/file (1GB)
No Threading Much Better Performance
--multi-thread-streams 0
Very fast ironically even though the download was slower
Runtime 1m20s
Write 50MB/s
Verify instant ??? is it being skipped as there was no read from disk step hashes still displayed
Read 160MB/s
Fragmentation 1 frags/file (1GB)
No Sparse File Best Performance
--local-no-sparse
Runtime 1m1s
Write 76MB/s
Verify instant ??? is it being skipped as there was no read from disk step hashes still displayed
Read 161MB/s
Fragmentation 1 frags/file (1GB)