rclone google unencrypted remote copy job to ubuntu local ext4 mergerfs HDDs "pauses" at 100% a lot.
I'm saturating gigabit downloading until files hit 100%, then I presume some checking process comparing gdrive with local files runs, but it takes so long that it slows the whole big copy job. It would be preferable to me if the copy job saturated my gigabit consistently, so I can get this big copy job over sooner rather than later.
Example: runs at 100+MB/s until files start hitting 100%, then:
Elapsed time: 1d33m2.2s Transferring: * file1:100% /9.475Gi, 0/s, 0s * file2:100% /9.241Gi, 0/s, 0s * file3:100% /9.442Gi, 0/s, 0s * file4:100% /7.980Gi, 0/s, 0s * file5:100% /7.864Gi, 0/s, 0s * file6:100% /7.890Gi, 0/s, 0s * file7:100% /8.137Gi, 0/s, 0s
Once it's done checking the files and most are done after a good while, it will spin up to 100+MB/s with 8 new active transfers
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 6.2.0-36-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.3
- go/linking: static
- go/tags: none
rclone copy tdrive: /mnt/localhddsunionfs/ --checkers=16 --drive-chunk-size=128M --low-level-retries=2 --retries=1 --stats=60s --transfers=8 -v
I will gladly take advice here on what I should change. More transfers? Disable checking? Or some other flag?
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[tdrive] client_id = XXX client_secret = XXX type = drive token = XXX team_drive = XXX
I can't present this log, at this time.