What is the problem you are having with rclone?
I am syncing about 800 GB and it always slows down and becomes unresponsive after about 100 GB. I am syncing between two Nextcloud instances using WebDav. The source Nextcloud has local storage, the target (local for rclone) Nextcloud is using Wasabi S3 storage.
When it stops copying files successfully, I restart rclone. The debug log shows that most files have a different modification date (one is today, when the file was copied, and the other is the date from the original server). This causes rclone to start checking or copying the files again which makes it impossible to finish the sync.
This is after I had locking issues within Nextcloud (target), so I temporarily disabled that. I also reduced the number of checkers and transfers.
What is your rclone version (output from
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Linux, 64 Bits
Which cloud storage system are you using? (eg Google Drive)
Nextcloud (with Local Storage) and Nextcloud (with External S3 - Wasabi)
The command you were trying to run (eg
rclone copy /tmp remote:tmp)
rclone copy NC: hetzcloud: -P -vvvvv --transfers 8 --checkers 8
A log from the command with the
-vv flag (eg output from
rclone -vv copy /tmp remote:tmp)
2020-01-28 11:18:38 INFO : 2005/fil1.JPG: Copied (replaced existing)
2020-01-28 11:18:41 INFO : 2005/file2.bmp: Copied (replaced existing)
2020-01-28 11:18:41 DEBUG : 2008/dir1/file3.AVI: Modification times differ by 102831h28m45s: 2008-05-03 18:28:14 +0000 GMT, 2020-01-26 09:56:59 +0000 GMT
2020-01-28 11:18:45 INFO : 2005/file4.jpg: Copied (replaced existing)
2020-01-28 11:18:45 DEBUG : 2008/dir1/file5.JPG: Modification times differ by 102831h28m13s: 2008-05-03 18:28:48 +0000 GMT, 2020-01-26 09:57:01 +0000 GMT
2020-01-28 11:18:47 INFO : 2005/file6.JPG: Copied (replaced existing)
2020-01-28 11:18:48 INFO : 2005/file7.JPG: Copied (replaced existing)