The first sync job succeeded. (local volume --> local volume)
C:\Program Files\RCLONE
λ rclone.exe sync "E:\SharepointSync\reporting\Wholesale Sales\testfolder2" testfolder2 --ignore-times -vv
2022/01/12 18:22:12 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone.exe" "sync" "E:\\SharepointSync\\reporting\\Wholesale Sales\\testfolder2" "testfolder2" "--ignore-times" "-vv"]
2022/01/12 18:22:12 DEBUG : Creating backend with remote "E:\\SharepointSync\\reporting\\Wholesale Sales\\testfolder2"
2022/01/12 18:22:12 DEBUG : Using config file from "C:\\Users\\adm_engelsen\\AppData\\Roaming\\rclone\\rclone.conf"
2022/01/12 18:22:12 DEBUG : fs cache: renaming cache item "E:\\SharepointSync\\reporting\\Wholesale Sales\\testfolder2" to be canonical "//?/E:/SharepointSync/reporting/Wholesale Sales/testfolder2"
2022/01/12 18:22:12 DEBUG : Creating backend with remote "testfolder2"
2022/01/12 18:22:12 DEBUG : fs cache: renaming cache item "testfolder2" to be canonical "//?/C:/Program Files/RCLONE/testfolder2"
2022/01/12 18:22:12 DEBUG : Local file system at //?/C:/Program Files/RCLONE/testfolder2: Waiting for checks to finish
2022/01/12 18:22:12 DEBUG : Local file system at //?/C:/Program Files/RCLONE/testfolder2: Waiting for transfers to finish
2022/01/12 18:22:12 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: md5 = 3457afa3ddbe358ae97fa6a8f4e7456a OK
2022/01/12 18:22:12 INFO : Bookings with Material and Customer with Customization Info S'21.xlsx: Copied (new)
2022/01/12 18:22:12 DEBUG : Waiting for deletions to finish
2022/01/12 18:22:12 INFO :
Transferred: 7.264 MiB / 7.264 MiB, 100%, 0 B/s, ETA -
Transferred: 1 / 1, 100%
Elapsed time: 0.1s
2022/01/12 18:22:12 DEBUG : 3 go routines active
The 2nd sync job failed because the file sizes differed on transfer.
Failed to sync: corrupted on transfer: sizes differ 7617229 vs 7624530
When I add the --ignore-size flag, I was told that the hashes did not match. (Which is very odd.)
Failed to sync: corrupted on transfer: quickxor hash differ "dfee030765a14f7ad79122af6150bba1fe1c6b5f" vs "ba8674f47885eebe48a86d526ba3ef11ae65227b"
Adding both the --ignore-size and --ignore-checksum flags allowed the file transfer to succeed.
C:\Program Files\RCLONE
λ rclone sync testfolder2 SharePoint_Reporting_Wholesale_Sales: --ignore-times --ignore-size --ignore-checksum -vv
2022/01/12 18:32:46 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "sync" "testfolder2" "SharePoint_Reporting_Wholesale_Sales:" "--ignore-times" "--ignore-size" "--ignore-checksum" "-vv"]
2022/01/12 18:32:46 DEBUG : Creating backend with remote "testfolder2"
2022/01/12 18:32:46 DEBUG : Using config file from "C:\\Users\\adm_engelsen\\AppData\\Roaming\\rclone\\rclone.conf"
2022/01/12 18:32:46 DEBUG : fs cache: renaming cache item "testfolder2" to be canonical "//?/C:/Program Files/RCLONE/testfolder2"
2022/01/12 18:32:46 DEBUG : Creating backend with remote "SharePoint_Reporting_Wholesale_Sales:"
2022/01/12 18:32:48 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Starting multipart upload
2022/01/12 18:32:48 DEBUG : One drive root '': Waiting for checks to finish
2022/01/12 18:32:49 DEBUG : One drive root '': Waiting for transfers to finish
2022/01/12 18:32:49 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Uploading segment 0/7617229 size 7617229
2022/01/12 18:32:58 INFO : Bookings with Material and Customer with Customization Info S'21.xlsx: Copied (new)
2022/01/12 18:32:58 DEBUG : Waiting for deletions to finish
2022/01/12 18:32:58 INFO : Bookings/Bookings with Material and Customer Info F'22.xlsx: Deleted
2022/01/12 18:32:58 INFO : Bookings/Bookings with Material and Customer Info S'21.xlsx: Deleted
2022/01/12 18:32:58 INFO : Bookings/Bookings with Material and Customer with Customization Info S'21.xlsx: Deleted
2022/01/12 18:32:58 INFO : Bookings/Bookings with Material and Customer with Customization Info F'21.xlsx: Deleted
2022/01/12 18:32:59 INFO : Bookings/Bookings with Material and Customer Info S'22.xlsx: Deleted
2022/01/12 18:32:59 INFO : Bookings/Bookings with Material and Customer Info F'20.xlsx: Deleted
2022/01/12 18:32:59 INFO : Bookings/Bookings with Material and Customer Info F'21.xlsx: Deleted
2022/01/12 18:32:59 INFO : Bookings/Bookings with Material and Customer with Customization Info F'20.xlsx: Deleted
2022/01/12 18:32:59 INFO : Bookings/Bookings with Material and Customer with Customization Info F'22.xlsx: Deleted
2022/01/12 18:32:59 INFO : Bookings/Bookings with Material and Customer with Customization Info S'22.xlsx: Deleted
2022/01/12 18:33:00 INFO : Bookings: Removing directory
2022/01/12 18:33:00 DEBUG : One drive root '': deleted 1 directories
2022/01/12 18:33:00 INFO :
Transferred: 7.264 MiB / 7.264 MiB, 100%, 618.771 KiB/s, ETA 0s
Checks: 10 / 10, 100%
Deleted: 10 (files), 1 (dirs)
Transferred: 1 / 1, 100%
Elapsed time: 15.2s
2022/01/12 18:33:00 DEBUG : 13 go routines active
I edited the .xlsx file and ran another sync job (still ignoring the size, checksum, and time). The file transfer succeeded, but I did see output that said the upload session was not found.
C:\Program Files\RCLONE
λ rclone sync testfolder2 SharePoint_Reporting_Wholesale_Sales: --ignore-times --ignore-size --ignore-checksum -vv
2022/01/12 18:41:04 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "sync" "testfolder2" "SharePoint_Reporting_Wholesale_Sales:" "--ignore-times" "--ignore-size" "--ignore-checksum" "-vv"]
2022/01/12 18:41:05 DEBUG : Creating backend with remote "testfolder2"
2022/01/12 18:41:05 DEBUG : Using config file from "C:\\Users\\adm_engelsen\\AppData\\Roaming\\rclone\\rclone.conf"
2022/01/12 18:41:05 DEBUG : fs cache: renaming cache item "testfolder2" to be canonical "//?/C:/Program Files/RCLONE/testfolder2"
2022/01/12 18:41:05 DEBUG : Creating backend with remote "SharePoint_Reporting_Wholesale_Sales:"
2022/01/12 18:41:06 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Transferring unconditionally as --ignore-times is in use
2022/01/12 18:41:06 DEBUG : One drive root '': Waiting for checks to finish
2022/01/12 18:41:06 DEBUG : One drive root '': Waiting for transfers to finish
2022/01/12 18:41:06 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Starting multipart upload
2022/01/12 18:41:08 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Uploading segment 0/7939438 size 7939438
2022/01/12 18:41:09 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Cancelling multipart upload: itemNotFound: The upload session was not found
2022/01/12 18:41:09 NOTICE: Bookings with Material and Customer with Customization Info S'21.xlsx: Failed to cancel multipart upload: itemNotFound: The upload session was not found (upload failed due to: itemNotFound: The upload session was not found)
2022/01/12 18:41:09 ERROR : Bookings with Material and Customer with Customization Info S'21.xlsx: Failed to copy: itemNotFound: The upload session was not found
2022/01/12 18:41:09 ERROR : One drive root '': not deleting files as there were IO errors
2022/01/12 18:41:09 ERROR : One drive root '': not deleting directories as there were IO errors
2022/01/12 18:41:09 ERROR : Attempt 1/3 failed with 1 errors and: itemNotFound: The upload session was not found
2022/01/12 18:41:09 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Transferring unconditionally as --ignore-times is in use
2022/01/12 18:41:09 DEBUG : One drive root '': Waiting for checks to finish
2022/01/12 18:41:10 DEBUG : One drive root '': Waiting for transfers to finish
2022/01/12 18:41:10 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Starting multipart upload
2022/01/12 18:41:10 DEBUG : Bookings with Material and Customer with Customization Info S'21.xlsx: Uploading segment 0/7939438 size 7939438
2022/01/12 18:41:13 INFO : Bookings with Material and Customer with Customization Info S'21.xlsx: Copied (replaced existing)
2022/01/12 18:41:13 DEBUG : Waiting for deletions to finish
2022/01/12 18:41:13 ERROR : Attempt 2/3 succeeded
2022/01/12 18:41:13 INFO :
Transferred: 15.143 MiB / 15.143 MiB, 100%, 2.514 MiB/s, ETA 0s
Checks: 2 / 2, 100%
Transferred: 1 / 1, 100%
Elapsed time: 8.8s
2022/01/12 18:41:13 DEBUG : 7 go routines active
Here's what I think:
The file transfer will succeed when RCLONE is told to sync a "small batches" of files. (In this example we updating just 1 file.) However, when RCLONE is asked to sync a folder with 10+ flles, that is when things start to fail miserably. What do you think, @Ole ?