What is the problem you are having with rclone?
When running sync, file checking takes a very long time in v1.68.2 as compared to v1.65.0.
Run the command 'rclone version' and share the full output of the command.
rclone v1.68.2
- os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
- os/kernel: 10.0.19045.5131 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.23.3
- go/linking: static
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
OneDrive
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
start cmd.exe /k C:\rclone\rclone.exe sync D:\Backup_Duplicati OneDrive:Backup_PC --progress
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[OneDrive]
type = onedrive
token = XXX
drive_id = XXX
drive_type = personal
A log from the command that you were trying to run with the -vv
flag
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 354 / 6956, 5%
Elapsed time: 30.8s
Checking:
* UserFiles/duplicati-b0…e0cbf51.dblock.zip.aes: checking
* UserFiles/duplicati-b0…6b9b936.dblock.zip.aes: checking
* UserFiles/duplicati-b0…bfa04f3.dblock.zip.aes: checking
* UserFiles/duplicati-b0…b01beb5.dblock.zip.aes: checking
* UserFiles/duplicati-b0…5b44584.dblock.zip.aes: checking
* UserFiles/duplicati-b0…28bd5a3.dblock.zip.aes: checking
* UserFiles/duplicati-b0…be6fca8.dblock.zip.aes: checking
* UserFiles/duplicati-b0…84daaf0.dblock.zip.aes: checking
More info:
I've been using this sync for probably about a year without any issues until a few days ago I started getting an error. I was using v1.65.0. This is the error (which I'm including in case it's of any relevance):
2024/11/19 17:02:21 DEBUG : test123/123.txt: Need to transfer - File not found at Destination
2024/11/19 17:02:21 DEBUG : test123/123.txt: Starting multipart upload
2024/11/19 17:02:22 DEBUG : test123/123.txt: Uploading segment 0/13 size 13
2024/11/19 17:02:22 DEBUG : test123/123.txt: Cancelling multipart upload: unauthenticated: Unauthenticated
2024/11/19 17:02:23 NOTICE: test123/123.txt: Failed to cancel multipart upload: unauthenticated: Unauthenticated (upload failed due to: unauthenticated: Unauthenticated)
2024/11/19 17:02:23 ERROR : test123/123.txt: Failed to copy: unauthenticated: Unauthenticated
2024/11/19 17:03:13 DEBUG : OneDrive root 'Backup_PC': Waiting for transfers to finish
2024/11/19 17:03:13 ERROR : OneDrive root 'Backup_PC': not deleting files as there were IO errors
2024/11/19 17:03:13 ERROR : OneDrive root 'Backup_PC': not deleting directories as there were IO errors
2024/11/19 17:04:02 DEBUG : OneDrive root 'Backup_PC': Waiting for transfers to finish
2024/11/19 17:04:02 ERROR : OneDrive root 'Backup_PC': not deleting files as there were IO errors
2024/11/19 17:04:02 ERROR : OneDrive root 'Backup_PC': not deleting directories as there were IO errors
After this error happened I updated to v1.68.2 and that resolved the issue, but now the file checking is insanely slow. There are four folders I am syncing and the total number of files is about 16k. They range anywhere from 1kb to 50mb. They are compressed Duplicati backup files.
Three sections up in my above post where it shows "Checks 354/6956 , 5%
" -- in v1.65.0 this never used to count up slowly from 0 to 6956, it always just showed 6956/6956 instantly. But now in v1.68.2 it seems to check each file slowly and what used to take maybe 2-3 minutes now takes about 2 hours.
Is there something that changed in the recent versions? How do I regain the quick checking speed from 1.65.0? If I revert back to v1.65.0, file checking is quick, but of course I get that authentication error.