Hi all, I'm using rclone sync to synchronize one NAS folder to OneDrive. I noted that some folders that have been removed from source are still present in OneDrive. I can see these folders on the root of my remote OneDrive folder and I don't know if there are other subfolders not deleted on remote. I raised the log level to DEBUG but I don't detect any errors regarding these folders except the following error that appears from time to time:
2020/12/04 06:15:01 DEBUG : One drive root 'Data': Waiting for checks to finish
2020/12/04 06:15:01 DEBUG : One drive root 'Data': Waiting for transfers to finish
2020/12/04 06:15:01 ERROR : One drive root 'Data': not deleting files as there were IO errors
2020/12/04 06:15:01 ERROR : One drive root 'Data': not deleting directories as there were IO errors
What is your rclone version (output from rclone version)
I'm using rclone v1.53.2.
Which OS you are using and how many bits (eg Windows 7, 64 bit)
The NAS is a CentOS 6 system 32 bit.
Which cloud storage system are you using? (eg Google Drive)
The cloud storage I'm using is OneDrive.
The rclone config contents with secrets removed.
[OneDrive]
type = onedrive
token = {xxxxx}
drive_id = xxxxx
drive_type = business
Many thanks for you answer. This is the log with his context:
2020/12/05 04:34:14 DEBUG : folder1/file1: Size and modification time the same (differ by 0s, within tolerance 1s)
2020/12/05 04:34:14 DEBUG : folder1/file1: Unchanged skipping
2020/12/05 04:34:14 DEBUG : One drive root 'Data': Waiting for transfers to finish
2020/12/05 04:34:14 ERROR : One drive root 'Data': not deleting files as there were IO errors
2020/12/05 04:34:14 ERROR : One drive root 'Data': not deleting directories as there were IO errors
2020/12/05 04:34:14 ERROR : Attempt 1/3 failed with 11 errors and: 400 Bad Request:
2020/12/05 04:34:14 DEBUG : folder2/file2: Size and modification time the same (differ by -919.445804ms, within tolerance 1s)
2020/12/05 04:34:14 DEBUG : folder2/file2: Unchanged skipping
It is hard to understand which file or folder this ERROR is related to.
These are all the log lines where the word ERROR appears (I have put PATH instead of filepath):
2020/12/05 02:50:52 ERROR :PATH: corrupted on transfer
2020/12/05 03:33:33 ERROR :PATH: Failed to copy
2020/12/05 03:33:33 ERROR :PATH: Failed to copy
2020/12/05 03:33:33 ERROR :PATH: Failed to copy
2020/12/05 03:33:33 ERROR :PATH: Failed to copy
2020/12/05 03:33:33 ERROR :PATH: Failed to copy
2020/12/05 03:34:55 ERROR :PATH: Failed to copy
2020/12/05 03:34:55 ERROR :PATH: Failed to copy
2020/12/05 03:34:55 ERROR :PATH: Failed to copy
2020/12/05 03:34:56 ERROR :PATH: Failed to copy
2020/12/05 03:34:56 ERROR :PATH: Failed to copy
2020/12/05 04:34:14 ERROR :One drive root 'Data': not deleting files as there were IO errors
2020/12/05 04:34:14 ERROR :One drive root 'Data': not deleting directories as there were IO errors
2020/12/05 04:34:14 ERROR :Attempt 1/3 failed with 11 errors and: 400 Bad Request
2020/12/05 05:42:40 ERROR :PATH: Failed to copy
2020/12/05 05:42:40 ERROR :PATH: Failed to copy
2020/12/05 05:42:40 ERROR :PATH: Failed to copy
2020/12/05 05:42:40 ERROR :PATH: Failed to copy
2020/12/05 05:42:40 ERROR :PATH: Failed to copy
2020/12/05 06:11:52 ERROR :PATH: Failed to copy
2020/12/05 06:11:52 ERROR :PATH: Failed to copy
2020/12/05 06:11:52 ERROR :PATH: Failed to copy
2020/12/05 06:11:52 ERROR :PATH: Failed to copy
2020/12/05 06:11:53 ERROR :PATH: Failed to copy
2020/12/05 06:41:12 ERROR :One drive root 'Data': not deleting files as there were IO errors
2020/12/05 06:41:12 ERROR :One drive root 'Data': not deleting directories as there were IO errors
2020/12/05 06:41:12 ERROR :Attempt 2/3 failed with 10 errors and: 400 Bad Request
2020/12/05 08:15:24 ERROR :PATH: Failed to copy
2020/12/05 08:15:24 ERROR :PATH: Failed to copy
2020/12/05 08:15:25 ERROR :PATH: Failed to copy
2020/12/05 08:15:25 ERROR :PATH: Failed to copy
2020/12/05 08:15:25 ERROR :PATH: Failed to copy
2020/12/05 08:34:17 ERROR :PATH: Failed to copy
2020/12/05 08:34:17 ERROR :PATH: Failed to copy
2020/12/05 08:34:17 ERROR :PATH: Failed to copy
2020/12/05 08:34:17 ERROR :PATH: Failed to copy
2020/12/05 08:34:17 ERROR :PATH: Failed to copy
2020/12/05 08:51:51 ERROR :One drive root 'Data': not deleting files as there were IO errors
2020/12/05 08:51:51 ERROR :One drive root 'Data': not deleting directories as there were IO errors
2020/12/05 08:51:51 ERROR :Attempt 3/3 failed with 10 errors and: 400 Bad Request
So there some ERRORs but the lines:
not deleting files as there were IO errors
not deleting directories as there were IO errors
400 Bad Request
seems not to be related to ERRORs above or below the real ERRORs looking at the time. How can I interpret these ERRORs? I think that those lines are some sort of summary of the above ERRORS.
This synchronization takes up to 6 hours to complete. Because of the DEBUG option the entire log file is 402 MB in size, where for each synced file there is a log line (or more than one).
There is only one ERROR "corrupted on transfer" and is the one I posted above. I think that this file will be in sync tomorrow, no problem. The problem, as stated in the subject of this topic, is that some folders removed on source are still present in the root of remote and there are no errors in the DEBUG log related to this issue. The folders still on remote contains files and they have been deleted from source (I don't know when - I'm keeping logs for just one day now that I'm using the DEBUG option). I will investigate further and will let you know.