WebDav, Synology, Sync needs 2 attempts

#1

Hi all

Just tried my very first sync with rclone - it's working (all files are there), but for some reason, it requires 2 attempts to complete. I'm finding this worrying, so before I use it for my main syncing, does anybody know whats going on here? Target: Synology WebDav, User has read/write access.

/ # rclone sync /source synology:target --progress -vv
2019/05/11 18:37:48 DEBUG : rclone: Version "v1.47.0" starting with parameters [
"rclone" "sync" "/source" "synology:target" "--progress" "-vv"]
2019/05/11 18:37:48 DEBUG : Using config file from "/root/.config/rclone/rclone.
conf"
2019-05-11 18:37:48 INFO : webdav root 'target': Waiting for checks to finish
2019-05-11 18:37:48 INFO : webdav root 'target': Waiting for transfers to finis
h
2019-05-11 18:37:48 ERROR : test.srt:
Failed to copy: Update mkParentDir failed: 403 Forbidden
2019-05-11 18:37:49 INFO : test/testlin.txt: Copied (new)
2019-05-11 18:37:49 INFO : test.nfo:
Copied (new)
2019-05-11 18:39:11 INFO : test.mkv:
Copied (new)
2019-05-11 18:39:11 ERROR : webdav root 'target': not deleting files as there we
re IO errors
2019-05-11 18:39:11 ERROR : webdav root 'target': not deleting directories as th
ere were IO errors
2019-05-11 18:39:11 ERROR : Attempt 1/3 failed with 2 errors and: Update mkParen
tDir failed: 403 Forbidden
2019-05-11 18:39:11 DEBUG : test/testlin.txt: Sizes identical
2019-05-11 18:39:11 DEBUG : test/testlin.txt: Unchanged skipping
2019-05-11 18:39:11 DEBUG : test.mkv:
Sizes identical
2019-05-11 18:39:11 DEBUG : test.mkv:
Unchanged skipping
2019-05-11 18:39:11 DEBUG : test.nfo:
Sizes identical
2019-05-11 18:39:11 DEBUG : test.nfo:
Unchanged skipping
2019-05-11 18:39:11 INFO : webdav root 'target': Waiting for checks to finish
2019-05-11 18:39:11 INFO : webdav root 'target': Waiting for transfers to finis
h
2019-05-11 18:39:11 INFO : test.srt:
Copied (new)
2019-05-11 18:39:11 INFO : Waiting for deletions to finish
2019-05-11 18:39:11 ERROR : Attempt 2/3 succeeded
Transferred: 7.648G / 7.648 GBytes, 100%, 93.780 MBytes/s, ETA 0s
Errors: 0
Checks: 3 / 3, 100%
Transferred: 4 / 4, 100%
Elapsed time: 1m23.5s
2019/05/11 18:39:11 INFO :
Transferred: 7.648G / 7.648 GBytes, 100%, 93.780 MBytes/s, ETA 0s
Errors: 0
Checks: 3 / 3, 100%
Transferred: 4 / 4, 100%
Elapsed time: 1m23.5s

2019/05/11 18:39:11 DEBUG : 5 go routines active
2019/05/11 18:39:11 DEBUG : rclone: Version "v1.47.0" finishing with parameters
["rclone" "sync" "/source" "synology:target" "--progress" "-vv"]

Thx

#2

I suspect the webdav server is returing 403 when rclone tries to create a directory that already exists...

Can you run with -vv --dump headers and post the log to confirm?

#3

Here is the log:

https://pastebin.com/eTNEt8AM

What can be done if it is what you expect?
thx

#4

That is what is happening. Though it isn't consistent...

I'm not sure I want to ignore a 403 for an already created directory as 403 is an error which might legitimately be returned.

I think what needs to be done is use a directory cache in webdav to stop it trying to create the directories more than once.

That said, the error is harmless and the retry will fix it up so it maybe isn't urgent.