RClone "SYNC" Download all files again and replace exist


#1

Hello,

i use RClone with an GSuite Drive. Sometimes i do an Backup to an local Storage Server. I use “rclone -v sync Remote: localpath”

Bevor is start i test ist with “-n” here are RClone shoes me 39 new files to download… But when i start the sync RClone Download all files new and replace the exist…

I don´t know why… Any Ideas?

Regards

Massaguana


#2

Can you post a log with -vv please?

Did you try the latest beta?


#3

No, i don´t test the lastest beta… but i can do that…

-vv is no Problem, but it is really als lot… and is it possible to hide the file names? I don´t like post file Names…


#4

Okay, i think out of -vv debug logging i find the problem

2018/12/04 15:08:32 DEBUG : #########.mkv: Modification times differ by -845ms: 2018-09-06 15:37:33.845 +0200 CEST, 2018-09-06 15:37:33 +0200 CEST

there are a lot of entrys like this…


#5

and something more out of log: during Transfer is running

Transferred: 47.230G / 188.618 GBytes, 25%, 19.639 MBytes/s, ETA 2h2m52s
Errors: 9 (retrying may help)
Checks: 1467 / 1467, 100%
Transferred: 1 / 19, 5%
Elapsed time: 41m2.6s
Transferring:

  • #####.mkv: 12% /7.797G, 11.421M/s, 10m12s
    

2018/12/04 17:27:12 NOTICE: #####.mkv: Removing partially written file on error: unexpected EOF
2018/12/04 17:27:23 ERROR : #####.mkv: Failed to copy: unexpected EOF


#6

You can use:

     --modify-window duration                     Max time diff to be considered the same (default 1ns)

and increase that a bit if the times aren’t quite syncing up.

The EOF looks like something got terminated in the process?


#7

how i can use this command?

rclone -v --modify-window 1000 sync "GSuiteCacheCrypt:Plex Cloud Crypted/x264" /Volumes/x264

This Command don´t work


#8

It needs a unit so I did 1 second as an example:

--modify-window 1s

#9

What is your local storage? It looks like it only supports timestamps accurage to 1 second.


#10

It´s an linux based NAS (Thecus N10850), mounted with my Mac…

Thats not the first time i doe this “backup”… the last month it works without any problems

EDIT: With “–modify-window 1s”

2018/12/05 06:45:19 NOTICE: #####.mkv: Removing partially written file on error: write /Volumes/x264/#####.mkv: input/output error


#11

Looks like the destination has become unmounted somehow…


#12

hmm, this problems are make an api bann… great…


#13

Okay, now it works… with:

rclone -v --exclude .DS_Store --modify-window 1s sync “GSuiteCrypt:Plex Cloud Crypted/x264/” “/Volumes/x264/”


#14

Glad you got it working :smile: