I'm on Windows server and I need to backup a distant webdav server (600GB and millions of files). I'd like to do a full backup first time during the weekend from friday 9PM til monday 06:00AM, then every night copy only new/modified files and do versionning (keep 20 oldest versions).
What's the best and easiest way to do it with rclone ?
hello and welcome to the forum,
rclone sync with
--backup-dir using a timestamp.
the timestamp would have to be created with some kind of simple script
a basic example of a first run
rclone sync webdav: c:\path\to\backup.folder\current --backup-dir=c:\path\to\backup.folder\archive\20210303
for the daily run, add
take a few minutes to read the docs and let me know if you have any questions.
Thank you for your reply.
Does this works also in copy mode instead of sync ?
Where should I add --min-age=24h ?
The webdav has thousands of folders containing files, the best for me would be to have a full copy and inside each folders, the versionned files with different timestamp, is it possible ?
copy will copy files from source to dest, will not delete files in the dest.
sync will copy files from source to dest, will delete files in the dest
--min-age is added to the rclone command.
you should be able to use
Yes but where ? at the end of the full line ?
OK but how can i use it ? I need to use the backup-dir command too ?
Could you gave me the full command maybe ?
Thanks a lot
does not matter where the flags are positioned.
i have never used
--suffix, do not want to have the old files in the same folder are the newest file.
if you want to test a command and you are not sure what will happen,
Ok will try this, thanks for your help
Just FYI, webDAV does not support modtime. So if you change a file but you do not change the size (not super likely but could happen), rclone will not see it.
This doesn't address your question but it is good to be aware of details like this.
excellent point, that would mean my suggestion about
--min-age could be a ticking time
of course, a test recovery of a simulated disaster for a proposed backup solution, would catch that.
to clarify, it depends on the particular webdav server.
I'm nearly there, except for the date, I ran :
rclone -v copy Source: E:\Destination --suffix -revision-".$(date +%F)" --suffix-keep-extension
It did copied the modified file and kept the old file but I cant get the date, instead I get :
Any idea what is the windows command to get the date ?
not a linux expert, perhpas try
Thank you, I'm on windows not linux
I'm trying this tonight : -revision-"%date%"
that will not work.
are you using
dos batch file?
I'm adding this to my .bat :
FOR /F "TOKENS=1 eol=/ DELIMS=/ " %%A IN ('DATE/T') DO SET dd=%%A
FOR /F "TOKENS=1,2 eol=/ DELIMS=/ " %%A IN ('DATE/T') DO SET mm=%%B
FOR /F "TOKENS=1,2,3 eol=/ DELIMS=/ " %%A IN ('DATE/T') DO SET yyyy=%%C
rclone -v copy source: E:\destination --suffix -revision-"%datestr%" --suffix-keep-extension
i find that if you are going to store more than one year, to use.
easier to view in a file manager
Ok will post here tomorrow if this worked.
Thank you for your help
Ok it works fine now
One last thing, what is the command to end the job when the full scan is done ?
what scan, i did not see a
rclone scan command?
rclone copy command will copy the files and then exit on it own
yes i mean rclone copy sorry, but it doesnt exit when copy is done, it keeps trying to copy error files.