Rclone never stops

Help and Support
1

I am using rclone v1.47.0 - os/arch: linux/amd64 - go version: go1.12.4 on Ubuntu 18.04 to an Ubuntu 18.04 server running a snap of Nextcloud. I have rclone set up to backup to the Nextcloud instance using Webdav with this command,

rclone --transfers=50 --checkers=50 --drive-chunk-size=163840k --progress sync /archive/Archive mbs:Backup

Previously I was using,

rclone copy /archive/Archive mbs:Backup

Neither command has ever ended. They just go on and on and on and on. There is a lot more network traffic with the latest command but still it never gets to the end where it has actually synced the data. What am I doing wrong?

2

Run with -v or -vv and see what it is doing. Are you copying a lot of data?

3

I have two setups, one is copying about 50GB of data and the other is 300GB. Both to different nextcloud accounts. The conf is from the 300GB one.

Added info;
rclone.conf
[mbs]
type = webdav
url = http://192.168.0.1/remote.php/webdav/
vendor = nextcloud
user = xxxxxxxx
pass = xxxxxxxxxxxxxxxxxxxxxxxxxx

I have run with -vv and here is the zipped log file. Only a partial run though, maybe six minutes.

4

It seems like you have quite the lot of little files and it doesn't seem anything is getting stuck.

How many files and what's the size you are backing up?

You can check via a few find commands:

[felix@gemini ~]$ cd /GD
[felix@gemini GD]$ find . -type f | wc -l
26973
[felix@gemini GD]$ find . -type d | wc -l
2833
[felix@gemini GD]$ du -sh *
100M	100M.file
512	mounted
26T	Movies
43T	TV
5

I see quite a few lines like this in the log with large time differences, which looks like maybe rclone's attempt to set the modification time is not working on nextcloud.

2019/06/24 13:58:06 DEBUG : Backup/Downloads/V.A. - Top 1000 Classic Rock Songs of AllTime (2011) [WwW.ZoNaTorrent.CoM]/V.A. - Top 1000 Classic Rock Songs of AllTime (2011) [WwW.ZoNaTorrent.CoM]/V.A. - Top 1000 Classic Rock Songs of AllTime (2011) [WwW.ZoNaTo/0501 - 0750/575.Alice In Chains-1995-Alice In Chains-01-Grind.mp3: Modification times differ by 71936h41m22s: 2011-03-30 01:30:47 +0200 CEST, 2019-06-13 08:12:09 +0000 GMT

Can you do a simple test like this just to check that the modification times are being set correctly in nextcloud?

cd /tmp/
mkdir source
cd source
touch -d 20010101 file.txt 
rclone lsl .
rclone copy . mbs:test_folder
rclone lsl  mbs:test_folder
6

find . -type f | wc -l
250101

find . -type d | wc -l
39904

du -sh *
314G Archive
du: cannot read directory 'lost+found': Permission denied
16K lost+found

The other one is only 50G though and has been left for almost a day without it finishing either.

7

rclone lsl .
0 2001-01-01 00:00:00.000000000 file.txt

rclone copy . mbs:test_folder
rclone lsl mbs:test_folder
0 2001-01-01 00:00:00.000000000 file.txt

Is all I got out of that

8

That looks fine - the timestamp was preserved correctly on nextcloud which is what I was concerned about.

This will certainly take some time to upload. You can keep retrying the upload until it transfers everything.

9

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.