Rclone quits after 3 errors

Help and Support
1

What is the problem you are having with rclone?

Runs fine for a while, but stops after 3 errors:

2020/04/16 14:24:07 INFO : bordo.com/user2/cur/1587010625.M97598P70378.mail.bordo.com.au,S=32611,W=33064:2,S: Copied (new)
2020/04/16 14:24:22 INFO : S3 bucket mailbackupbordo: Waiting for checks to finish
2020/04/16 14:24:24 INFO : S3 bucket mailbackupbordo: Waiting for transfers to finish
2020/04/16 14:24:24 ERROR : S3 bucket mailbackupbordo: not deleting files as there were IO errors
2020/04/16 14:24:24 ERROR : S3 bucket mailbackupbordo: not deleting directories as there were IO errors
2020/04/16 14:24:24 ERROR : Attempt 3/3 failed with 3 errors and: failed to open source object: open /usr/local/virtual/bordo.com/user/cur/1587010760.M397771P80510.mail.bordo.com.au,S=35800,W=36401:2,ah: no such file or directory
2020/04/16 14:24:24 Failed to sync with 3 errors: last error was: failed to open source object: open /usr/local/virtual/bordo.com/user/cur/1587010760.M397771P80510.mail.bordo.com.au,S=35800,W=36401:2,ah: no such file or directory

What is your rclone version (output from rclone version)

rclone v1.51.0

  • os/arch: darwin/amd64

  • go version: go1.13.7

Which OS you are using and how many bits (eg Windows 7, 64 bit)

macOS Catalina 10.15.4 (64-bit)

Which cloud storage system are you using? (eg Google Drive)

Wasabi

The command you were trying to run (eg rclone copy /tmp remote:tmp)

/usr/local/bin/rclone sync /usr/local/virtual remote:mailbackupbordo --filter "- *.cache" --filter "- *.index" --filter "- .log" --config "/Users/me/.config/rclone/rclone.conf" --log-level INFO --log-file "/private/var/log/rclone.log" --stats-file-name-length 0 --use-mmap --transfers=20 --checkers=20 --checksum

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

See above.

Is there a way to increase the max number of errors?

Thanks, James.

2

if you enable debug level in the log
--log-level DEBUG

3

Rclone tried to open that file and it wasn't there. What kind of file is that? Is it a dangling symlink?

4

It's an email file. I think that the user deleted the email between when rclone checked it and when it tried to transfer it.

5

Thanks for that. Tried and it finishes after almost 10 mins with:

2020/04/17 10:14:39 INFO  : bordo.com/userA/cur/1587007502.M102678P77600.mail.bordo.com.au,S=115921,W=117462:2,RSTbe: Deleted
2020/04/17 10:14:39 ERROR : Attempt 2/3 succeeded
2020/04/17 10:14:39 INFO  : 
Transferred:   	  135.207M / 135.207 MBytes, 100%, 236.021 kBytes/s, ETA 0s
Checks:           2661366 / 2661366, 100%
Deleted:              170
Transferred:          461 / 461, 100%
Elapsed time:      9m46.6s

2020/04/17 10:14:39 DEBUG : 117 go routines active
2020/04/17 10:14:39 DEBUG : rclone: Version "v1.51.0" finishing with parameters ["/usr/local/bin/rclone" "sync" "/usr/local/virtual" "remote:mailbackupbordo" "--filter" "- *.cache" "--filter" "- *.index" "--filter" "- *.log*" "--config" "/Users/me/.config/rclone/rclone.conf" "--log-level" "DEBUG" "--log-file" "/private/var/log/rclone.log" "--stats-file-name-length" "0" "--use-mmap" "--transfers=20" "--checkers=20" "--checksum"]

So does that mean that it was successful?

6

yes, successful.

it is not uncommon to have a few retries in the log.

i guess you are using rclone to backup emails.
does the email server have some kind of backup procedure?

7

Yes it does.

If there are files missing etc then rclone will do its best to transfer what it can. Running it again will tidy up what was missed.

8

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.