Sync: not deleting files as there were IO errors

PengouinPdt · February 20, 2021, 1:59pm

What is the problem you are having with rclone?

I search to understand the reason of this error message:

Failed to sync with 8 errors: last error was: not deleting files as there were IO errors

What is your rclone version (output from `rclone version`)

$ rclone version
rclone v1.53.3-DEV

os/arch: openbsd/amd64
go version: go1.15.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

OpenBSD 6.8, amd64

Which cloud storage system are you using? (eg Google Drive)

Mega

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone sync --log-file=rclone-mega.log -v -L -P /home/me/Administration/Bckps/ mega-backups:Bckps

The rclone config contents with secrets removed.

[mega-backups]
type = mega
user = myemail@disroot.org
pass =

A log from the command with the `-vv` flag

2021/02/20 14:32:33 DEBUG : rclone: Version "v1.53.3-DEV" starting with parameters ["rclone" "sync" "--log-file=rclone-mega.log" "-vv" "-L" "-P" "/home/me/Administration/Bckps/" "mega-backups:Bckps"]
2021/02/20 14:32:33 DEBUG : Creating backend with remote "/home/me/Administration/Bckps/"
2021/02/20 14:32:33 DEBUG : Using config file from "/home/me/.config/rclone/rclone.conf"
2021/02/20 14:32:33 DEBUG : Creating backend with remote "mega-backups:Bckps"
2021/02/20 14:32:39 DEBUG : sh1web/etc/changelist: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/changelist: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/disktab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/disktab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/doas.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/doas.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/dumpdates: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/dumpdates: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/fbtab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/fbtab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/fstab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/fstab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ftpusers: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ftpusers: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/gettytab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/gettytab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/group: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/group: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/hostname.vio0: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/hostname.vio0: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/hosts: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/hosts: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/installurl: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/installurl: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/kbdtype: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/kbdtype: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ksh.kshrc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ksh.kshrc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/localtime: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/localtime: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/locate.rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/locate.rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/login.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/login.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/magic: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/magic: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/mail.rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/mail.rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/mailer.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/mailer.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/moduli: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/moduli: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/motd: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/motd: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/mygate: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/mygate: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/myname: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/myname: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/netstart: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/netstart: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/newsyslog.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/newsyslog.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ntpd.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ntpd.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/passwd: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/passwd: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badhost.txt: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badhost.txt: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badips.txt: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badips.txt: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf.os: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf.os: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini.origin: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini.origin: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-fpm.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-fpm.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/protocols: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/protocols: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pwd.db: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pwd.db: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/resolv.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/resolv.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rmt: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rmt: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rpc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rpc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/services: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/services: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/shells: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/shells: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/slsh.rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/slsh.rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/syslog.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/syslog.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/termcap: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/termcap: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ttys: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ttys: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/usermgmt.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/usermgmt.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-07_01-42-00.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-07_01-42-00.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-31-48.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-31-48.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-46-27.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-46-27.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-09_01-31-37.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-09_01-31-37.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-10_01-31-39.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-10_01-31-39.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-11_01-32-04.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-11_01-32-04.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-12_01-31-52.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-12_01-31-52.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-13_01-31-37.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-13_01-31-37.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-15_01-31-43.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-15_01-31-43.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-16_01-31-38.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-16_01-31-38.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-17_01-31-36.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-17_01-31-36.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-18_01-32-20.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-18_01-32-20.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-19_01-31-50.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-19_01-31-50.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1dns/etc/acme-client.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1dns/etc/acme-client.conf: Unchanged skipping
(...)
2021/02/20 14:32:40 DEBUG : mega root 'Bckps': Waiting for checks to finish
2021/02/20 14:32:40 DEBUG : sh1web/var/www/htdocs/jw.huc.fr.eu.org/www/vendor/squizlabs/php_codesniffer/src/Standards/Squiz/Tests/PHP/NonExecutableCodeUnitTest.php: Sizes identical
2021/02/20 14:32:40 DEBUG : sh1web/var/www/htdocs/jw.huc.fr.eu.org/www/vendor/squizlabs/php_codesniffer/src/Standards/Squiz/Tests/PHP/NonExecutableCodeUnitTest.php: Unchanged skipping
2021/02/20 14:32:40 DEBUG : mega root 'Bckps': Waiting for transfers to finish
2021/02/20 14:32:40 ERROR : mega root 'Bckps': not deleting files as there were IO errors
2021/02/20 14:32:40 ERROR : mega root 'Bckps': not deleting directories as there were IO errors
2021/02/20 14:32:40 INFO  : There was nothing to transfer
2021/02/20 14:32:40 ERROR : Attempt 3/3 failed with 8 errors and: not deleting files as there were IO errors
2021/02/20 14:32:40 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 8 (retrying may help)
Checks:             22434 / 22434, 100%
Elapsed time:         6.7s

2021/02/20 14:32:40 DEBUG : 8 go routines active
2021/02/20 14:32:40 Failed to sync with 8 errors: last error was: not deleting files as there were IO errors

Log file is very very large; I copy here a small part; I hope that's relevant!

asdffdsa · February 20, 2021, 5:01pm

hi,

that is how sync works
https://rclone.org/commands/rclone_sync/#synopsis
"Note that files in the destination won't be deleted if there were any errors at any point."

PengouinPdt · February 20, 2021, 5:20pm

It appears that for you is clear. Excuse-me, but I dont understand! ???

asdffdsa · February 20, 2021, 5:23pm

yes, it can be confusing.

during the sync:
if there is an error, then rclone will not delete files.

PengouinPdt · February 20, 2021, 5:25pm

Ok, but what can generate these IO errors?!
Is this on Mega? or my system?

asdffdsa · February 20, 2021, 5:29pm

search the log flle for ERROR

if you want, i can take a look at the log file.
you can upload the log file to the forum using
or using https://pastebin.com/

PengouinPdt · February 20, 2021, 5:38pm

I attempt to post the paste (will be delete on 1 week).

asdffdsa · February 20, 2021, 5:44pm

your system

the errors are from some issue with symlink
"ERROR : sh1web/etc/nginx/sites-enable/doc.huc.fr.eu.org: Listing error: symlink"

you can search https://rclone.org/flags/ for flags about symlink

PengouinPdt · February 20, 2021, 6:20pm

Ok, now i use

--skip-links

I hope it's good!

asdffdsa · February 20, 2021, 6:22pm

me too

you can test with https://rclone.org/docs/#n-dry-run

system · April 22, 2021, 2:22pm

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.