Sync: not deleting files as there were IO errors

What is the problem you are having with rclone?

I search to understand the reason of this error message:

Failed to sync with 8 errors: last error was: not deleting files as there were IO errors

What is your rclone version (output from rclone version)

$ rclone version
rclone v1.53.3-DEV

  • os/arch: openbsd/amd64
  • go version: go1.15.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

OpenBSD 6.8, amd64

Which cloud storage system are you using? (eg Google Drive)

Mega

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync --log-file=rclone-mega.log -v -L -P /home/me/Administration/Bckps/ mega-backups:Bckps

The rclone config contents with secrets removed.

[mega-backups]
type = mega
user = myemail@disroot.org
pass = 

A log from the command with the -vv flag

2021/02/20 14:32:33 DEBUG : rclone: Version "v1.53.3-DEV" starting with parameters ["rclone" "sync" "--log-file=rclone-mega.log" "-vv" "-L" "-P" "/home/me/Administration/Bckps/" "mega-backups:Bckps"]
2021/02/20 14:32:33 DEBUG : Creating backend with remote "/home/me/Administration/Bckps/"
2021/02/20 14:32:33 DEBUG : Using config file from "/home/me/.config/rclone/rclone.conf"
2021/02/20 14:32:33 DEBUG : Creating backend with remote "mega-backups:Bckps"
2021/02/20 14:32:39 DEBUG : sh1web/etc/changelist: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/changelist: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/daily.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/disktab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/disktab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/doas.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/doas.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/dumpdates: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/dumpdates: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/fbtab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/fbtab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/fstab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/fstab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ftpusers: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ftpusers: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/gettytab: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/gettytab: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/group: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/group: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/hostname.vio0: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/hostname.vio0: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/hosts: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/hosts: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/installurl: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/installurl: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/kbdtype: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/kbdtype: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ksh.kshrc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ksh.kshrc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/localtime: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/localtime: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/locate.rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/locate.rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/login.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/login.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/magic: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/magic: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/mail.rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/mail.rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/mailer.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/mailer.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/moduli: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/moduli: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/monthly.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/motd: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/motd: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/mygate: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/mygate: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/myname: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/myname: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/netstart: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/netstart: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/newsyslog.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/newsyslog.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ntpd.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ntpd.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/passwd: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/passwd: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badhost.txt: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badhost.txt: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badips.txt: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf-badips.txt: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf.os: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pf.os: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini.origin: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-7.4.ini.origin: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-fpm.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/php-fpm.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/protocols: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/protocols: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/pwd.db: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/pwd.db: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rc.conf.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/resolv.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/resolv.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rmt: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rmt: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/rpc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/rpc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/services: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/services: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/shells: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/shells: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/slsh.rc: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/slsh.rc: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/syslog.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/syslog.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/termcap: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/termcap: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/ttys: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/ttys: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/usermgmt.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/usermgmt.conf: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly.local: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/etc/weekly.local: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-07_01-42-00.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-07_01-42-00.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-31-48.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-31-48.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-46-27.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-08_01-46-27.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-09_01-31-37.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-09_01-31-37.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-10_01-31-39.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-10_01-31-39.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-11_01-32-04.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-11_01-32-04.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-12_01-31-52.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-12_01-31-52.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-13_01-31-37.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-13_01-31-37.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-15_01-31-43.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-15_01-31-43.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-16_01-31-38.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-16_01-31-38.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-17_01-31-36.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-17_01-31-36.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-18_01-32-20.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-18_01-32-20.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-19_01-31-50.log: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1web/logs/bckp_2021-02-19_01-31-50.log: Unchanged skipping
2021/02/20 14:32:39 DEBUG : sh1dns/etc/acme-client.conf: Sizes identical
2021/02/20 14:32:39 DEBUG : sh1dns/etc/acme-client.conf: Unchanged skipping
(...)
2021/02/20 14:32:40 DEBUG : mega root 'Bckps': Waiting for checks to finish
2021/02/20 14:32:40 DEBUG : sh1web/var/www/htdocs/jw.huc.fr.eu.org/www/vendor/squizlabs/php_codesniffer/src/Standards/Squiz/Tests/PHP/NonExecutableCodeUnitTest.php: Sizes identical
2021/02/20 14:32:40 DEBUG : sh1web/var/www/htdocs/jw.huc.fr.eu.org/www/vendor/squizlabs/php_codesniffer/src/Standards/Squiz/Tests/PHP/NonExecutableCodeUnitTest.php: Unchanged skipping
2021/02/20 14:32:40 DEBUG : mega root 'Bckps': Waiting for transfers to finish
2021/02/20 14:32:40 ERROR : mega root 'Bckps': not deleting files as there were IO errors
2021/02/20 14:32:40 ERROR : mega root 'Bckps': not deleting directories as there were IO errors
2021/02/20 14:32:40 INFO  : There was nothing to transfer
2021/02/20 14:32:40 ERROR : Attempt 3/3 failed with 8 errors and: not deleting files as there were IO errors
2021/02/20 14:32:40 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 8 (retrying may help)
Checks:             22434 / 22434, 100%
Elapsed time:         6.7s

2021/02/20 14:32:40 DEBUG : 8 go routines active
2021/02/20 14:32:40 Failed to sync with 8 errors: last error was: not deleting files as there were IO errors

Log file is very very large; I copy here a small part; I hope that's relevant! :stuck_out_tongue:

hi,

that is how sync works
https://rclone.org/commands/rclone_sync/#synopsis
"Note that files in the destination won't be deleted if there were any errors at any point."

It appears that for you is clear. Excuse-me, but I dont understand! ???

yes, it can be confusing.

during the sync:
if there is an error, then rclone will not delete files.

Ok, but what can generate these IO errors?!
Is this on Mega? or my system?

search the log flle for ERROR

if you want, i can take a look at the log file.
you can upload the log file to the forum using image
or using https://pastebin.com/

I attempt to post the paste (will be delete on 1 week).

your system

the errors are from some issue with symlink
"ERROR : sh1web/etc/nginx/sites-enable/doc.huc.fr.eu.org: Listing error: symlink"

you can search https://rclone.org/flags/ for flags about symlink

Ok, now i use

--skip-links

I hope it's good! :stuck_out_tongue:

me too :upside_down_face:

you can test with https://rclone.org/docs/#n-dry-run

1 Like