What is the problem you are having with rclone?
rclone does not update mtime on directories.
remote is a mac-mini, using SFTP, and using APFS.
local is a NAS, running debian/TrueNAS, and using ZFS.
And... something I think is important... the sync direction is the opposite to the usual one: from SFTP to local.
The NAS is what runs rclone, not the mac-mini!
Run the command 'rclone version' and share the full output of the command.
rclone v1.65.2
- os/version: debian 12.4 (64 bit)
- os/kernel: 6.6.32-production+truenas (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.8
- go/linking: dynamic
- go/tags: non
Which cloud storage system are you using? (eg Google Drive)
From SFTP (mac-mini) to Local (debian/TrueNAS).
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone sync -i --progress --create-empty-src-dirs --copy-links --track-renames 'mac-mini:/Volumes/Users/vicmarto' '/mnt/backup/Users/vicmarto'
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[mac-mini]
type = sftp
host = 10.0.1.10
user = vicmarto
key_file = /root/.ssh/id_ed25519
shell_type = unix
md5sum_command = md5 -r
sha1sum_command = shasum -a 1
A log from the command that you were trying to run with the -vv flag
2024/09/11 16:17:54 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "sync" "-vv" "-i" "--progress" "--create-empty-src-dirs" "--copy-links" "--track-renames" "mac-mini:/Volumes/Users/vicmarto" "/mnt/backup/Users/vicmarto"]
2024/09/11 16:17:54 DEBUG : Creating backend with remote "mac-mini:/Volumes/Users/vicmarto"
2024/09/11 16:17:54 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2024/09/11 16:17:54 DEBUG : sftp://vicmarto@10.0.1.10:22//Volumes/Users/vicmarto: New connection 10.0.1.150:47158->10.0.1.10:22 to "SSH-2.0-OpenSSH_9.7"
2024/09/11 16:17:54 DEBUG : sftp://vicmarto@10.0.1.10:22//Volumes/Users/vicmarto: Shell type "unix" from config
2024/09/11 16:17:54 DEBUG : sftp://vicmarto@10.0.1.10:22//Volumes/Users/vicmarto: Using root directory "/Volumes/Users/vicmarto"
2024/09/11 16:17:54 DEBUG : Creating backend with remote "/mnt/backup/Users/vicmarto"
2024/09/11 16:17:54 DEBUG : local: detected overridden config - adding "{12rtk}" suffix to name
2024/09/11 16:17:54 DEBUG : fs cache: renaming cache item "/mnt/backup/Users/vicmarto" to be canonical "local{12rtk}:/mnt/backup/Users/vicmarto"
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : sftp://vicmarto@10.0.1.10:22//Volumes/Users/vicmarto: New connection 10.0.1.150:47162->10.0.1.10:22 to "SSH-2.0-OpenSSH_9.7"
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : sftp://vicmarto@10.0.1.10:22//Volumes/Users/vicmarto: New connection 10.0.1.150:47172->10.0.1.10:22 to "SSH-2.0-OpenSSH_9.7"
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:54 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : sftp://vicmarto@10.0.1.10:22//Volumes/Users/vicmarto: New connection 10.0.1.150:47184->10.0.1.10:22 to "SSH-2.0-OpenSSH_9.7"
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Size and modification time the same (differ by 0s, within tolerance 1s)
2024/09/11 16:17:55 DEBUG : FILE NAME REDACTED : Unchanged skipping
.
.
.
.
ONE MINUTE WITH LOTS OF 'Unchanged skipping' and 'Size and modification time the same (differ by 0s, within tolerance 1s)'
.
.
.
.
2024/09/11 16:18:51 INFO : Local file system at /mnt/backup/Users/vicmarto: Making map for --track-renames
2024/09/11 16:18:51 INFO : Local file system at /mnt/backup/Users/vicmarto: Finished making map for --track-renames
2024/09/11 16:18:51 DEBUG : Local file system at /mnt/backup/Users/vicmarto: Waiting for checks to finish
2024/09/11 16:18:51 DEBUG : Local file system at /mnt/backup/Users/vicmarto: Waiting for renames to finish
2024/09/11 16:18:51 DEBUG : Local file system at /mnt/backup/Users/vicmarto: Waiting for transfers to finish
2024/09/11 16:18:51 DEBUG : Waiting for deletions to finish
2024/09/11 16:18:51 INFO : There was nothing to transfer
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 265032 / 265032, 100%
Elapsed time: 57.0s
2024/09/11 16:18:51 NOTICE:
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 265032 / 265032, 100%
Elapsed time: 57.0s
2024/09/11 16:18:51 DEBUG : 76 go routines active
2024/09/11 16:18:51 DEBUG : sftp://vicmarto@10.0.1.10:22//Volumes/Users/vicmarto: Closing 8 unused connections
Things I've tried without success:
- --metadata
- --sftp-set-modtime=false
- --refresh-times --update
- --update --use-server-modtime
One important point I found: when I try to sync in the usual way: from local (Mac-mini) > SFTP (NAS), and therefore run rclone on Mac-mini, the NAS updates mtime on the directories! Does this mean the problem is with the Mac-mini's SFTP?
I don't know if it's relevant, but these are the sshd options on the mac-mini:
port 22
addressfamily inet
listenaddress 192.168.1.10:22
listenaddress 10.0.1.150:22
usepam no
logingracetime 120
x11displayoffset 10
maxauthtries 6
maxsessions 10
clientaliveinterval 0
clientalivecountmax 3
requiredrsasize 1024
streamlocalbindmask 0177
unusedconnectiontimeout none
permitrootlogin without-password
ignorerhosts yes
ignoreuserknownhosts no
hostbasedauthentication no
hostbasedusesnamefrompacketonly no
pubkeyauthentication yes
kerberosauthentication no
kerberosorlocalpasswd yes
kerberosticketcleanup yes
gssapiauthentication no
gssapicleanupcredentials yes
passwordauthentication no
kbdinteractiveauthentication no
printmotd yes
printlastlog yes
x11forwarding no
x11uselocalhost yes
permittty yes
permituserrc yes
strictmodes yes
tcpkeepalive yes
permitemptypasswords no
compression no
gatewayports no
usedns no
allowtcpforwarding yes
allowagentforwarding yes
disableforwarding no
allowstreamlocalforwarding yes
streamlocalbindunlink no
fingerprinthash SHA256
exposeauthinfo no
pidfile /var/run/sshd.pid
modulifile /etc/ssh/moduli
xauthlocation /usr/X11R6/bin/xauth
ciphers chacha20-poly1305@openssh.com,aes128-ctr,aes192-ctr,aes256-ctr,aes128-gcm@openssh.com,aes256-gcm@openssh.com
macs umac-64-etm@openssh.com,umac-128-etm@openssh.com,hmac-sha2-256-etm@openssh.com,hmac-sha2-512-etm@openssh.com,hmac-sha1-etm@openssh.com,umac-64@openssh.com,umac-128@openssh.com,hmac-sha2-256,hmac-sha2-512,hmac-sha1
banner none
forcecommand none
chrootdirectory none
trustedusercakeys none
revokedkeys none
securitykeyprovider internal
authorizedprincipalsfile none
versionaddendum none
authorizedkeyscommand none
authorizedkeyscommanduser none
authorizedprincipalscommand none
authorizedprincipalscommanduser none
hostkeyagent none
kexalgorithms sntrup761x25519-sha512@openssh.com,curve25519-sha256,curve25519-sha256@libssh.org,ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group16-sha512,diffie-hellman-group18-sha512,diffie-hellman-group14-sha256
casignaturealgorithms ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ssh-ed25519@openssh.com,sk-ecdsa-sha2-nistp256@openssh.com,rsa-sha2-512,rsa-sha2-256
hostbasedacceptedalgorithms ssh-ed25519-cert-v01@openssh.com,ecdsa-sha2-nistp256-cert-v01@openssh.com,ecdsa-sha2-nistp384-cert-v01@openssh.com,ecdsa-sha2-nistp521-cert-v01@openssh.com,sk-ssh-ed25519-cert-v01@openssh.com,sk-ecdsa-sha2-nistp256-cert-v01@openssh.com,rsa-sha2-512-cert-v01@openssh.com,rsa-sha2-256-cert-v01@openssh.com,ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ssh-ed25519@openssh.com,sk-ecdsa-sha2-nistp256@openssh.com,rsa-sha2-512,rsa-sha2-256
hostkeyalgorithms ssh-ed25519-cert-v01@openssh.com,ecdsa-sha2-nistp256-cert-v01@openssh.com,ecdsa-sha2-nistp384-cert-v01@openssh.com,ecdsa-sha2-nistp521-cert-v01@openssh.com,sk-ssh-ed25519-cert-v01@openssh.com,sk-ecdsa-sha2-nistp256-cert-v01@openssh.com,rsa-sha2-512-cert-v01@openssh.com,rsa-sha2-256-cert-v01@openssh.com,ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ssh-ed25519@openssh.com,sk-ecdsa-sha2-nistp256@openssh.com,rsa-sha2-512,rsa-sha2-256
pubkeyacceptedalgorithms ssh-ed25519-cert-v01@openssh.com,ecdsa-sha2-nistp256-cert-v01@openssh.com,ecdsa-sha2-nistp384-cert-v01@openssh.com,ecdsa-sha2-nistp521-cert-v01@openssh.com,sk-ssh-ed25519-cert-v01@openssh.com,sk-ecdsa-sha2-nistp256-cert-v01@openssh.com,rsa-sha2-512-cert-v01@openssh.com,rsa-sha2-256-cert-v01@openssh.com,ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ssh-ed25519@openssh.com,sk-ecdsa-sha2-nistp256@openssh.com,rsa-sha2-512,rsa-sha2-256
loglevel INFO
syslogfacility AUTH
authorizedkeysfile .ssh/authorized_keys
hostkey /etc/ssh/ssh_host_rsa_key
hostkey /etc/ssh/ssh_host_ecdsa_key
hostkey /etc/ssh/ssh_host_ed25519_key
acceptenv LANG
acceptenv LC_*
authenticationmethods any
channeltimeout none
subsystem sftp /usr/libexec/sftp-server
maxstartups 10:30:100
persourcemaxstartups none
persourcenetblocksize 32:128
permittunnel no
ipqos af21 cs1
rekeylimit 0 0
permitopen any
permitlisten any
permituserenvironment no
pubkeyauthoptions none