What is the problem you are having with rclone?
Hashes differ repeatedly only for certain .xls files (not .xlsx or anything else) when doing a cryptcheck of roughly 0.5 million read-only files, immediately after a sync. Syncing using "--ignore-times" resolves this. Any advice on how this may be avoided would be greatly appreciated.
Note: Per character redaction rules used for file paths and names:
Uppercase -> X
Lowercase -> x
Diacritic uppercase (only "`" or "´") -> À
Diacritic lowercase (only "`" or "´") -> à
Numerical -> 0
Run the command 'rclone version' and share the full output of the command.
rclone v1.69.3-DEV
- os/version: freebsd 13.1-release-p9 (64 bit)
- os/kernel: 13.1-release-p9 (amd64)
- os/type: freebsd
- os/arch: amd64
- go/version: go1.23.0
- go/linking: dynamic
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
Openstack Swift
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone sync -vv "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls" secret-name:"XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"
rclone cryptcheck -vv "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls" secret-name:"XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[BackupStorage]
type = swift
env_auth = true
auth_version = 3
auth = https://auth.cloud.ovh.net/v3
endpoint_type = public
tenant_domain = default
tenant = XXX
domain = default
user = XXX
key = XXX
region = XXX
[secret-name]
type = crypt
remote = BackupStorage:XXXX.XX0.XXXX
password = XXX
password2 = XXX
A log from the command that you were trying to run with the -vv flag
2025/06/03 13:12:23 DEBUG : rclone: Version "v1.69.3-DEV" starting with parameters ["rclone" "sync" "-vv" "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls" "secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"]
2025/06/03 13:12:23 DEBUG : Creating backend with remote "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls"
Enter configuration password:
password:
2025/06/03 13:12:35 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2025/06/03 13:12:35 DEBUG : fs cache: renaming child cache item "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls" to be canonical for parent "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"
2025/06/03 13:12:35 DEBUG : Creating backend with remote "secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"
2025/06/03 13:12:35 DEBUG : Creating backend with remote "BackupStorage:XXXX.XX0.XXXX/n8v25oio6mh57l7u0nqstutthk/n7jpc0560tp8iup53p8phe1be0c68o1ssr8kejjhd43rkn23mtr0/g11djncuj8osu9j0c7nv06en58/a5ctmlqoaghk493ds3thqurd6o/mjkfrdsgd4kusrt17he260u964/4ile6ir0qip65o3ih7cmrkva5k/ptii6pi41aehc741uedrqidqoo"
2025/06/03 13:12:37 DEBUG : Swift container XXXX.XX0.XXXX path n8v25oio6mh57l7u0nqstutthk/n7jpc0560tp8iup53p8phe1be0c68o1ssr8kejjhd43rkn23mtr0/g11djncuj8osu9j0c7nv06en58/a5ctmlqoaghk493ds3thqurd6o/mjkfrdsgd4kusrt17he260u964/4ile6ir0qip65o3ih7cmrkva5k/ptii6pi41aehc741uedrqidqoo: Auto set use_segments_container to true
2025/06/03 13:12:39 DEBUG : Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls: Size and modification time the same (differ by 0s, within tolerance 1ns)
2025/06/03 13:12:39 DEBUG : Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls: Unchanged skipping
2025/06/03 13:12:39 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Elapsed time: 0.0s
2025/06/03 13:12:39 DEBUG : 6 go routines active
2025/06/03 13:14:49 DEBUG : rclone: Version "v1.69.3-DEV" starting with parameters ["rclone" "cryptcheck" "-vv" "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls" "secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"]
2025/06/03 13:14:49 DEBUG : Creating backend with remote "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls"
Enter configuration password:
password:
2025/06/03 13:14:56 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2025/06/03 13:14:56 DEBUG : fs cache: renaming child cache item "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX/Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls" to be canonical for parent "/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"
2025/06/03 13:14:56 DEBUG : Creating backend with remote "secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX"
2025/06/03 13:14:56 DEBUG : Creating backend with remote "BackupStorage:XXXX.XX0.XXXX/n8v25oio6mh57l7u0nqstutthk/n7jpc0560tp8iup53p8phe1be0c68o1ssr8kejjhd43rkn23mtr0/g11djncuj8osu9j0c7nv06en58/a5ctmlqoaghk493ds3thqurd6o/mjkfrdsgd4kusrt17he260u964/4ile6ir0qip65o3ih7cmrkva5k/ptii6pi41aehc741uedrqidqoo"
2025/06/03 13:14:58 DEBUG : Swift container XXXX.XX0.XXXX path n8v25oio6mh57l7u0nqstutthk/n7jpc0560tp8iup53p8phe1be0c68o1ssr8kejjhd43rkn23mtr0/g11djncuj8osu9j0c7nv06en58/a5ctmlqoaghk493ds3thqurd6o/mjkfrdsgd4kusrt17he260u964/4ile6ir0qip65o3ih7cmrkva5k/ptii6pi41aehc741uedrqidqoo: Auto set use_segments_container to true
2025/06/03 13:14:59 INFO : Using md5 for hash comparisons
2025/06/03 13:14:59 DEBUG : Encrypted drive 'secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX': Waiting for checks to finish
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXX.pdf: Excluded (FilesFrom Filter)
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXX.pdf: Excluded
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXX Xxxxxàx.pdf: Excluded (FilesFrom Filter)
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXX Xxxxxàx.pdf: Excluded
2025/06/03 13:15:00 DEBUG : XX0 xx xxxxxxxx.pdf: Excluded (FilesFrom Filter)
2025/06/03 13:15:00 DEBUG : XX0 xx xxxxxxxx.pdf: Excluded
2025/06/03 13:15:00 DEBUG : Xxxxxx xxxxxxxxxxxxx - XXXXXX XXXXX.pdf: Excluded (FilesFrom Filter)
2025/06/03 13:15:00 DEBUG : Xxxxxx xxxxxxxxxxxxx - XXXXXX XXXXX.pdf: Excluded
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXXXXXX.pdf: Excluded (FilesFrom Filter)
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXXXXXX.pdf: Excluded
2025/06/03 13:15:00 DEBUG : XXXX_xxxxxxx-.xlsx: Excluded (FilesFrom Filter)
2025/06/03 13:15:00 DEBUG : XXXX_xxxxxxx-.xlsx: Excluded
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXXXX XXXXXX.pdf: Excluded (FilesFrom Filter)
2025/06/03 13:15:00 DEBUG : Xxxxxxx xxxxxxxxxxxxx - XXXXX XXXXXX.pdf: Excluded
2025/06/03 13:15:00 ERROR : Xxxxxxx_xx_xxxxxxxxxxxx_xxx_xxxxxxxxxxxx-Xxxxxxxxxxx-XXX.xls: hashes differ (secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX) "360737c7057e158279a71dccc67be975" vs (local:/mnt/snapshot/auto-2025-06-03_13-00/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX) "20b4ac31db421de42914077657e6c733"
2025/06/03 13:15:00 NOTICE: Encrypted drive 'secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX': 1 differences found
2025/06/03 13:15:00 NOTICE: Encrypted drive 'secret-name:XXXX.XX0.XXXX/XXX XXXXXXXXXXXXX/00 XXXXXXXXXXXXX/0000 XXXX/00 Xxxxxxx/000000 XXX XXX/À XXXXXX': 1 errors while checking
2025/06/03 13:15:00 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Errors: 1 (retrying may help)
Checks: 1 / 1, 100%
Elapsed time: 0.4s
2025/06/03 13:15:00 DEBUG : 7 go routines active
2025/06/03 13:15:00 NOTICE: Failed to cryptcheck: 1 differences found