--ignore-checksum not honored

[jkiebzak]

I am using rclone copy to replicate a local folder to a remote sftp server. I also am using a crypt remote ontop of the sftp remote.

After rclone reports 100% complete for a file, I can see md5sum start on the remote sftp server. Additionally, the local rclone hangs at 100% for that particular file until the remote md5sum comletes.

Here is my command:
rclone copy -P --transfers 8 --ignore-checksum --size-only /local/folder secret:/folder/

rclone version:

rclone v1.50.2
- os/arch: linux/amd64
- go version: go1.13.4

[Animosity022]

Can you run the same command with -vv and share the debug log?

Crypt doesn't support checksums so that seems odd.

Can you include your rclone.conf without passwords as well?

[jkiebzak]

Thanks for the quick reply.

conf:

cat .config/rclone/rclone.conf

[SFTPSERVER]
type = sftp
host = {{redacted}}
user = {{redacted}}
key_use_agent = true
md5sum_command = md5sum
sha1sum_command = sha1sum

[secret]
type = crypt
remote = SFTPSERVER:/mnt/backupsV2/encrypted
filename_encryption = standard
directory_name_encryption = true
password = {{redacted}}

comand:

rclone copy -vv -P --transfers 8 --ignore-checksum --size-only . secret:/vols/server_saturn2/

sample output:

2019-12-16 11:04:49 DEBUG : sftp hash = "129130a28656b361ec28385f94a9f636"
2019-12-16 11:04:49 INFO  : {{local file path redacted}}: Copied (new)
2019-12-16 11:04:52 DEBUG : sftp cmd = /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/2f5c55o11l2a585sdhnk6p1668/ue12i2hc8d76gfihs9k6as4fio/6k34gt155penp0obeoiea2gd08/2mtvbhg3hf3c9o684635susq87m79vuei2s8u4lrg0vh4ckqf31g
2019-12-16 11:04:52 DEBUG : sftp output = "5416c7c978b537b1de2e9ecfb58e248a  /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/2f5c55o11l2a585sdhnk6p1668/ue12i2hc8d76gfihs9k6as4fio/6k34gt155penp0obeoiea2gd08/2mtvbhg3hf3c9o684635susq87m79vuei2s8u4lrg0vh4ckqf31g\n"
2019-12-16 11:04:52 DEBUG : sftp hash = "5416c7c978b537b1de2e9ecfb58e248a"
2019-12-16 11:04:52 INFO  : {{local file path redacted}}: Copied (new)
2019-12-16 11:04:58 DEBUG : sftp cmd = /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/teotj82b4adettr84c5g7dr2mo/9bl5rbsdueunflc6afj38mtba0/ud42d9ta43a4fg7vdc0fvspmkg/lqd83no2mnd3m7nnga07b8a6kc/nbgg98ik31tia79lqrot75mjhifpho0746ni4ha8sme3kbovq64g
2019-12-16 11:04:58 DEBUG : sftp output = "5408220638a632502ab6ce785362c789  /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/teotj82b4adettr84c5g7dr2mo/9bl5rbsdueunflc6afj38mtba0/ud42d9ta43a4fg7vdc0fvspmkg/lqd83no2mnd3m7nnga07b8a6kc/nbgg98ik31tia79lqrot75mjhifpho0746ni4ha8sme3kbovq64g\n"
2019-12-16 11:04:58 DEBUG : sftp hash = "5408220638a632502ab6ce785362c789"
2019-12-16 11:04:58 INFO  : {{local file path redacted}}: Copied (new)
2019-12-16 11:05:05 DEBUG : sftp cmd = /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/teotj82b4adettr84c5g7dr2mo/9bl5rbsdueunflc6afj38mtba0/a3m3pdb0kdaf1rdq2lf86rb34c/7v5ksbrcd1f1g7khnbnn1838fc/sfdvu06s1c6g5i4ftugr1eaie2e70q5df7hm2csm3mpi2cjpv0j0
2019-12-16 11:05:05 DEBUG : sftp output = "934a0469cc61495b76bb089f418d4028  /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/teotj82b4adettr84c5g7dr2mo/9bl5rbsdueunflc6afj38mtba0/a3m3pdb0kdaf1rdq2lf86rb34c/7v5ksbrcd1f1g7khnbnn1838fc/sfdvu06s1c6g5i4ftugr1eaie2e70q5df7hm2csm3mpi2cjpv0j0\n"
2019-12-16 11:05:05 DEBUG : sftp hash = "934a0469cc61495b76bb089f418d4028"
2019-12-16 11:05:05 INFO  : {{local file path redacted}}: Copied (new)
2019-12-16 11:05:14 DEBUG : sftp cmd = /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/teotj82b4adettr84c5g7dr2mo/9bl5rbsdueunflc6afj38mtba0/ud42d9ta43a4fg7vdc0fvspmkg/lqd83no2mnd3m7nnga07b8a6kc/f4tmeb82ukbo8udm780dun87vm9o9hqhrr25lfjfq39paokm8gp0
2019-12-16 11:05:14 DEBUG : sftp output = "342b33411d6c8eff16c678ea8b5220e4  /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/teotj82b4adettr84c5g7dr2mo/9bl5rbsdueunflc6afj38mtba0/ud42d9ta43a4fg7vdc0fvspmkg/lqd83no2mnd3m7nnga07b8a6kc/f4tmeb82ukbo8udm780dun87vm9o9hqhrr25lfjfq39paokm8gp0\n"
2019-12-16 11:05:14 DEBUG : sftp hash = "342b33411d6c8eff16c678ea8b5220e4"
2019-12-16 11:05:14 INFO  : {{local file path redacted}}: Copied (new)
2019-12-16 11:05:21 DEBUG : sftp cmd = /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/2f5c55o11l2a585sdhnk6p1668/ue12i2hc8d76gfihs9k6as4fio/6k34gt155penp0obeoiea2gd08/rompi1c3mj09q6tb9emjontl6u7o2voqslop61lm9ijshsl2mtqg
2019-12-16 11:05:21 DEBUG : sftp output = "b9db5a832f2728a2813c27b4e3b75ebb  /mnt/{{redacted}}/backupsV2/encrypted/ni8eu5nk42llcp9vb5gdf7d8kc/gip433pkbutv7l6jbht188cf8s/2f5c55o11l2a585sdhnk6p1668/ue12i2hc8d76gfihs9k6as4fio/6k34gt155penp0obeoiea2gd08/rompi1c3mj09q6tb9emjontl6u7o2voqslop61lm9ijshsl2mtqg\n"
2019-12-16 11:05:21 DEBUG : sftp hash = "b9db5a832f2728a2813c27b4e3b75ebb"

[Animosity022]

With the SFTP, you should use:

https://rclone.org/sftp/#sftp-disable-hashcheck

[jkiebzak]

BINGO. thanks again for your quick response.