Cryptcheck seems to be downloading files from a remote

What is the problem you are having with rclone?

From what I understand, cryptcheck used as described below should not download files from encryptedremote. Nonetheless, traffic monitoring shows that rclone starts downloading heavily from the remote server, consuming the entire available 1Gbps bandwidth.

After logging in via SSH to remote, I see processes bash -c /usr/bin/md5sum so only checksums should be transferred. Why is the bandwidth usage so high?

Run the command 'rclone version' and share the full output of the command.

rclone v1.57.0-DEV

  • os/version: rocky 8.6 (64 bit)
  • os/kernel: 4.18.0-372.9.1.el8.x86_64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.16.12
  • go/linking: dynamic
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

sftp

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone cryptcheck /path/ encryptedremote:path

The rclone config contents with secrets removed.

[remote]
type = sftp
host = backupserver.abc
user = username
port = 22
key_file = ~/.ssh/id_rsa
md5sum_command = md5sum
sha1sum_command = sha1sum

[encryptedremote]
type = crypt
remote = remote:/repo
directory_name_encryption = true
password = xxx
password2 = xxx

A log from the command with the -vv flag

$  rclone cryptcheck -vv  /path/ encryptedremote:/path/ 
2023/03/06 18:05:08 DEBUG : rclone: Version "v1.57.0-DEV" starting with parameters ["rclone" "cryptcheck" "-vv" "/path/" "encryptedremote:/path/"]
2023/03/06 18:05:08 DEBUG : Creating backend with remote "/path/"
2023/03/06 18:05:08 DEBUG : Using config file from "/home/user/.config/rclone/rclone.conf"
2023/03/06 18:05:08 DEBUG : Creating backend with remote "encryptedremote:/path/"
2023/03/06 18:05:08 DEBUG : Creating backend with remote "remote:/repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0"
2023/03/06 18:05:08 DEBUG : sftp://user@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0: New connection myserver.abc:58024->backupserver.abc to "SSH-2.0-OpenSSH_8.0"
2023/03/06 18:05:08 INFO  : Using md5 for hash comparisons
2023/03/06 18:05:08 DEBUG : Encrypted drive 'encryptedremote:/path/': Waiting for checks to finish
2023/03/06 18:05:08 DEBUG : sftp://user@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0: New connection myserver.abc:58026->backupserver.abc to "SSH-2.0-OpenSSH_8.0"
2023/03/06 18:05:08 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/vbsbfhnjtfeb7es99nuuppvbu5j756cpmh60u4a118fce2epm9k0
2023/03/06 18:05:08 DEBUG : sftp output = "654b6ebab18a377c86864991d054c001  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/vbsbfhnjtfeb7es99nuuppvbu5j756cpmh60u4a118fce2epm9k0\n"
2023/03/06 18:05:08 DEBUG : sftp hash = "654b6ebab18a377c86864991d054c001"
2023/03/06 18:05:08 DEBUG : myfile0001.jpg: OK
2023/03/06 18:05:08 ERROR : myfile0002.jpg: Sizes differ
2023/03/06 18:05:08 DEBUG : sftp://user@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0: New connection myserver.abc:58028->backupserver.abc to "SSH-2.0-OpenSSH_8.0"
2023/03/06 18:05:08 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/3mb3979ltfol5nhf48vp9p4a5g
2023/03/06 18:05:08 DEBUG : sftp output = "bfed10ab95198abb51dc6cd10c209d05  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/3mb3979ltfol5nhf48vp9p4a5g\n"
2023/03/06 18:05:08 DEBUG : sftp hash = "bfed10ab95198abb51dc6cd10c209d05"
2023/03/06 18:05:08 DEBUG : myfile0003.jpg: OK
...
...
...

Can you update the latest stable and post the full debug log as the snippet doesn't show anything useful?

Thank you for your reply.
Upgrading to the latest rclone did not result in any change

rclone v1.61.1
- os/version: rocky 8.6 (64 bit)
- os/kernel: 4.18.0-372.9.1.el8.x86_64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.4
- go/linking: static
- go/tags: none

Unfortunately I can't attach the full logs because of the file names/paths etc - they shouldn't be revealed.

Not sure what else I can add as I can't see anything to offer any advice.

How would suggest I assist if I can't see anything you are reporting?

I did rclone on a 2.5G subdirectory with 6 files, the logs of which I can share.

Command:

rclone cryptcheck --log-file=cryptcheck_log -vv /path/to/resource/ encryptedremote:/path/to/resource/

Log. The only changes are hostnames and paths

2023/03/06 20:39:04 DEBUG : rclone: Version "v1.57.0-DEV" starting with parameters ["rclone" "cryptcheck" "--log-file=cryptcheck_log" "-vv" "/path/to/resource/" "encryptedremote:/path/to/resource/"]
2023/03/06 20:39:04 DEBUG : Creating backend with remote "/path/to/resource/"
2023/03/06 20:39:04 DEBUG : Using config file from "/home/user/.config/rclone/rclone.conf"
2023/03/06 20:39:04 DEBUG : Creating backend with remote "encryptedremote:/path/to/resource/"
2023/03/06 20:39:04 DEBUG : Creating backend with remote "myremote:/repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug"
2023/03/06 20:39:04 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58730->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:04 INFO  : Using md5 for hash comparisons
2023/03/06 20:39:04 DEBUG : Encrypted drive 'encryptedremote:/path/to/resource/': Waiting for checks to finish
2023/03/06 20:39:04 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/jctqp9ri007jvg40h3v628psn8e3pdi2drfpgq1emq01anov5ucbutsplne4b1m7inti4npfcpksq
2023/03/06 20:39:04 DEBUG : sftp output = "c782ea0040d72ac2afe6d29f273a5b1e  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/jctqp9ri007jvg40h3v628psn8e3pdi2drfpgq1emq01anov5ucbutsplne4b1m7inti4npfcpksq\n"
2023/03/06 20:39:04 DEBUG : sftp hash = "c782ea0040d72ac2afe6d29f273a5b1e"
2023/03/06 20:39:04 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58732->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:05 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58734->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_06_00_01.templ: OK
2023/03/06 20:39:05 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58736->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:05 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58738->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/tv6vqf6bvvta2t8c9n6g25g4ip1bsncucchn2212vo4qvi015aagrpp28ehj5actcgvamcblp34q4
2023/03/06 20:39:05 DEBUG : sftp output = "8dac5cbaef9799eacc53a3cd7a50f42b  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/tv6vqf6bvvta2t8c9n6g25g4ip1bsncucchn2212vo4qvi015aagrpp28ehj5actcgvamcblp34q4\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "8dac5cbaef9799eacc53a3cd7a50f42b"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_00_01_25.data.log: OK
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/16a7pja8pv79va4aqe11us2tkitucoh9u95kmai0d8s2vuijjv7lojhknqt5uok2k38os7pgu4qsk
2023/03/06 20:39:05 DEBUG : sftp output = "86766d82a7aeb92e63a6eefa847f8b5f  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/16a7pja8pv79va4aqe11us2tkitucoh9u95kmai0d8s2vuijjv7lojhknqt5uok2k38os7pgu4qsk\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "86766d82a7aeb92e63a6eefa847f8b5f"
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/hh3qtfa7nplq6s2ltqdh60l84afb953jrle0icdh6q3h1s567ka17gak21ornb25c47bsf8nlutvo
2023/03/06 20:39:05 DEBUG : sftp output = "0f00e9bb42aaf3d0d043814e019b1240  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/hh3qtfa7nplq6s2ltqdh60l84afb953jrle0icdh6q3h1s567ka17gak21ornb25c47bsf8nlutvo\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "0f00e9bb42aaf3d0d043814e019b1240"
2023/03/06 20:39:05 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58740->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_12_00_01.data.book.txt: OK
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/rmt0a26d11vis499fjr4uh87mnohakvguf615khfnrj437q8mgreeu4emrisbougnbs1uvo1609t6
2023/03/06 20:39:05 DEBUG : sftp output = "6f02ec3706cf186f440fd9b2f0a377c1  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/rmt0a26d11vis499fjr4uh87mnohakvguf615khfnrj437q8mgreeu4emrisbougnbs1uvo1609t6\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "6f02ec3706cf186f440fd9b2f0a377c1"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_00_01_25.templ: OK
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_06_00_01.data.book.txt: OK
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/vfo5unoa805bdqk9om2ure3vm0m39kq72l6254tfuoep28oubde4ieev9fc0dqf5o4q6ki395m8e2
2023/03/06 20:39:05 DEBUG : sftp output = "69b77d4a05315e48d25dfc3d3e781b32  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/vfo5unoa805bdqk9om2ure3vm0m39kq72l6254tfuoep28oubde4ieev9fc0dqf5o4q6ki395m8e2\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "69b77d4a05315e48d25dfc3d3e781b32"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_12_00_01.data.log: OK
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/366mkq4avglv0h8reb5t3mk763v0fjcihr5hfv4kvb6cu9srikru7i7toigppp5d1s3vobrg5nt8s
2023/03/06 20:39:05 DEBUG : sftp output = "b78bd15c4013744bce893d3bdf124ccd  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/366mkq4avglv0h8reb5t3mk763v0fjcihr5hfv4kvb6cu9srikru7i7toigppp5d1s3vobrg5nt8s\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "b78bd15c4013744bce893d3bdf124ccd"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_18_00_01.data.book.txt: OK
2023/03/06 20:39:05 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58742->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/i0fc240u23r0ajo0h947edp6p5190un4obs211h88rqa7k6jfa9o7uko0ni4hhdka22rb3v2uvir0
2023/03/06 20:39:05 DEBUG : sftp output = "282ecb4ccf03be5b1b5710ed00d2dea2  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/i0fc240u23r0ajo0h947edp6p5190un4obs211h88rqa7k6jfa9o7uko0ni4hhdka22rb3v2uvir0\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "282ecb4ccf03be5b1b5710ed00d2dea2"
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/7lr1dgjteob0ivpv1spri6b0q5q6sgvr98aliula1qmtpma2adginkp78do83nqpe3hu1gbbp699m
2023/03/06 20:39:05 DEBUG : sftp output = "1f43c3317cfe92549b3fa42f4bb53712  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/7lr1dgjteob0ivpv1spri6b0q5q6sgvr98aliula1qmtpma2adginkp78do83nqpe3hu1gbbp699m\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "1f43c3317cfe92549b3fa42f4bb53712"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_00_01_25.data.book.txt: OK
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_18_00_01.data.log: OK
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/rgcvv8hecnskio8d6h23jog53na88mus4gleaiu8hjj86dojb4n0ribnmg775g9tcql7ebqk85hcc
2023/03/06 20:39:05 DEBUG : sftp output = "d4a2476b02550a4711c48e021199141f  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/rgcvv8hecnskio8d6h23jog53na88mus4gleaiu8hjj86dojb4n0ribnmg775g9tcql7ebqk85hcc\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "d4a2476b02550a4711c48e021199141f"
2023/03/06 20:39:05 DEBUG : sftp://username@backupserver.abc//repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug: New connection localserver.abc:58744->backupserver.abc:22130 to "SSH-2.0-OpenSSH_8.0"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_12_00_01.templ: OK
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/kpvt9t295c41hbfmm7kb8khdsejs5kspq3m4nlkbge1fsl3davd9rshkedrq79ab0k1i41n5hhea0
2023/03/06 20:39:05 DEBUG : sftp output = "a7d10b603140c4b8926b632808864cee  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/kpvt9t295c41hbfmm7kb8khdsejs5kspq3m4nlkbge1fsl3davd9rshkedrq79ab0k1i41n5hhea0\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "a7d10b603140c4b8926b632808864cee"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_06_00_01.data.log: OK
2023/03/06 20:39:05 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/9c01ibgi5nms53cssqvodtdarcu6okd7q8edhptc9mb9sc3sagp6017lkn4db90okrkg8ig5c59sg
2023/03/06 20:39:05 DEBUG : sftp output = "4302ce5c4bc9c2256075681d7669cf0c  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/9c01ibgi5nms53cssqvodtdarcu6okd7q8edhptc9mb9sc3sagp6017lkn4db90okrkg8ig5c59sg\n"
2023/03/06 20:39:05 DEBUG : sftp hash = "4302ce5c4bc9c2256075681d7669cf0c"
2023/03/06 20:39:05 DEBUG : 2023_01_02_CODE_18_00_01.templ: OK
2023/03/06 20:39:07 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/c04ncif80n2p2dddtsqj23pr6chtr3cpctun3tc75ufovgs4s0u0
2023/03/06 20:39:07 DEBUG : sftp output = "f593d53e65073c7cda70eb396860a958  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/c04ncif80n2p2dddtsqj23pr6chtr3cpctun3tc75ufovgs4s0u0\n"
2023/03/06 20:39:07 DEBUG : sftp hash = "f593d53e65073c7cda70eb396860a958"
2023/03/06 20:39:07 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/j5psolp5709j2g2plf9escm1hlta60qldm5f7meq94emcsdqjs8g
2023/03/06 20:39:07 DEBUG : sftp output = "126a9f5aa89c98b17f35e7d97be1de40  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/j5psolp5709j2g2plf9escm1hlta60qldm5f7meq94emcsdqjs8g\n"
2023/03/06 20:39:07 DEBUG : sftp hash = "126a9f5aa89c98b17f35e7d97be1de40"
2023/03/06 20:39:07 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/er0fquj7lsbab53j795h4qc3plumaoa8undcqev9ahuccjlub4s0
2023/03/06 20:39:07 DEBUG : sftp output = "45abb11ef3c34f9be1bdf4f55435042b  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/er0fquj7lsbab53j795h4qc3plumaoa8undcqev9ahuccjlub4s0\n"
2023/03/06 20:39:07 DEBUG : sftp hash = "45abb11ef3c34f9be1bdf4f55435042b"
2023/03/06 20:39:08 DEBUG : sftp cmd = /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/4qc9pipjk30k01uagijnvnlrtknvi4cinh1cgocqncq31k4ai7b0
2023/03/06 20:39:08 DEBUG : sftp output = "601a1a6d6e1db13f90e331dabfd16a13  /repo/ie89haac169fm0ah9vr675mvrk/8vohdo0i899e5dfc21bpetkuj8/ajabnma04l3eml2l6v8p4bb9dk/sjgkdr68bkfjm3m83vnvnmaqd0/o646dl6u7e6rkljrdelnn2bgl4/oibhgvg18d64mm528g05p4ik4c/6tijpjs8ievbnr8c0t6hthqsuc/7c6tn5otshu6lvov19ajgaqv2k/6js11kg37rh0o6cljksj0jjctg/18g02rua4hdl700ii392paprug/4qc9pipjk30k01uagijnvnlrtknvi4cinh1cgocqncq31k4ai7b0\n"
2023/03/06 20:39:08 DEBUG : sftp hash = "601a1a6d6e1db13f90e331dabfd16a13"
2023/03/06 20:39:33 DEBUG : 2023_01_02_CODE_00_01_25.data: OK
2023/03/06 20:39:34 DEBUG : 2023_01_02_CODE_18_00_01.data: OK
2023/03/06 20:39:34 DEBUG : 2023_01_02_CODE_06_00_01.data: OK
2023/03/06 20:39:34 DEBUG : 2023_01_02_CODE_12_00_01.data: OK
2023/03/06 20:39:34 NOTICE: Encrypted drive 'encryptedremote:/path/to/resource/': 0 differences found
2023/03/06 20:39:34 NOTICE: Encrypted drive 'encryptedremote:/path/to/resource/': 16 matching files
2023/03/06 20:39:34 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:                16 / 16, 100%
Elapsed time:        30.4s

2023/03/06 20:39:34 DEBUG : 75 go routines active

The transfer is just as high. While running rclone Iptraf showed:

obraz

Maybe I don't understand something, but it seems to me that nothing but md5 sums should be transferred?

Can you use the latest stable please? I can try to reproduce if so.

Below are logs from the latest stable.

I'm not seeing anything being transferred as are you sure that is the same process doing the xfer?

rclone cryptcheck `pwd` testcrypt: -vv
2023/03/06 15:55:22 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "cryptcheck" "/Users/etexter/Downloads/t" "testcrypt:" "-vv"]
2023/03/06 15:55:22 DEBUG : Creating backend with remote "/Users/etexter/Downloads/t"
2023/03/06 15:55:22 DEBUG : Using config file from "/Users/etexter/.config/rclone/rclone.conf"
2023/03/06 15:55:22 DEBUG : Creating backend with remote "testcrypt:"
2023/03/06 15:55:22 DEBUG : Creating backend with remote "SFTP:/home/felix/crypt"
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: New connection 192.168.1.178:59746->192.168.1.30:22 to "SSH-2.0-OpenSSH_8.4p1 Debian-5+deb11u1"
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Shell type "unix" from config
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Using root directory "/home/felix/crypt"
2023/03/06 15:55:22 INFO  : Using md5 for hash comparisons
2023/03/06 15:55:22 DEBUG : Encrypted drive 'testcrypt:': Waiting for checks to finish
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Shell path "/home/felix/crypt/6r50j5eru0lfub6f2n39ifq4b8"
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Shell path "/home/felix/crypt/156htkvl9257us1m33vc7if5de3vc9f1fak6f1lruotrglvf86hqvlhnr2vcjk0nm70vrn30vnbs6"
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Running remote command: md5sum /home/felix/crypt/6r50j5eru0lfub6f2n39ifq4b8
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: New connection 192.168.1.178:59747->192.168.1.30:22 to "SSH-2.0-OpenSSH_8.4p1 Debian-5+deb11u1"
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Running remote command: md5sum /home/felix/crypt/156htkvl9257us1m33vc7if5de3vc9f1fak6f1lruotrglvf86hqvlhnr2vcjk0nm70vrn30vnbs6
2023/03/06 15:55:22 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Remote command result: 20a899c8a894afbbd4c4aa6ff1c4e260  /home/felix/crypt/156htkvl9257us1m33vc7if5de3vc9f1fak6f1lruotrglvf86hqvlhnr2vcjk0nm70vrn30vnbs6
2023/03/06 15:55:22 DEBUG : 156htkvl9257us1m33vc7if5de3vc9f1fak6f1lruotrglvf86hqvlhnr2vcjk0nm70vrn30vnbs6: Parsed hash: 20a899c8a894afbbd4c4aa6ff1c4e260
2023/03/06 15:55:23 DEBUG : Plex-1.65.1.3596-7b1f6d97-x86_64.zip: OK
2023/03/06 15:55:54 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Remote command result: e1230e87800ca6341d0edbaebb81abe5  /home/felix/crypt/6r50j5eru0lfub6f2n39ifq4b8
2023/03/06 15:55:54 DEBUG : 6r50j5eru0lfub6f2n39ifq4b8: Parsed hash: e1230e87800ca6341d0edbaebb81abe5
2023/03/06 15:56:22 INFO  :
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 1 / 2, 50%
Elapsed time:       1m0.1s
Checking:
 *                                      testfile: checking

2023/03/06 15:56:54 DEBUG : sftp://felix@192.168.1.30:22//home/felix/crypt: Closing 2 unused connections

I only see some disk IO on the SFTP host via iotop and nothing was transferred at all.

The parsed hash shows it did the md5sum on the remote side.

 Parsed hash: f593d53e65073c7cda70eb396860a958

You are right. Everything is as it should be. My mistake, I forgot that I have the local resource connected via NFS. That's why iptraf was showing a large transfer, but it was a large one between the server where I run rclone and the NFS resource and not encryptedremote.

Topic can be closed. Thank you for your professional support, which helped me finally track down the cause of the problem. Greetings.

Ah hah!

That's a good find as that makes perfect sense.

Glad it is sorted as that was confusing to me too.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.