Vamp
October 22, 2017, 2:37pm
1
Hello there,
I try to upload (sync) a video file my crypted google drive storage, the upload finish successfull, (every time) but if i run the cryptcheck command, it say that is “hashes differ”
Something is changed? I use it some month ago without problem. (the cryptcheck OK every time)
Need to ose a different method or…?
ncw
(Nick Craig-Wood)
October 22, 2017, 3:28pm
2
Vamp:
I try to upload (sync) a video file my crypted google drive storage, the upload finish successfull, (every time) but if i run the cryptcheck command, it say that is “hashes differ”
That means that likely a file on your disk is different now to a file on drive. Is it just one file or lots?
Try downloading the file and check the differences locally.
Vamp
October 22, 2017, 3:31pm
3
Hello @ncw
I try sync about 15 files with 3 times and the bigger about 500 mb files every time “hashes differ".
Now i try to copy a file with rclone browser.
Edit: it finished but same…
Now i try to download it and do a local MD5 check.
Edit2: i finished the sha256 check:
the original and the downloaded file got the exactly same number…
I dont understand, why get a error, if i use cryptcheck…
ncw
(Nick Craig-Wood)
October 23, 2017, 11:43am
4
That is good because it means your data isn’t corrupted
Can you send a log of cryptcheck
run with -vv
please?
Vamp
October 23, 2017, 2:25pm
5
Here the log:
2017/10/23 16:03:22 DEBUG : Using config file from "/home/vamp/.rclone.conf"
2017/10/23 16:03:22 DEBUG : rclone: Version "v1.38" starting with parameters ["/usr/bin/rclone" "cryptcheck" "/home/vamp/adat/Upload/" "Google_gsuite_crypt:temp" "-vv" "--log-file=/home/vamp/log/send_log"]
2017/10/23 16:03:25 INFO : Encrypted drive 'Google_gsuite_crypt:temp': Modify window is 1ms
2017/10/23 16:03:25 INFO : Using MD5 for hash comparisons
2017/10/23 16:03:25 INFO : Encrypted drive 'Google_gsuite_crypt:temp': Waiting for checks to finish
2017/10/23 16:04:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 1m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:05:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 2m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:06:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 3m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:07:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 4m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:08:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 5m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:09:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 6m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:10:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 7m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:11:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 8m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:12:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 9m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:13:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 10m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:14:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 11m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:15:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 12m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:16:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 13m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:17:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 14m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:18:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 15m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:19:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 16m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:20:25 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 0
Transferred: 0
Elapsed time: 17m3.1s
Checking:
* Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv
2017/10/23 16:20:32 ERROR : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.mkv: hashes differ (Google_gsuite_crypt:temp) "052b2b5235ee70de8e40a40fe5a0890b" vs (local:/home/vamp/adat/Upload) "d12508c77b8dac69c7ccf8579706c198"
2017/10/23 16:20:32 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.nfo: OK
2017/10/23 16:20:32 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/spider-man.homecoming.1080p-trinity.nfo: OK
2017/10/23 16:20:33 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/spider-man.homecoming.forced.hunsub-trinity.srt: OK
2017/10/23 16:20:33 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/spider-man.homecoming.forced.hunsub-trinity.srt: OK
2017/10/23 16:20:38 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/sample/spider-man.homecoming.1080p-trinity.mkv: OK
2017/10/23 16:20:38 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/sample/spider-man.homecoming.1080p-trinity.mkv: OK
2017/10/23 16:21:07 ERROR : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/spider-man.homecoming.hundub-trinity.ac3: hashes differ (Google_gsuite_crypt:temp) "43b1e953e578b24e08d14fed04dc1615" vs (local:/home/vamp/adat/Upload) "44b560b2f01e9b5c31910e1a2b295b9a"
2017/10/23 16:21:08 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/spider-man.homecoming.hunsub-trinity.srt: OK
2017/10/23 16:21:08 DEBUG : Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/spider-man.homecoming.hunsub-trinity.srt: OK
2017/10/23 16:21:08 NOTICE: Encrypted drive 'Google_gsuite_crypt:temp': 2 differences found
2017/10/23 16:21:08 Failed to cryptcheck: 2 differences found
ncw
(Nick Craig-Wood)
October 23, 2017, 4:50pm
6
That is interesting.
What I’d like to find out is what is the correct hash of the encrypted data?
So can you find the encrypted name of the file that is giving the error: Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/spider-man.homecoming.hundub-trinity.ac3
rclone ls --crypt-show-mapping Google_gsuite_crypt:temp
then can you download the crypted file
rclone copy Google_gsuite:path/to/encrypted/file /tmp
Then can you run md5sum on it.
What I want to know is does it match one of these?
(Google_gsuite_crypt:temp) “43b1e953e578b24e08d14fed04dc1615”
(local:/home/vamp/adat/Upload) “44b560b2f01e9b5c31910e1a2b295b9a”
If it matches the first, then it means there is a bug in cryptcheck, if it matches the second then it means google has got the wrong md5sum on your file.
Vamp
October 23, 2017, 7:27pm
7
@ncw
I check the encrypted file:
here the result:
44B560B2F01E9B5C31910E1A2B295B9A:2063 ms used
ncw
(Nick Craig-Wood)
October 23, 2017, 9:44pm
8
So that means that google has the wrong MD5 attached to your file somehow…
Or possibly rclone got the sha1sums mixed up somehow in cryptcheck…
Can you just double check and do rclone md5sum Google_gsuite:path/to/encrypted/file/name
- I’m expecting that to match one or the other of those sha1sums
Vamp
October 24, 2017, 7:34pm
9
@ncw
i get this:
fd4865f2df2f1124f34b97c5c84b7999 gfut3f60lk5m2frtuq4ajrd5tefiahsv4rlk8kfdsopg1n6n9fmvm7u4efro9bobjnu40mnkiaotk
Sorry, I re-upload it, so the code is changed.
I check the encrypted file again (download it ):
here: FD4865F2DF2F1124F34B97C5C84B7999:13772 ms used
It is match .
Strange… now i get this with cryptcheck…
2017/10/24 21:46:36 DEBUG : Using config file from "/home/vamp/.rclone.conf"
2017/10/24 21:46:36 DEBUG : rclone: Version "v1.38" starting with parameters ["/usr/bin/rclone" "cryptcheck" "/home/vamp/adat/Upload/Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/" "Google_gsuite_crypt:Filmek/Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/" "-vv" "--log-file=/home/vamp/tmp/out2"]
2017/10/24 21:46:40 INFO : Encrypted drive 'Google_gsuite_crypt:Filmek/Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/': Modify window is 1ms
2017/10/24 21:46:40 INFO : Using MD5 for hash comparisons
2017/10/24 21:46:40 INFO : Encrypted drive 'Google_gsuite_crypt:Filmek/Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/': Waiting for checks to finish
2017/10/24 21:46:40 DEBUG : spider-man.homecoming.forced.hunsub-trinity.srt: OK
2017/10/24 21:46:40 DEBUG : spider-man.homecoming.forced.hunsub-trinity.srt: OK
2017/10/24 21:47:07 DEBUG : spider-man.homecoming.hundub-trinity.ac3: OK
2017/10/24 21:47:07 DEBUG : spider-man.homecoming.hundub-trinity.ac3: OK
2017/10/24 21:47:07 DEBUG : spider-man.homecoming.hunsub-trinity.srt: OK
2017/10/24 21:47:07 DEBUG : spider-man.homecoming.hunsub-trinity.srt: OK
2017/10/24 21:47:07 NOTICE: Encrypted drive 'Google_gsuite_crypt:Filmek/Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/': 0 differences found
2017/10/24 21:47:07 INFO :
Transferred: 0 Bytes (0 Bytes/s)
Errors: 0
Checks: 3
Transferred: 0
Elapsed time: 30.9s
2017/10/24 21:47:07 DEBUG : Go routines at exit 5
2017/10/24 21:47:07 DEBUG : rclone: Version "v1.38" finishing with parameters ["/usr/bin/rclone" "cryptcheck" "/home/vamp/adat/Upload/Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/" "Google_gsuite_crypt:Filmek/Spider-Man.Homecoming.2017.1080p.REPACK.BluRay.DTS.x264.HuN-TRiNiTY/hun/" "-vv" "--log-file=/home/vamp/tmp/out2"]
ncw
(Nick Craig-Wood)
October 26, 2017, 4:36pm
10
Hmm! I think what happened is that the MD5 SUM google stored for the file, was incorrect for some reason. Uploading it again has fixed it though.