[closed] Rclone check -c, why there is large network flow?

Hi~

have 100x 4GB movies on local HDD (D:) and google drive. (google drive:my drive\movie)

uploaded using rclone.

then I wanna check for checksum.

I use:
rclone check -c d:\ “google drive:my drive\movie”

I saw my local HDD 's LED flashing, CPU 100%… reasonable,
as rclone is calculating the local file’s checksum say MD5?

but there is ALSO 15% network brandwith which is about 100Mbit/s?

what I expect is rclone should simply ask google drive for the remote files’s MD5,
and compare with the local calculated MD5.

so there should be just LITTLE network flow?

2nd, may I ask how rclone check work with or withou the -c?

a. with the -c option, i think rclone check wont care on size, and it must check checksum.
b. without -c option, it 1st found difference by size, THEN if size is same, it WILL compare checksum.

sorry for asking newbie problems but I worry about my files so I wanna know more on the
checksum/check issue.

thanks

Run it with -vvv and see what its doing.

I tried with -v and -vv,

for -vv, it displays as:

yeah those are the movies.
Thanks

C:\Users\xxxx\Documents\kb-x200t\0-i\romeo\rclone\main-cur\last-commands\2018040
8-225327–verify-yyyy>“C:\Users\xxxx\Documents\kb-x200t\0-i\romeo\rclone\main-cu
r\rclone.exe” -vv -c --config “C:\Users\xxxx\Documents\kb-x200t\0-i\romeo\rclone
\main-cur\rclone-cur.conf” check “D:\0-bc-01-ed\0-inc-20180408-225327” “G:\My Dr
ive\base-a002\20180326-02\bc-ed\0-incoming-yyyy\0-inc-20180408-225327”
2018/05/17 16:40:06 DEBUG : rclone: Version “v1.41” starting with parameters [“C
:\Users\xxxx\Documents\kb-x200t\0-i\romeo\rclone\main-cur\rclone.exe” "
-vv" “-c” “–config” “C:\Users\xxxx\Documents\kb-x200t\0-i\romeo\rclone\
main-cur\rclone-cur.conf” “check” “D:\0-bc-01-ed\0-inc-20180408-225327” “G:\
My Drive\base-a002\20180326-02\bc-ed\0-incoming-yyyy\0-inc-20180408-225327”
]
2018/05/17 16:40:06 DEBUG : Using config file from “C:\Users\xxxx\Documents\
kb-x200t\0-i\romeo\rclone\main-cur\rclone-cur.conf”
2018/05/17 16:40:06 INFO : Local file system at \?\G:\My Drive\base-a002\20180
326-02\bc-ed\0-incoming-yyyy\0-inc-20180408-225327: Modify window is 100ns
2018/05/17 16:40:06 INFO : Local file system at \?\G:\My Drive\base-a002\20180
326-02\bc-ed\0-incoming-yyyy\0-inc-20180408-225327: Waiting for checks to finish

2018/05/17 16:40:07 DEBUG : FolderKey.bch: MD5 = 219a2fb421e4ef6cf34b6cb2c9bfc6e
b (Local file system at \?\D:\0-bc-01-ed\0-inc-20180408-225327)
2018/05/17 16:40:07 DEBUG : FolderKey.bch: MD5 = 49250c88cca65a494f2e57ff3d7d4a3
3 (Local file system at \?\G:\My Drive\base-a002\20180326-02\bc-ed\0-incoming-p
orn\0-inc-20180408-225327)
2018/05/17 16:40:07 ERROR : FolderKey.bch: MD5 differ
2018/05/17 16:40:29 DEBUG : ASD- Hang/FolderKey.bch: OK
2018/05/17 16:40:29 DEBUG : 0-russiahot-fhd/FolderKey.bch: OK
2018/05/17 16:40:29 DEBUG : Asian Male Western Females Series Kinpatu86-0001 Ube
rcute Lexi Belle FullHD 1080p/folder.jpg.bc: OK
2018/05/17 16:40:29 DEBUG : Asian Male Western Females Series Kinpatu86-0010 AMW
F Stunning Duo FullHD 1080p/folder.jpg.bc: OK
2018/05/17 16:40:29 DEBUG : 0-russiahot-fhd/russia-Hot-n0959-HD/FolderKey.bch: OK
2018/05/17 16:40:29 DEBUG : Asian Male Western Females Series Kinpatu86-0001 Ube
rcute Lexi Belle FullHD 1080p/FolderKey.bch: OK
2018/05/17 16:40:30 DEBUG : 0-russiahot-fhd/russia-Hot-n0962-HD–d/FolderKey.bch:
OK
2018/05/17 16:40:30 DEBUG : Asian Male Western Females Series Kinpatu86-0010 AMW
F Stunning Duo FullHD 1080p/FolderKey.bch: OK
2018/05/17 16:40:30 DEBUG : 0-russiahot-fhd/russia-Hot-n0961-HD/FolderKey.bch: OK
2018/05/17 16:40:30 DEBUG : 0-russiahot-fhd/russia-Hot-n0958-HD/FolderKey.bch: OK
2018/05/17 16:40:30 DEBUG : 0-russiahot-fhd/russia-Hot-n0960-HD/FolderKey.bch: OK
2018/05/17 16:40:31 DEBUG : 0-russiahot-fhd/russia-Hot-n0962-HD–d/vlcsnap-2017-04
-29-12h07m28s667.jpg.bc: OK
2018/05/17 16:40:31 DEBUG : Asian Male Western Females Series Kinpatu86-0001 Ube
rcute Lexi Belle FullHD 1080p/Kinpatu86-0001 (Lexi Belle).jpeg.bc: OK
2018/05/17 16:40:31 DEBUG : Asian Male Western Females Series Kinpatu86-0010 AMW
F Stunning Duo FullHD 1080p/Kinpatu86-0010.jpeg.bc: OK
2018/05/17 16:40:32 DEBUG : 0-russiahot-fhd/russia-Hot-n0963-HD/FolderKey.bch: OK
2018/05/17 16:41:36 DEBUG : ASD- Hang/Hang - Asian.mp4.bc: OK
2018/05/17 16:41:38 DEBUG : ASD- Hang/Hang - Asian.mp4_thumbs_[2015.07.30_10.29.
23].jpg.bc: OK
2018/05/17 16:41:39 DEBUG : 0-russiahot-fhd/russia-Hot-n0964-HD/FolderKey.bch: OK
2018/05/17 16:54:46 DEBUG : Asian Male Western Females Series Kinpatu86-0010 AMW
F Stunning Duo FullHD 1080p/Kinpatu86-0010.wmv.bc: OK
2018/05/17 16:55:26 DEBUG : 0-russiahot-fhd/russia-Hot-n0965-HD/FolderKey.bch: OK
2018/05/17 16:56:00 DEBUG : Asian Male Western Females Series Kinpatu86-0001 Ube
rcute Lexi Belle FullHD 1080p/Kinpatu86-0001 (Lexi Belle).wmv.bc: OK
2018/05/17 16:56:01 DEBUG : 0-russiahot-fhd/russia-Hot-n0966-HD/1063715@18p2p.com.
txt.bc: OK
2018/05/17 16:56:02 DEBUG : 0-russiahot-fhd/russia-Hot-n0966-HD/FolderKey.bch: OK
2018/05/17 18:09:41 DEBUG : 0-russiahot-fhd/russia-Hot-n0958-HD/n0958_seira_matsuo
ka_od_n_fhd.wmv.bc: OK

it’s definitely progressing.

but to my understanding, there should be just LITTLE network flow.

but now, it’s huge of about 100Mbit/s?

thx

Sorry guys,

it’s my fault.

I should use the command as
rclone check -c d:\ “google drive name : \movies”

what I used above is
rclone check -c d:\ G:mydriive\movies

whish is thru g suit’s file stream.

thanks.

this thread could be closed.

sorry guys.

No worries. Note that -c doesn’t do anything with rclone check it checks the checksums regardless of that. And you are right it should do lots of local activity doing MD5 Sums and a little bit of bandwidth fetching the remote listing with the MD5Sums.