What is rclone checking during a purge?

[Ole (Ole Frost)]

@ncw

So what you are worried about here is that there are clearly only 4 things in the "checkers" category, but checkers is 8.

I think this is actually a bug here - we are running --transfers delete routines not --checkers as you would expect.

Exactly!

@ncw

Please give this a go.

Sure, this looks even better, happy to see the 8 "deleting" lines under "Checking:"

Now extending the test a bit to this sequence:

rclone test makefiles ./testfolder/makefiles100/ --files=100    
rclone sync --track-renames ./testfolder/ GoogleDrive:testfolder/ --progress
mv ./testfolder/makefiles100/ ./testfolder/makefiles100renamed/
rclone sync --track-renames ./testfolder/ GoogleDrive:testfolder/ --progress 

resulting in these stats

Transferred:            318 B / 318 B, 100%, 0 B/s, ETA -
Checks:               112 / 120, 93%
Renamed:               12
Elapsed time:         8.0s
Checking:
 *               makefiles100/sewewot7c/cosezow4:  0% /26, 0/s, -
 *                   makefiles100/sewewot7c/hiju:  0% /86, 0/s, -
 *               makefiles100/sewewot7c/powovof3:  0% /91, 0/s, -
 *              makefiles100/sewewot7c/leyizub3k:  0% /78, 0/s, -
 *                makefiles100/rabokoh9pol/pesuf:  0% /0, 0/s, -
 *             makefiles100/sewewot7c/gopibim9ne:  0% /7, 0/s, -
 *             makefiles100/sewewot7c/kuwizaq7gu:  0% /20, 0/s, -
 *                makefiles100/sewewot7c/revepaf:  0% /70, 0/s, -

Which I think ideally should look more like this (note changes in all lines except "Elapsed Time" and "Checking:")

Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:               100 / 100, 100%
Renamed:               12 / 100,  12%
Elapsed time:         8.0s
Checking:
 *               makefiles100/sewewot7c/cosezow4: renaming
 *                   makefiles100/sewewot7c/hiju: renaming
 *               makefiles100/sewewot7c/powovof3: renaming
 *              makefiles100/sewewot7c/leyizub3k: renaming
 *                makefiles100/rabokoh9pol/pesuf: renaming
 *             makefiles100/sewewot7c/gopibim9ne: renaming
 *             makefiles100/sewewot7c/kuwizaq7gu: renaming
 *                makefiles100/sewewot7c/revepaf: renaming

---

I also tried another test inspired by this and this forum post, where the time spend on checksumming (on local and SFTP) isn't (easily) visible in the stats.

This is what I see when I do a copy to a slow external USB2 drive (app. 22 seconds to copy and another 22 seconds to do the checksum) :

> rclone copy .\makefile1GB\ D:\testfolder\ --progress --stats=20s 

Transferred:   	  927.777 MiB / 1 GiB, 91%, 46.949 MiB/s, ETA 2s
Checks:                 1 / 1, 100%
Transferred:            0 / 1, 0%
Elapsed time:        20.0s
Transferring:
 *                                       file1GB: 90% /1Gi, 45.519Mi/s, 2s

Transferred:   	        1 GiB / 1 GiB, 100%, 14.430 MiB/s, ETA 0s
Checks:                 1 / 1, 100%
Transferred:            0 / 1, 0%
Elapsed time:        40.0s
Transferring:
 *                                       file1GB:100% /1Gi, 14.430Mi/s, 0s

Transferred:   	        1 GiB / 1 GiB, 100%, 11.890 MiB/s, ETA 0s
Checks:                 1 / 1, 100%
Transferred:            1 / 1, 100%
Elapsed time:        43.9s

I would ideally like the 40 seconds stats to look like something like this:

Elapsed time:        40.0s
Transferring:
 *                                       file1GB:100% /1Gi, checksumming

or like this (if changed to be performed by the --checkers):

Elapsed time:        40.0s
Checking:
 *                                       file1GB: checksumming