rclone 1.55
rclone cryptcheck --one-way -vv --fast-list --drive-chunk-size 128M "D:\rtmpdump newfolder 8-29-2017" "cleancrypt:D:\rtmpdump newfolder 8-29-2017" --checkers 2
First time I ran this command today I got an error I cannot quote exactly but it said that I had made too many api calls and that rclone was going to stop trying and return no results at all.
Second time I ran this command today it worked fine. All checks were made. It was VERY slow to start though and you'll see why if you open this text file.
exampleofproblemm.txt (170.8 KB)
I cut the file off when it actually started making the checks successfully. But the rest of the file would've been just the tool working pretty much fine (still some api throttling but not enough to break the run)....
Here are the final results of the above file:
2021/05/20 13:39:43 NOTICE: Encrypted drive 'cleancrypt:D:/rtmpdump newfolder 8-29-2017': 0 differences found
2021/05/20 13:39:43 NOTICE: Encrypted drive 'cleancrypt:D:/rtmpdump newfolder 8-29-2017': 62 matching files
2021/05/20 13:39:43 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks: 62 / 62, 100%
Elapsed time: 53m8.7s
2021/05/20 13:39:43 DEBUG : 5 go routines active
So how can I cut out this time? I don't think --no-traverse is functional on a cryptcheck is it? The problem here, as far as I can tell, is the ls command rclone must make before it begins it's task? right?
A month or two ago this never resulted in total failure, and honestly speed isn't that big an issue to me. The total failure is. Maybe rclone could be patched so that instead of giving total failure and closure of the tool after 50or so minutes the pacer just keeps waiting? This folder has grown a LOT since 2017. That's why this takes so long, I can understand that. It's gotten slower and slower month by month and year by year. The real issue is that's it's gotten so big that rclone is giving up rather than continuing to pause (sometimes.... but pretty soon probably always). In case you need/want details on what I call "large".
rclone size of the folder lists:
Total objects: 200785
Total size: 67.573 TBytes
so uh. A) increase the time limit before rclone gives up or B) tell me what I'm doing wrong and magically this wasted 30-40minutes a day is saved and goes away entirely