During sync, files examined more than once?


#1

Hi. I’m a new user of rclone; I like it a lot. I’m using it to back up my home directory to pcloud. Here is the command I’m using:

rclone -v -v --transfers=4 --checkers=8 --exclude-from /home/reid/bin/backup-rclone-excludes.txt --backup-dir=pcloud:rclone_root/old_$DATE --log-file=/home/reid/rclone_logs/$LOG_NAME sync /home/reid pcloud:rclone_root/current_backup

(I’ve been trying to get just the right numbers in transfers and checkers so it runs fast but doesn’t bog down my cable internet connection.) What I’m seeing in the log file are things like this:

2018/07/08 10:48:11 DEBUG : .asunder: Size and modification time the same (differ by 0s, within tolerance 1s)
2018/07/08 10:48:11 DEBUG : .asunder: Unchanged skipping

and

2018/07/08 12:39:13 DEBUG : .asunder: Size and modification time the same (differ by 0s, within tolerance 1s)
2018/07/08 12:39:13 DEBUG : .asunder: Unchanged skipping

It seems to be happening to a lot, if not all, of my files. This log file is associated with a single run of rclone, I’m pretty sure. Is it normal for it to do this?

Thanks,
Reid

EDIT: Some more data: If I do a “find . | wc -l” in my home directory, I get 778729. The rclone process above is still running, with this as the latest status:

2018/07/08 15:02:10 INFO :
Transferred: 238.794 MBytes (16.044 kBytes/s)
Errors: 11
Checks: 1310616
Transferred: 399
Elapsed time: 4h14m0.6s

Shouldn’t the number of checks be at most 778729?

Interestingly, I started looking into this because it seemed like some files that I had deleted in my home directory weren’t being deleted on the remote side (actually, moved to a backup directory). So I wasn’t expecting this other issue.