Copied Data to New Drive, rclone wants to copy everythin again

Help and Support
1

What is the problem you are having with rclone?

...
I've copied data to a new destination. Then want rclone to sync using copy to that destination. No matter what I do, rclone wants to copy the file again to the new destination instead of skipping b/c it's already there.
Moving files doesn't change the Checksum and the File size may have changed on a handfull of files, but not all. In a normal day only 20-30 files would be modified.
...

Run the command 'rclone version' and share the full output of the command.

...
v.1.61.1
...

Which cloud storage system are you using? (eg Google Drive)

Local files system, Windows Folder to iSCSI connected Drive.

The command you were trying to run (eg rclone copy /tmp remote:tmp)

For Dry Run
	rclone.exe copy y:/OUT/ t:/IN/ --exclude "STUFF/**" --exclude "JUNK/**" -c -n --auto-confirm -P --log-file=LOGGING.LOG --log-level INFO

To Just Do Checksum
	rclone.exe copy y:/OUT/ t:/IN/ --exclude "STUFF/**" --exclude "JUNK/**" -c --auto-confirm -P --log-file=LOGGING.LOG --log-level INFO

Size Only Dry Run
	rclone.exe copy y:/OUT/ t:/IN/ --exclude "STUFF/**" --exclude "JUNK/**" --size-only -n --auto-confirm -P --log-file=LOGGING.LOG --log-level INFO

Size Only
	rclone.exe copy y:/OUT/ t:/IN/ --exclude "STUFF/**" --exclude "JUNK/**" --size-only --auto-confirm -P --log-file=LOGGING.LOG --log-level INFO

The rclone config contents with secrets removed.

No Config just Command Line

A log from the command with the -vv flag

	When doing Dry Run with any --size-only or -c
		Skipped copy as --dry-run is set (size xxxx)
	
	When running command no dry run
	 	 Copied (new)
2

hi,
can you post something that replicates the issue. for example,

  1. copy a single file using a simple command.
  2. run the command twice.
  3. post full debug output of both commands.
rclone copy y:/OUT/file.ext t:/IN -vv
rclone copy y:/OUT/file.ext t:/IN -vv

and post the full output of rclone version

3

Doing the testing you suggested brought to the forefront some other oddities. Digging deeper into things, there is an issue with the zVol on my Truenas box. I started to look at some other systems I have point to some iSCSI targets and there are some things I need to investigate. I run the copy command now and I just get an insane about of corrupt file/directory errors. I feel bad I blamed rclone lol.

Thanks you for your assistance.

4

yeah, that simple test can be quite effective.

no worries

5

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.