Renaming without uploading whole file again

What is the problem you are having with rclone?

I've uploaded around 400 GB of video files to Gdrive (crypt), while organizing I've renamed bunch of them (92GB).
NOTE: logs are from other crypt which I'm currently using for testing

To my understanding when using --track-renames-strategy modtime it's supposed to just rename files to the remote but not upload the whole thing but here it's uploading whole file and deleting old one.
How do I get it to just rename files without uploading whole file again?

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2

  • os/version: Microsoft Windows 10 Enterprise 22H2 (64 bit)
  • os/kernel: 10.0.19045.2846 Build 19045.2846.2846 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.20.2
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync --track-renames-strategy modtime --progress "D:\uploads" "crypt-Gdrive:Sync" -vv --log-file="debug.log"

The rclone config contents with secrets removed.

[Gdrive]
type = drive
scope = drive
team_drive = 

[crypt-Gdrive]
type = crypt
remote = Gdrive:Sync

[crypt-GdriveBackups]
type = crypt
remote = Gdrive:Backups

A log from the command with the -vv flag

2023/06/13 13:34:06 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "sync" "--track-renames-strategy" "modtime" "--progress" "D:\\uploads" "crypt-Gdrive:Sync" "--log-file=debug.log" "-vv" "--dry-run"]
2023/06/13 13:34:06 DEBUG : Creating backend with remote "D:\\uploads"
2023/06/13 13:34:06 DEBUG : Using config file from "C:\\Users\\XX\\AppData\\Roaming\\rclone\\rclone.conf"
2023/06/13 13:34:06 DEBUG : fs cache: renaming cache item "D:\\uploads" to be canonical "//?/D:/uploads"
2023/06/13 13:34:06 DEBUG : Creating backend with remote "crypt-Gdrive:Sync"
2023/06/13 13:34:07 DEBUG : Creating backend with remote "Gdrive:Sync/22q6oklobrpglj3nascqdlthe4"
2023/06/13 13:34:07 DEBUG : Google drive root 'Sync/22q6oklobrpglj3nascqdlthe4': 'root_folder_id = 0AIOyh0nd-Sb0Uk9PVA' - save this in the config to speed up startup
2023/06/13 13:34:09 DEBUG : 008.jpg: Size and modification time the same (differ by -530.5µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : 008.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : 009.jpg: Size and modification time the same (differ by -49.6µs, within tolerance 1ms)
2023/06/13 13:34:09 NOTICE: Alpine Road trip_01.jpg: Skipped copy as --dry-run is set (size 2.670Mi)
2023/06/13 13:34:09 NOTICE: Alpine Road trip 03.jpg: Skipped copy as --dry-run is set (size 1.319Mi)
2023/06/13 13:34:09 NOTICE: Alpine Road trip 02.jpg: Skipped copy as --dry-run is set (size 1.555Mi)
2023/06/13 13:34:09 DEBUG : night.jpg: Size and modification time the same (differ by -438.1µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : night.jpg: Unchanged skipping
2023/06/13 13:34:09 NOTICE: Blade Runner 2049 shot films.mkv: Skipped copy as --dry-run is set (size 215.767Mi)
2023/06/13 13:34:09 DEBUG : 002.jpg: Size and modification time the same (differ by -515.7µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : 002.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : ren-ran-Jy6luiLBsrk-unsplash.jpg: Size and modification time the same (differ by -235.3µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : 004.jpg: Size and modification time the same (differ by -955.5µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : 004.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : 2560x1440 Bubbles.jpg: Size and modification time the same (differ by -212.2µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : 2560x1440 Bubbles.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : travel-02.jpg: Size and modification time the same (differ by -979.7µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : travel-02.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : 009.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : 5gktd0pmqjz91.jpg: Size and modification time the same (differ by -102.6µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : 5gktd0pmqjz91.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : travel-05.jpg: Size and modification time the same (differ by -470.8µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : k22oeyx5ash81.jpg: Size and modification time the same (differ by -906.1µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : in_flames___berserk___by_anatofinnstark_df3eedm-fullview.jpg: Size and modification time the same (differ by -826.1µs, within tolerance 1ms)
2023/06/13 13:34:09 NOTICE: bmw gs 1250.jpg: Skipped copy as --dry-run is set (size 835.598Ki)
2023/06/13 13:34:09 DEBUG : red_by_seven_teenth_decbl7c.jpg: Size and modification time the same (differ by -374.7µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : ren-ran-Jy6luiLBsrk-unsplash.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : red_by_seven_teenth_decbl7c.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : Encrypted drive 'crypt-Gdrive:Sync': Waiting for checks to finish
2023/06/13 13:34:09 DEBUG : salty_suburban_by_seven_teenth_dfadr69.jpg: Size and modification time the same (differ by -125.4µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : salty_suburban_by_seven_teenth_dfadr69.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : wallhaven-6oqzgq.jpg: Size and modification time the same (differ by -195.5µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : wallhaven-6oqzgq.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : travel-04.jpg: Size and modification time the same (differ by -277µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : travel-04.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : travel-05.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : k22oeyx5ash81.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : in_flames___berserk___by_anatofinnstark_df3eedm-fullview.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : unsplash-11.jpg: Size and modification time the same (differ by -77.8µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : unsplash-11.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : travel-03.jpg: Size and modification time the same (differ by -624.3µs, within tolerance 1ms)
2023/06/13 13:34:09 DEBUG : travel-03.jpg: Unchanged skipping
2023/06/13 13:34:09 DEBUG : Encrypted drive 'crypt-Gdrive:Sync': Waiting for transfers to finish
2023/06/13 13:34:09 DEBUG : Waiting for deletions to finish
2023/06/13 13:34:09 NOTICE: pic-3.jpg: Skipped delete as --dry-run is set (size 1.319Mi)
2023/06/13 13:34:09 NOTICE: pic-2.jpg: Skipped delete as --dry-run is set (size 1.555Mi)
2023/06/13 13:34:09 NOTICE: pic-1.jpg: Skipped delete as --dry-run is set (size 2.670Mi)
2023/06/13 13:34:09 NOTICE: Blade Runner 2049.mkv: Skipped delete as --dry-run is set (size 215.767Mi)
2023/06/13 13:34:09 NOTICE: travel-01.jpg: Skipped delete as --dry-run is set (size 835.598Ki)
2023/06/13 13:34:09 NOTICE: 
Transferred:   	  222.127 MiB / 222.127 MiB, 100%, 0 B/s, ETA -
Checks:                23 / 23, 100%
Deleted:                5 (files), 0 (dirs)
Transferred:            5 / 5, 100%
Elapsed time:         2.4s

2023/06/13 13:34:09 DEBUG : 5 go routines active

Pick up one problematic file and check modification timestamp on both remote and locally e.g. to see it on remote:

rclone lsl crypt-Gdrive:Sync:file.txt

Actually leave checking after you run it correctly as at the moment you define track-renames-strategy but not ask to be used:)

This is correct command:

rclone sync --track-renames --track-renames-strategy modtime --progress "D:\uploads" "crypt-Gdrive:Sync" -vv --log-file="debug.log"

2 Likes

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.