Rclone dedupe interactive is deleting without user input according to the log output

Suspected Bug
1

What is the problem you are having with rclone?

It looks like dedupe interactive mode is just deleting.

Run the command 'rclone version' and share the full output of the command.

rclone v1.65.0
- os/version: ubuntu 18.04 (64 bit)
- os/kernel: 4.4.0-22621-Microsoft (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.4
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

USER@Desktop:~$ rclone dedupe google-drive-username123:Backup_Storage/xtt200-webcam-motion/ --dedupe-mode interactive -vv

2023/12/14 21:38:23 DEBUG : rclone: Version "v1.65.0" starting with parameters ["rclone" "dedupe" "google-drive-username123:Backup_Storage/xtt200-webcam-motion/" "--dedupe-mode" "interactive" "-vv"]
2023/12/14 21:38:23 DEBUG : Creating backend with remote "google-drive-username123:Backup_Storage/xtt200-webcam-motion/"
2023/12/14 21:38:23 DEBUG : Using config file from "/home/good4y0u/.config/rclone/rclone.conf"
2023/12/14 21:38:24 DEBUG : Google drive root 'Backup_Storage/xtt200-webcam-motion': 'root_folder_id = 0AOh6eWIUaZIAUk9PVA' - save this in the config to speed up startup
2023/12/14 21:38:24 DEBUG : fs cache: renaming cache item "google-drive-username123:Backup_Storage/xtt200-webcam-motion/" to be canonical "google-drive-username123:Backup_Storage/xtt200-webcam-motion"
2023/12/14 21:38:24 INFO  : Google drive root 'Backup_Storage/xtt200-webcam-motion': Looking for duplicate names using interactive mode.
2023/12/14 21:38:54 NOTICE: libre-motion/CAM_0/2020_07_02/219-02/pic-2020-07-02-02-56-31.jpg: Found 2 files with duplicate names
2023/12/14 21:38:54 NOTICE: libre-motion/CAM_0/2020_07_02/219-02/pic-2020-07-02-02-56-31.jpg: Deleting 1/2 identical duplicates (md5 d136151d791512f692a78566722750c3)
2023/12/14 21:38:55 INFO  : libre-motion/CAM_0/2020_07_02/219-02/pic-2020-07-02-02-56-31.jpg: Deleted
2023/12/14 21:38:55 NOTICE: libre-motion/CAM_0/2020_07_02/219-02/pic-2020-07-02-02-56-31.jpg: All duplicates removed
2023/12/14 21:38:55 NOTICE: libre-motion/CAM_0/2020_07_04/335-19/pic-2020-07-04-19-34-53.jpg: Found 2 files with duplicate names
2

This is exactly how it is supposed to work... as per docs:

deduping by name, for every group of duplicate file names / hashes, it will delete all but one identical file it finds without confirmation. This means that for most duplicated files the dedupe command will not be interactive.

Have a look at the example from docs:

$ rclone dedupe drive:dupes
2016/03/05 16:24:37 Google drive root 'dupes': Looking for duplicates using interactive mode.
one.txt: Found 4 files with duplicate names
one.txt: Deleting 2/3 identical duplicates (MD5 "1eedaa9fe86fd4b8632e2ac549403b36")
one.txt: 2 duplicates remain
  1:      6048320 bytes, 2016-03-05 16:23:16.798000000, MD5 1eedaa9fe86fd4b8632e2ac549403b36
  2:       564374 bytes, 2016-03-05 16:23:06.731000000, MD5 7594e7dc9fc28f727c42ee3e0749de81
s) Skip and do nothing
k) Keep just one (choose which in next step)
r) Rename all to be different (by changing file.jpg to file-1.jpg)
s/k/r> k

interactive mode kicks in only when duplicates are not identical.

And feel free to improve documentation if you think it is not clear enough. There is always space for improvements in docs.

1 Like
3

ah this makes sense, thank you.

1 Like
4

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.