How to keep both files when getting the "Duplicate object found in source - ignoring" error?

Help and Support
1

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.

What is the problem you are having with rclone?

I am trying to run rclone copy but have certain folders with duplicate objects. This results in only one version being kept. How can I keep both, renaming one perhaps? Thanks!

Run the command 'rclone version' and share the full output of the command.

rclone version
rclone v1.62.2
- os/version: darwin 13.5.2 (64 bit)
- os/kernel: 22.6.0 (x86_64)
- os/type: darwin
- os/arch: amd64
- go/version: go1.20.2
- go/linking: dynamic
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy -P --ignore-checksum gd:/ "/Volumes/My Large Hard Drive" --exclude "/Folder 1 to exclude/**" --exclude "/Folder 2 to exclude/**"

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[gd]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
acknowledge_abuse = true
token = XXX
root_folder_id = XXX
team_drive =

A log from the command that you were trying to run with the -vv flag

The below is with --dry-run option

2023/09/15 18:03:11 DEBUG : Creating backend with remote "gd:/"
2023/09/15 18:03:11 DEBUG : Using config file from "/Users/home/.config/rclone/rclone.conf"
2023/09/15 18:03:11 DEBUG : fs cache: renaming cache item "gd:/" to be canonical "gd:"
2023/09/15 18:03:11 DEBUG : Creating backend with remote "/Volumes/My Large Hard Drive/"
2023/09/15 18:03:11 DEBUG : fs cache: renaming cache item "/Volumes/My Large Hard Drive/" to be canonical "/Volumes/My Large Hard Drive"
2023-09-15 18:03:11 DEBUG : gd: Loaded invalid token from config file - ignoring
2023-09-15 18:03:11 DEBUG : Saving config "token" in section "gd" of the config file
2023-09-15 18:03:11 DEBUG : gd: Saved new token in config file
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:         1.5s^C
2

Rclone doesn’t handle duplicates as you have run rclone dedupe to clean the source.

3

Thanks! May I ask what do you mean clean the source? Such as modifying the source google drive folders/file?

4

You need to run rclone dedupe

5

There is no functionality like this in rclone but you can use workaround described in the below post:

6

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.