# Sync not clearing duplicates

**URL:** <https://forum.rclone.org/t/sync-not-clearing-duplicates/14372>\
**Category:** Help and Support\
**Created:** [February 16, 2020, 10:04am UTC](https://forum.rclone.org/t/sync-not-clearing-duplicates/14372 "2020-02-16T10:04:05Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Harry](https://forum.rclone.org/letter_avatar_proxy/v4/letter/h/f6c823/32.png) [@Harry](https://forum.rclone.org/u/Harry)\
**Post date:** [February 16, 2020, 10:04am UTC](https://forum.rclone.org/t/sync-not-clearing-duplicates/14372/1 "2020-02-16T10:04:05Z")

</div>

when doing `sync` destinations duplicates are not clearing.

```auto
2020/02/16 15:30:34 NOTICE: {redacted}.zip: Duplicate object found in destination - ignoring
2020/02/16 15:30:34 NOTICE: {redacted}.zip: Duplicate object found in destination - ignoring
2020/02/16 15:30:34 NOTICE: {redacted}.zip: Duplicate object found in destination - ignoring
2020/02/16 15:30:34 NOTICE: {redacted}.zip: Duplicate object found in destination - ignoring

```

I know i can clear duplicates using `dedupe` but isn't `sync` supposed to make exact clone?

---

<div class="post-metadata">

**Author:** ![Animosity022](https://forum.rclone.org/user_avatar/forum.rclone.org/animosity022/32/451_2.png) [@Animosity022](https://forum.rclone.org/u/Animosity022)\
**Post date:** [February 16, 2020, 12:55pm UTC](https://forum.rclone.org/t/sync-not-clearing-duplicates/14372/2 "2020-02-16T12:55:34Z")

</div>

What version of rclone are you using?  
What's your config look like with passwords and keys removed?  
What command are you running?  
Can you share a debug log of the command?  
Are you able to recreate it?

---

<div class="post-metadata">

**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\
**Post date:** [February 17, 2020, 7:54am UTC](https://forum.rclone.org/t/sync-not-clearing-duplicates/14372/3 "2020-02-17T07:54:54Z")

</div>

> [@Harry](#):
>
> I know i can clear duplicates using `dedupe` but isn't `sync` supposed to make exact clone?

I take your point about `sync` being an exact copy, but currently the sync algorithm can't cope with duplicates so it gives this message instead.

---

<div class="post-metadata">

**Author:** ![Harry](https://forum.rclone.org/letter_avatar_proxy/v4/letter/h/f6c823/32.png) [@Harry](https://forum.rclone.org/u/Harry)\
**Post date:** [February 17, 2020, 8:14am UTC](https://forum.rclone.org/t/sync-not-clearing-duplicates/14372/4 "2020-02-17T08:14:59Z")

</div>

So, I have no choice but run `dedupe`?

---

<div class="post-metadata">

**Author:** ![ncw](https://forum.rclone.org/user_avatar/forum.rclone.org/ncw/32/18_2.png) [@ncw](https://forum.rclone.org/u/ncw)\
**Post date:** [February 19, 2020, 5:14pm UTC](https://forum.rclone.org/t/sync-not-clearing-duplicates/14372/5 "2020-02-19T17:14:27Z")

</div>

Yes, you need to run dedupe

---

<div class="post-metadata">

**Author:** ![system](https://forum.rclone.org/uploads/default/original/2X/3/39ad3235f6ffec76ccd0c81616bd55697b4c300d.png) [@system](https://forum.rclone.org/u/system)\
**Post date:** [May 19, 2020, 5:14pm UTC](https://forum.rclone.org/t/sync-not-clearing-duplicates/14372/6 "2020-05-19T17:14:28Z")

</div>

Closed on May 19, 2020, 5:14pm UTC

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.
