--backup-dir making copy even though no change

[7aklhz (el_even)]

What is the problem you are having with rclone?

--backup-dir is making a copy even though the file has not changed, not moved nor deleted

Please note that I'm backing up on an encrypted remote.

What is your rclone version (output from rclone version)

rclone v1.55.0

Which OS you are using and how many bits (eg Windows 7, 64 bit)

• os/type: linux
• os/arch: amd64
• go/version: go1.16.2
• go/linking: static
• go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

From OneDrive personal to B2 Backblaze

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync OneDrive: BackBlazeEncrypt:OneDrive/34uk/current --backup-dir BackBlazeEncrypt:OneDrive/34uk/deleted/$(date +\%Y_\%m_\%d-\%H\%M\%S) -v > /var/log/cron_logs/onedrive_backup-$(date +\%Y_\%m_\%d_\%H\%M\%S).log

The rclone config contents with secrets removed.

Paste config here

A log from the command with the -vv flag

2021/06/28 20:34:11 INFO  : OneDrive_Personnel/Image Uploads/2021/06/20210604_153443842_iOS.heic: Copied (server-side copy)
2021/06/28 20:34:12 INFO  : OneDrive_Personnel/Image Uploads/2019/08/20190817_114713992_iOS.heic: Copied (server-side copy)
2021/06/28 20:34:12 INFO  : OneDrive_Personnel/Image Uploads/2021/06/20210604_164412991_iOS.heic: Deleted
2021/06/28 20:34:12 INFO  : OneDrive_Personnel/Image Uploads/2021/06/20210602_101857718_iOS.heic: Deleted
2021/06/28 20:34:13 INFO  : OneDrive_Personnel/Image Uploads/2021/06/20210626_113939257_iOS.heic: Copied (server-side copy)
2021/06/28 20:34:13 INFO  : OneDrive_Personnel/Image Uploads/2021/03/20210305_103842382_iOS.heic: Copied (new)

[Animosity022]

See:

Can't mount '.heic' (photo-video) files from onedrive

@asdffdsa Good question, I guess the answer is yes. @Andrew_Xxx: It looks like the files are Live Photos uploaded from the iOS OneDrive App. If so, then the issue is most likely due to OneDrive’s partial support of Live Photos. Upload and storage from the iOS app were introduced in December 2020. The remaining implementation is still work-in-progress and this introduces some “surprising” situations when mounting and synchronizing - also in the native OneDrive client on Windows. The issue(s) …

[7aklhz (el_even)]

ah... indeed, seems to be happening with images. I did another test with -vv and this is from one picture :
2021/06/28 20:50:53 DEBUG : OneDrive_Personnel/Image Uploads/2020/12/20201227_154154335_iOS.heic: Sizes differ (src 6431803 vs dst 2249241)
Then
2021/06/28 20:50:56 INFO : OneDrive_Personnel/Image Uploads/2020/12/20201227_154154335_iOS.heic: Copied (server-side copy)
and finally :
2021/06/28 20:50:58 INFO : OneDrive_Personnel/Image Uploads/2020/12/20201227_154154335_iOS.heic: Deleted

However, I think I also so this happen with PDF and other docs.

So any solution for this ?

[Animosity022]

See:

https://rclone.org/onedrive/#unexpected-file-size-hash-differences-on-sharepoint

[Ole (Ole Frost)]

I use --ignore-size (to servers with no/other checksums)

But it has some risks, so I also do regular verifications with

rclone check --download ...

[7aklhz (el_even)]

@Ole

check --download

What does this do / Why do you do it ?

[7aklhz (el_even)]

But if I do

--ignore-checksum --ignore-size

won't that also ignore legit changes I make to my files (for example excel file) ?

[Ole (Ole Frost)]

See rclone check

To make sure I detect if I missed a change or have invalid data transferred.

[Ole (Ole Frost)]

@7aklhz

won't that also ignore legit changes I make to my files (for example excel file) ?

sync still checks the modification time

I suggest you read the docs, especially the details for sync, --ignore-size and OneDrive.

[7aklhz (el_even)]

Thank you @Ole and @Animosity022 for taking the time to answer my questions. Cheers.