Why do files migrated using rclone take up more space on OneDrive?

What is the problem you are having with rclone?

Why does each file I migrate with rclone take up extra space like this? How to clean up these extra spaces?

I also used "rclone cleanup" command to clear it but it didn't work.

Run the command 'rclone version' and share the full output of the command.

rclone v1.68.2

  • os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
  • os/kernel: 10.0.19045.5131 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.23.3
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using?

OneDrive for Business

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy old: new: -v --transfers 10 --buffer-size 300Mi --multi-thread-streams 32

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[old]
type = onedrive
client_id = XXX
client_secret = XXX
token = XXX
drive_id = XXX
drive_type = business

[new]
type = onedrive
client_id = XXX
client_secret = XXX
token = XXX
drive_id = XXX
drive_type = business

A log from the command that you were trying to run with the -vv flag

none

Emm, there is a error:
ERROR : Failed to read hash: hash type not supported

The output of this command will leak my privacy, so I need to verify the file, right? Can I use other commands instead?

rclone md5sum old:Images/2019082416365209.jpg -v

Output:
2024/11/24 23:17:33 ERROR : 2019082416365209.jpg: hash unsupported: hash type not supported
2024/11/24 23:17:33 NOTICE: Failed to md5sum with 2 errors: last error was: hash unsupported: hash type not supported

The hash of the verification after they are downloaded is the same, and the file is correct, but the usage on OneDrive is larger.

It's not just one document, it's all about it.

2024/11/24 23:44:17 DEBUG : rclone: Version "v1.68.2" starting with parameters ["rclone" "copy" "365:IMG_0010.jpg" "new:IMG_0010.jpg" "-vv"]
2024/11/24 23:44:17 DEBUG : Creating backend with remote "365:IMG_0010.jpg"
2024/11/24 23:44:17 DEBUG : Using config file from "C:\Users\Administrator\AppData\Roaming\rclone\rclone.conf"
2024/11/24 23:44:19 DEBUG : fs cache: adding new entry for parent of "365:IMG_0010.jpg", "365:"
2024/11/24 23:44:19 DEBUG : Creating backend with remote "new:IMG_0010.jpg"
2024/11/24 23:44:24 DEBUG : IMG_0010.jpg: Need to transfer - File not found at Destination
2024/11/24 23:44:31 DEBUG : IMG_0010.jpg: Starting multipart upload
2024/11/24 23:44:32 DEBUG : IMG_0010.jpg: Uploading segment 0/34406835 size 10485760
2024/11/24 23:45:23 INFO :
Transferred: 6.996 MiB / 32.813 MiB, 21%, 148.151 KiB/s, ETA 2m58s
Transferred: 0 / 1, 0%
Elapsed time: 1m5.8s
Transferring:

  •                              IMG_0010.jpg: 21% /32.813Mi, 155.447Ki/s, 2m50s
    

2024/11/24 23:45:53 DEBUG : IMG_0010.jpg: Uploading segment 10485760/34406835 size 10485760
2024/11/24 23:46:23 INFO :
Transferred: 14.996 MiB / 32.813 MiB, 46%, 149.731 KiB/s, ETA 2m1s
Transferred: 0 / 1, 0%
Elapsed time: 2m5.8s
Transferring:

  •                              IMG_0010.jpg: 45% /32.813Mi, 153.882Ki/s, 1m58s
    

2024/11/24 23:47:06 DEBUG : IMG_0010.jpg: Uploading segment 20971520/34406835 size 10485760
2024/11/24 23:47:23 INFO :
Transferred: 22.996 MiB / 32.813 MiB, 70%, 136.295 KiB/s, ETA 1m13s
Transferred: 0 / 1, 0%
Elapsed time: 3m5.8s
Transferring:

  •                              IMG_0010.jpg: 70% /32.813Mi, 139.213Ki/s, 1m12s
    

2024/11/24 23:48:13 DEBUG : IMG_0010.jpg: Uploading segment 31457280/34406835 size 2949555
2024/11/24 23:48:23 INFO :
Transferred: 31.996 MiB / 32.813 MiB, 98%, 156.782 KiB/s, ETA 5s
Transferred: 0 / 1, 0%
Elapsed time: 4m5.8s
Transferring:

  •                              IMG_0010.jpg: 97% /32.813Mi, 160.660Ki/s, 5s
    

2024/11/24 23:48:28 DEBUG : IMG_0010.jpg: quickxor = ec5ba0102e77016128f4b1da51d7f1038139088b OK
2024/11/24 23:48:28 INFO : IMG_0010.jpg: Copied (new)
2024/11/24 23:48:28 INFO :
Transferred: 32.813 MiB / 32.813 MiB, 100%, 170.119 KiB/s, ETA 0s
Transferred: 1 / 1, 100%
Elapsed time: 4m10.7s

2024/11/24 23:48:28 DEBUG : 9 go routines active

Actual occupancy:
image

No, it has nothing to do with the storage unit, and the file in source OneDrive is smaller than the target.

I did not rename the file and only transferred one file. The command I used was:
rclone copy "365:IMG_0010.jpg" "new:IMG_0010.jpg" -vv

It's a OneDrive design issue:
Microsoft Community

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.