RemyYYZ
(RemyYYZ)
November 24, 2024, 2:00am
1
What is the problem you are having with rclone?
Why does each file I migrate with rclone take up extra space like this? How to clean up these extra spaces?
I also used "rclone cleanup" command to clear it but it didn't work.
Run the command 'rclone version' and share the full output of the command.
rclone v1.68.2
os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
os/kernel: 10.0.19045.5131 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.23.3
go/linking: static
go/tags: cmount
Which cloud storage system are you using?
OneDrive for Business
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy old: new: -v --transfers 10 --buffer-size 300Mi --multi-thread-streams 32
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[old]
type = onedrive
client_id = XXX
client_secret = XXX
token = XXX
drive_id = XXX
drive_type = business
[new]
type = onedrive
client_id = XXX
client_secret = XXX
token = XXX
drive_id = XXX
drive_type = business
A log from the command that you were trying to run with the -vv
flag
none
RemyYYZ
(RemyYYZ)
November 24, 2024, 3:03pm
3
Emm, there is a error:
ERROR : Failed to read hash: hash type not supported
RemyYYZ
(RemyYYZ)
November 24, 2024, 3:14pm
5
The output of this command will leak my privacy, so I need to verify the file, right? Can I use other commands instead?
RemyYYZ
(RemyYYZ)
November 24, 2024, 3:19pm
6
rclone md5sum old:Images/2019082416365209.jpg -v
Output:
2024/11/24 23:17:33 ERROR : 2019082416365209.jpg: hash unsupported: hash type not supported
2024/11/24 23:17:33 NOTICE: Failed to md5sum with 2 errors: last error was: hash unsupported: hash type not supported
RemyYYZ
(RemyYYZ)
November 24, 2024, 3:32pm
7
The hash of the verification after they are downloaded is the same, and the file is correct, but the usage on OneDrive is larger.
RemyYYZ
(RemyYYZ)
November 24, 2024, 3:39pm
9
It's not just one document, it's all about it.
RemyYYZ
(RemyYYZ)
November 24, 2024, 3:53pm
11
2024/11/24 23:44:17 DEBUG : rclone: Version "v1.68.2" starting with parameters ["rclone" "copy" "365:IMG_0010.jpg" "new:IMG_0010.jpg" "-vv"]
2024/11/24 23:44:17 DEBUG : Creating backend with remote "365:IMG_0010.jpg"
2024/11/24 23:44:17 DEBUG : Using config file from "C:\Users\Administrator\AppData\Roaming\rclone\rclone.conf"
2024/11/24 23:44:19 DEBUG : fs cache: adding new entry for parent of "365:IMG_0010.jpg", "365:"
2024/11/24 23:44:19 DEBUG : Creating backend with remote "new:IMG_0010.jpg"
2024/11/24 23:44:24 DEBUG : IMG_0010.jpg: Need to transfer - File not found at Destination
2024/11/24 23:44:31 DEBUG : IMG_0010.jpg: Starting multipart upload
2024/11/24 23:44:32 DEBUG : IMG_0010.jpg: Uploading segment 0/34406835 size 10485760
2024/11/24 23:45:23 INFO :
Transferred: 6.996 MiB / 32.813 MiB, 21%, 148.151 KiB/s, ETA 2m58s
Transferred: 0 / 1, 0%
Elapsed time: 1m5.8s
Transferring:
2024/11/24 23:45:53 DEBUG : IMG_0010.jpg: Uploading segment 10485760/34406835 size 10485760
2024/11/24 23:46:23 INFO :
Transferred: 14.996 MiB / 32.813 MiB, 46%, 149.731 KiB/s, ETA 2m1s
Transferred: 0 / 1, 0%
Elapsed time: 2m5.8s
Transferring:
2024/11/24 23:47:06 DEBUG : IMG_0010.jpg: Uploading segment 20971520/34406835 size 10485760
2024/11/24 23:47:23 INFO :
Transferred: 22.996 MiB / 32.813 MiB, 70%, 136.295 KiB/s, ETA 1m13s
Transferred: 0 / 1, 0%
Elapsed time: 3m5.8s
Transferring:
2024/11/24 23:48:13 DEBUG : IMG_0010.jpg: Uploading segment 31457280/34406835 size 2949555
2024/11/24 23:48:23 INFO :
Transferred: 31.996 MiB / 32.813 MiB, 98%, 156.782 KiB/s, ETA 5s
Transferred: 0 / 1, 0%
Elapsed time: 4m5.8s
Transferring:
2024/11/24 23:48:28 DEBUG : IMG_0010.jpg: quickxor = ec5ba0102e77016128f4b1da51d7f1038139088b OK
2024/11/24 23:48:28 INFO : IMG_0010.jpg: Copied (new)
2024/11/24 23:48:28 INFO :
Transferred: 32.813 MiB / 32.813 MiB, 100%, 170.119 KiB/s, ETA 0s
Transferred: 1 / 1, 100%
Elapsed time: 4m10.7s
2024/11/24 23:48:28 DEBUG : 9 go routines active
RemyYYZ
(RemyYYZ)
November 25, 2024, 4:53am
14
No, it has nothing to do with the storage unit, and the file in source OneDrive is smaller than the target.
RemyYYZ
(RemyYYZ)
November 25, 2024, 2:57pm
16
I did not rename the file and only transferred one file. The command I used was:
rclone copy "365:IMG_0010.jpg" "new:IMG_0010.jpg" -vv
RemyYYZ
(RemyYYZ)
December 1, 2024, 2:49am
17
It's a OneDrive design issue:
Microsoft Community
system
(system)
Closed
December 4, 2024, 2:49am
18
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.