Rclone sync error for some files: Failed to copy: multi-thread copy: failed to open source: 416 Requested Range Not Satisfiable

Help and Support
1

What is the problem you are having with rclone?

I am using rclone to sync from OneDrive to an external hard drive. The sync is almost complete, but I keep getting this error for four .mp4 files I have:

Failed to copy: multi-thread copy: failed to open source: 416 Requested Range Not Satisfiable:

Not sure why these four specific files give errors, I have others and it worked fine for those. One thing I noticed though is that the size of one file is ~130MB on average, but that doesn't seem too large to cause issues.

I tried rclone copyto to manually try to get the files, but I got the same error.

I also ran rclone ls to check if the files exist for rclone, and they do.

Run the command 'rclone version' and share the full output of the command.

rclone v1.66.0-beta.7597.1f6271fa1
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.15.133.1-microsoft-standard-WSL2 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.5
- go/linking: static
- go/tags: none

I installed beta due to another issue I was having, also found in this post.

Which cloud storage system are you using? (eg Google Drive)

OneDrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

sudo rclone sync --config="rclone.conf" --interactive --progress onedrive: /mnt/d/OneDrive/

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[onedrive]
type = onedrive
client_id = XXX
client_secret = XXX
token = XXX
drive_id = XXX
drive_type = personal

A log from the command that you were trying to run with the -vv flag

 * Pictures/Samsung Galle…ra/20231031_182958.mp4:  0% /316.511Mi, 0/s, -
2024/01/06 17:16:59 ERROR : Pictures/Samsung Gallery/DCIM/Camera/20230923_121902.mp4: Failed to copy: multi-thread copy: failed to open source: 416 Requested Range Not Satisfiable:
Transferred:   	    2.542 MiB / 1.230 GiB, 0%, 162.713 KiB/s, ETA 2h11m52s
Errors:                 1 (retrying may help)
Checks:             45553 / 55562, 82%
Transferred:            4 / 26, 15%
Elapsed time:      3m12.6s

2024/01/06 17:16:59 ERROR : Pictures/Samsung Gallery/DCIM/Camera/20230817_172548.mp4: Failed to copy: multi-thread copy: failed to open source: 416 Requested Range Not Satisfiable:
Transferred:   	    2.542 MiB / 1000.377 MiB, 0%, 162.713 KiB/s, ETA 1h44m39s
Errors:                 2 (retrying may help)
Checks:             45743 / 55752, 82%
Transferred:            4 / 25, 16%
Elapsed time:      3m12.7s

Transferring:
 * Pictures/Samsung Galle…ra/20231002_193200.mp4:  0% /259.611Mi, 0/s, -
2024/01/06 17:20:47 ERROR : Pictures/Samsung Gallery/DCIM/Camera/20231002_193200.mp4: Failed to copy: multi-thread copy: failed to open source: 416 Requested Range Not Satisfiable:
Transferred:   	  121.245 MiB / 380.856 MiB, 32%, 93.744 KiB/s, ETA 47m15s
Errors:                 4 (retrying may help)
Checks:            160561 / 163172, 98%
Transferred:           57 / 58, 98%
Elapsed time:       7m0.3s

Transferring:
 * Pictures/Samsung Galle…ra/20231031_182958.mp4:  0% /316.511Mi, 0/s, -
2024/01/06 17:24:32 ERROR : Pictures/Samsung Gallery/DCIM/Camera/20231031_182958.mp4: Failed to copy: multi-thread copy: failed to open source: 416 Requested Range Not Satisfiable:
Transferred:   	  236.691 MiB / 553.202 MiB, 43%, 93.744 KiB/s, ETA 57m37s
Errors:                 4 (retrying may help)
Checks:            276500 / 279573, 99%
Transferred:           94 / 95, 99%
Elapsed time:     10m45.4s

2024/01/06 17:26:58 ERROR : Local file system at /mnt/d/OneDrive: not deleting files as there were IO errors
Transferred:   	  345.549 MiB / 345.549 MiB, 100%, 93.744 KiB/s, ETA 0s
Errors:                 4 (retrying may help)
Checks:            349382 / 349382, 100%
Transferred:          112 / 112, 100%
Elapsed time:     13m12.3s
2024/01/06 17:26:58 ERROR : Local file system at /mnt/d/OneDrive: not deleting directories as there were IO errors
Transferred:   	  345.549 MiB / 345.549 MiB, 100%, 93.744 KiB/s, ETA 0s
Errors:                 4 (retrying may help)
Checks:            349382 / 349382, 100%
Transferred:          112 / 112, 100%
Elapsed time:     13m12.3s
2024/01/06 17:26:58 ERROR : Attempt 3/3 failed with 4 errors and: multi-thread copy: failed to open source: 416 Requested Range Not Satisfiable:
Transferred:   	  345.549 MiB / 345.549 MiB, 100%, 93.744 KiB/s, ETA 0s
Errors:                 4 (retrying may help)
Checks:            349382 / 349382, 100%
Transferred:          112 / 112, 100%
Elapsed time:     13m12.3sTransferred:   	  345.549 MiB / 345.549 MiB, 100%, 93.744 KiB/s, ETA 0s
Errors:                 4 (retrying may help)
Checks:            349382 / 349382, 100%
Transferred:          112 / 112, 100%
Elapsed time:     13m12.3s

Is there any way this issue can be solved? Thank you.

2

welcome to the forum,

that has been discussed a number of times in the forum, including a possbile solution.
did none of those topics solve your issue?

instead of beta, might try the last stable release, v1.64.2

maybe try --multi-thread-streams=0

3

Thank you for the reply,

I searched in the forum for the error of course, and I found only these 2 instances where the same issue was discussed.

Thank you a lot, that worked!

1 Like
4

welcome

rclone has been doing a lot of work on multi-part uploads and there have been a number of issues.
transitioning from being controlled by the backend provider to being controlled by rclone.

so, i force rclone to continue relying on the backend provider, by using --multi-thread-streams=0

so i am thinking, maybe, there is a bug somewhere.
if you have time for a quick test, run the beta with --multi-thread-streams=0

5

Of course, glad to be of help. I tried with both the beta version I mentioned above and v1.64.2 and both worked fine it seems.

6

There is certainly a bug...

However I don't think this one is in rclone!

I think this is the correct issue #5580.

What is happening is that onedrive tells us the file is one length, but only gives us a different length of data when we read it.

We did a fix to fix rclone copy

However this doesn't fix rclone mount and it looks like it has broken with the new multi thread streaming code which expects files to be the correct length.

This is a specific problem with these HEIC type photos which onedrive acknowledged but it looks like it isn't fixed yet.

At minimum we should mention the need for --multi-thread-streams=0 in the onedrive docs when transferring HEIC files. I can't think of a better work around right now but maybe something will come to me...

In fact we have a section in the docs about this already.

It looks like it needs updating with --multi-thread-streams=0 - do you fancy making a PR @asdffdsa ?

7

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.