Rclone is failing to download some large files from OneDrive

What is the problem you are having with rclone?

When using rclone --multi-thread-streams=0 copy, or using the rclone hashsum quickxor --download, some larger files are failing to down load from my OneDrive personal account. With no options, the files will download with the rclone copy command

Run the command 'rclone version' and share the full output of the command.

/tmp/w/rclone --version
rclone v1.71.1
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 6.8.0-1035-oracle (aarch64)
- os/type: linux
- os/arch: arm64 (ARMv8 compatible)
- go/version: go1.25.1
- go/linking: static
- go/tags: none

This also fails using rclone v1.68.1 on this same system

Which cloud storage system are you using? (eg Google Drive)

OneDrive personal

The command you were trying to run (eg rclone copy /tmp remote:tmp)

/tmp/w/rclone -vv --config ../r.conf hashsum quickxor --download 'OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz'

The rclone config contents with secrets removed.

/tmp/w/rclone --config ../r.conf config redacted
[OneDriveMain]
type = onedrive
token = XXX
drive_id = XXX
drive_type = personal
### Double check the config for sensitive info before posting publicly

A log from the command with the -vv flag

/tmp/w/rclone -vv --config ../r.conf hashsum quickxor --download 'OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz'
2025/10/20 04:01:37 DEBUG : rclone: Version "v1.71.1" starting with parameters ["/tmp/w/rclone" "-vv" "--config" "../r.conf" "hashsum" "quickxor" "--download" "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz"]
2025/10/20 04:01:37 DEBUG : Creating backend with remote "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz"
2025/10/20 04:01:37 DEBUG : Using config file from "/tmp/w/r.conf"
2025/10/20 04:01:47 DEBUG : fs cache: renaming child cache item "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz" to be canonical for parent "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware"
2025/10/20 04:01:49 DEBUG : Armbian_community_25.5.0-trunk.256_Nanopi-r5c_bookworm_current_6.12.19_minimal.img.xz: Excluded (FilesFrom Filter)
2025/10/20 04:01:49 DEBUG : Armbian_community_25.5.0-trunk.256_Nanopi-r5c_bookworm_current_6.12.19_minimal.img.xz: Excluded
2025/10/20 04:01:49 DEBUG : Armbian_community_25.5.0-trunk.256_Nanopi-r5c_bookworm_current_6.12.19_minimal.img.xz.sha: Excluded (FilesFrom Filter)
2025/10/20 04:01:49 DEBUG : Armbian_community_25.5.0-trunk.256_Nanopi-r5c_bookworm_current_6.12.19_minimal.img.xz.sha: Excluded
2025/10/20 04:01:49 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.md5: Excluded (FilesFrom Filter)
2025/10/20 04:01:49 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.md5: Excluded
2025/10/20 04:01:49 DEBUG : README.txt: Excluded (FilesFrom Filter)
2025/10/20 04:01:49 DEBUG : README.txt: Excluded
2025/10/20 04:02:17 DEBUG : pacer: low level retry 1/10 (error <nil>)
2025/10/20 04:02:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/10/20 04:02:43 DEBUG : pacer: low level retry 2/10 (error <nil>)
2025/10/20 04:02:43 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2025/10/20 04:03:09 DEBUG : pacer: low level retry 3/10 (error <nil>)
2025/10/20 04:03:09 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2025/10/20 04:03:37 DEBUG : pacer: low level retry 4/10 (error <nil>)
2025/10/20 04:03:37 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2025/10/20 04:04:01 DEBUG : pacer: low level retry 5/10 (error <nil>)
2025/10/20 04:04:01 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2025/10/20 04:04:25 DEBUG : pacer: low level retry 6/10 (error <nil>)
2025/10/20 04:04:25 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2025/10/20 04:04:55 DEBUG : pacer: low level retry 7/10 (error <nil>)
2025/10/20 04:04:55 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2025/10/20 04:05:19 DEBUG : pacer: low level retry 8/10 (error <nil>)
2025/10/20 04:05:19 DEBUG : pacer: Rate limited, increasing sleep to 2s
2025/10/20 04:05:43 DEBUG : pacer: low level retry 9/10 (error <nil>)
2025/10/20 04:06:12 DEBUG : pacer: low level retry 10/10 (error <nil>)
2025/10/20 04:06:12 ERROR : EDE-R5C-Production-Backup-28JUN25.img.gz: failed to open file EDE-R5C-Production-Backup-28JUN25.img.gz: needs retry
2025/10/20 04:06:12 DEBUG : 5 go routines active
2025/10/20 04:06:12 NOTICE: Failed to hashsum with 2 errors: last error was: failed to open file EDE-R5C-Production-Backup-28JUN25.img.gz: needs retry

Now here is using rclone copy with no options, which works

/tmp/w/rclone -vv --config ../r.conf copy 'OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz' .
2025/10/20 04:06:12 DEBUG : rclone: Version "v1.71.1" starting with parameters ["/tmp/w/rclone" "-vv" "--config" "../r.conf" "copy" "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz" "."]
2025/10/20 04:06:12 DEBUG : Creating backend with remote "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz"
2025/10/20 04:06:12 DEBUG : Using config file from "/tmp/w/r.conf"
2025/10/20 04:06:19 DEBUG : fs cache: renaming child cache item "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz" to be canonical for parent "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware"
2025/10/20 04:06:19 DEBUG : Creating backend with remote "."
2025/10/20 04:06:19 DEBUG : fs cache: renaming cache item "." to be canonical "/tmp/w/Y"
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Need to transfer - File not found at Destination
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: disabling buffering because destination uses OpenWriterAt
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: write buffer set to 131072
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Starting multi-thread copy with 23 chunks of size 64Mi with 4 parallel streams
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 4/23 (201326592-268435456) size 64Mi starting
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 1/23 (0-67108864) size 64Mi starting
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 2/23 (67108864-134217728) size 64Mi starting
2025/10/20 04:06:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 3/23 (134217728-201326592) size 64Mi starting
2025/10/20 04:06:23 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 2
2025/10/20 04:06:23 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 0
2025/10/20 04:06:24 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 1
2025/10/20 04:06:29 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 2/23 (67108864-134217728) size 64Mi finished
2025/10/20 04:06:29 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 5/23 (268435456-335544320) size 64Mi starting
2025/10/20 04:06:29 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 3
2025/10/20 04:06:33 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 1/23 (0-67108864) size 64Mi finished
2025/10/20 04:06:33 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 6/23 (335544320-402653184) size 64Mi starting
2025/10/20 04:06:36 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 4/23 (201326592-268435456) size 64Mi finished
2025/10/20 04:06:36 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 7/23 (402653184-469762048) size 64Mi starting
2025/10/20 04:06:36 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 4
2025/10/20 04:06:38 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 3/23 (134217728-201326592) size 64Mi finished
2025/10/20 04:06:38 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 8/23 (469762048-536870912) size 64Mi starting
2025/10/20 04:06:39 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 5
2025/10/20 04:06:41 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 5/23 (268435456-335544320) size 64Mi finished
2025/10/20 04:06:41 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 9/23 (536870912-603979776) size 64Mi starting
2025/10/20 04:06:41 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 6
2025/10/20 04:06:43 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 6/23 (335544320-402653184) size 64Mi finished
2025/10/20 04:06:43 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 10/23 (603979776-671088640) size 64Mi starting
2025/10/20 04:06:43 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 7
2025/10/20 04:06:47 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 7/23 (402653184-469762048) size 64Mi finished
2025/10/20 04:06:47 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 11/23 (671088640-738197504) size 64Mi starting
2025/10/20 04:06:47 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 8
2025/10/20 04:06:53 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 8/23 (469762048-536870912) size 64Mi finished
2025/10/20 04:06:53 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 12/23 (738197504-805306368) size 64Mi starting
2025/10/20 04:06:53 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 9
2025/10/20 04:06:57 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 9/23 (536870912-603979776) size 64Mi finished
2025/10/20 04:06:57 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 13/23 (805306368-872415232) size 64Mi starting
2025/10/20 04:06:57 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 10
2025/10/20 04:07:03 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 10/23 (603979776-671088640) size 64Mi finished
2025/10/20 04:07:03 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 14/23 (872415232-939524096) size 64Mi starting
2025/10/20 04:07:04 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 11
2025/10/20 04:07:08 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 12
2025/10/20 04:07:11 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 11/23 (671088640-738197504) size 64Mi finished
2025/10/20 04:07:11 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 15/23 (939524096-1006632960) size 64Mi starting
2025/10/20 04:07:16 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 12/23 (738197504-805306368) size 64Mi finished
2025/10/20 04:07:16 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 16/23 (1006632960-1073741824) size 64Mi starting
2025/10/20 04:07:16 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 13
2025/10/20 04:07:19 INFO  :
Transferred:      820.125 MiB / 1.378 GiB, 58%, 12.347 MiB/s, ETA 47s
Transferred:            0 / 1, 0%
Elapsed time:        59.6s
Transferring:
 *      EDE-R5C-Production-Backup-28JUN25.img.gz: 58% /1.378Gi, 12.354Mi/s, 47s

2025/10/20 04:07:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 13/23 (805306368-872415232) size 64Mi finished
2025/10/20 04:07:20 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 17/23 (1073741824-1140850688) size 64Mi starting
2025/10/20 04:07:21 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 14
2025/10/20 04:07:24 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 14/23 (872415232-939524096) size 64Mi finished
2025/10/20 04:07:24 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 18/23 (1140850688-1207959552) size 64Mi starting
2025/10/20 04:07:24 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 16
2025/10/20 04:07:29 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 15/23 (939524096-1006632960) size 64Mi finished
2025/10/20 04:07:29 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 19/23 (1207959552-1275068416) size 64Mi starting
2025/10/20 04:07:29 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 17
2025/10/20 04:07:33 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 17/23 (1073741824-1140850688) size 64Mi finished
2025/10/20 04:07:33 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 20/23 (1275068416-1342177280) size 64Mi starting
2025/10/20 04:07:34 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 18
2025/10/20 04:07:37 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 18/23 (1140850688-1207959552) size 64Mi finished
2025/10/20 04:07:37 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 21/23 (1342177280-1409286144) size 64Mi starting
2025/10/20 04:07:37 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 19
2025/10/20 04:07:40 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 19/23 (1207959552-1275068416) size 64Mi finished
2025/10/20 04:07:40 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 22/23 (1409286144-1476395008) size 64Mi starting
2025/10/20 04:07:40 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 20
2025/10/20 04:07:43 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 20/23 (1275068416-1342177280) size 64Mi finished
2025/10/20 04:07:43 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 21
2025/10/20 04:07:44 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 23/23 (1476395008-1479929824) size 3.371Mi starting
2025/10/20 04:07:48 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 22
2025/10/20 04:07:49 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: writing chunk 15
2025/10/20 04:07:56 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 16/23 (1006632960-1073741824) size 64Mi finished
2025/10/20 04:07:58 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 21/23 (1342177280-1409286144) size 64Mi finished
2025/10/20 04:08:04 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 22/23 (1409286144-1476395008) size 64Mi finished
2025/10/20 04:08:04 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: multi-thread copy: chunk 23/23 (1476395008-1479929824) size 3.371Mi finished
2025/10/20 04:08:04 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Finished multi-thread copy with 23 parts of size 64Mi
2025/10/20 04:08:05 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: quickxor = 0c5fdb0cffdd90ad6a78349edeafd7787077e35a OK
2025/10/20 04:08:05 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz.88fdc9c1.partial: renamed to: EDE-R5C-Production-Backup-28JUN25.img.gz
2025/10/20 04:08:05 INFO  : EDE-R5C-Production-Backup-28JUN25.img.gz: Multi-thread Copied (new)
2025/10/20 04:08:05 INFO  :
Transferred:        1.378 GiB / 1.378 GiB, 100%, 10.936 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:      1m45.2s

2025/10/20 04:08:05 DEBUG : 7 go routines active

Now here is using rclone copy --multi-thread-streams=0 which does not work

This is the head and tail of the log. Due to length limits of this forum, the rest is at, : 
https://justpaste.it/bm02l

/tmp/w/rclone -vv --multi-thread-streams=0 --config ../r.conf copy 'OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz' .
2025/10/20 04:08:05 DEBUG : rclone: Version "v1.71.1" starting with parameters ["/tmp/w/rclone" "-vv" "--multi-thread-streams=0" "--config" "../r.conf" "copy" "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz" "."]
2025/10/20 04:08:05 DEBUG : Creating backend with remote "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz"
2025/10/20 04:08:05 DEBUG : Using config file from "/tmp/w/r.conf"
2025/10/20 04:08:15 DEBUG : fs cache: renaming child cache item "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz" to be canonical for parent "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware"
2025/10/20 04:08:15 DEBUG : Creating backend with remote "."
2025/10/20 04:08:15 DEBUG : fs cache: renaming cache item "." to be canonical "/tmp/w/Y"
2025/10/20 04:08:15 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Need to transfer - File not found at Destination
2025/10/20 04:08:35 DEBUG : pacer: low level retry 1/10 (error <nil>)
2025/10/20 04:08:35 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/10/20 04:08:51 DEBUG : pacer: low level retry 2/10 (error <nil>)
2025/10/20 04:08:51 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2025/10/20 04:09:08 DEBUG : pacer: low level retry 3/10 (error <nil>)
2025/10/20 04:09:08 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2025/10/20 04:09:15 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:        59.6s
Transferring:
 *      EDE-R5C-Production-Backup-28JUN25.img.gz: transferring

2025/10/20 04:09:26 DEBUG : pacer: low level retry 4/10 (error <nil>)
2025/10/20 04:09:26 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2025/10/20 04:09:48 DEBUG : pacer: low level retry 5/10 (error <nil>)
2025/10/20 04:09:48 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2025/10/20 04:10:05 DEBUG : pacer: low level retry 6/10 (error <nil>)
2025/10/20 04:10:05 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2025/10/20 04:10:15 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:      1m59.6s
Transferring:
 *      EDE-R5C-Production-Backup-28JUN25.img.gz: transferring

2025/10/20 04:10:23 DEBUG : pacer: low level retry 7/10 (error <nil>)
2025/10/20 04:10:23 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2025/10/20 04:10:45 DEBUG : pacer: low level retry 8/10 (error <nil>)
2025/10/20 04:10:45 DEBUG : pacer: Rate limited, increasing sleep to 2s
2025/10/20 04:11:12 DEBUG : pacer: low level retry 9/10 (error <nil>)
2025/10/20 04:11:15 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:      2m59.6s
Transferring:
 *      EDE-R5C-Production-Backup-28JUN25.img.gz: transferring

2025/10/20 04:11:35 DEBUG : pacer: low level retry 10/10 (error <nil>)
2025/10/20 04:11:35 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Received error: failed to open source object: needs retry - low level retry 0/10

... 
(tail)

2025/10/20 06:29:24 DEBUG : pacer: low level retry 9/10 (error <nil>)
2025/10/20 06:29:44 DEBUG : pacer: low level retry 10/10 (error <nil>)
2025/10/20 06:29:44 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Received error: failed to open source object: needs retry - low level retry 9/10
2025/10/20 06:29:44 ERROR : EDE-R5C-Production-Backup-28JUN25.img.gz: Failed to copy: failed to open source object: needs retry
2025/10/20 06:29:44 ERROR : Attempt 3/3 failed with 1 errors and: failed to open source object: needs retry
2025/10/20 06:29:44 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:   2h21m29.3s


2025/10/20 06:29:44 DEBUG : 7 go routines active
2025/10/20 06:29:44 NOTICE: Failed to copy: failed to open source object: needs retry

for a deeper look, at the API calls, and to keep the logs smaller,
make sure to test just one single file and use flags
--dump=headers --log-level=DEBUG --retries=1 --low-level-retries=1

So, do you want me to re-run one of my tests with the those flags?

yes, rclone copy just one single file.

Here is the copy of 1 file:


/tmp/w/rclone --dump=headers --log-level=DEBUG --retries=1 --low-level-retries=1 --multi-thread-streams=0 --config ../r.conf copy 'OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz' .
2025/10/20 14:37:45 DEBUG : rclone: Version "v1.71.1" starting with parameters ["/tmp/w/rclone" "--dump=headers" "--log-level=DEBUG" "--retries=1" "--low-level-retries=1" "--multi-thread-streams=0" "--config" "../r.conf" "copy" "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz" "."]
2025/10/20 14:37:45 DEBUG : Creating backend with remote "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz"
2025/10/20 14:37:45 DEBUG : Using config file from "/tmp/w/r.conf"
2025/10/20 14:37:45 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2025/10/20 14:37:45 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:45 DEBUG : HTTP REQUEST (req 0x40001f7040)
2025/10/20 14:37:45 DEBUG : GET /v1.0/drives/c72aaf4efd335c2a/root HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:45 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:46 DEBUG : HTTP RESPONSE (req 0x40001f7040)
2025/10/20 14:37:46 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: 2ca2b913-b671-4db9-820a-fe48238438f8
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:46 GMT
Odata-Version: 4.0
Request-Id: 2ca2b913-b671-4db9-820a-fe48238438f8
Splogid: ae43d1a1-605a-e000-6201-d5d687dc919b
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:46 DEBUG : HTTP REQUEST (req 0x4000be43c0)
2025/10/20 14:37:46 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!sea8cc6beffdb43d7976fbc7da445c639:/Documents: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:47 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:47 DEBUG : HTTP RESPONSE (req 0x4000be43c0)
2025/10/20 14:37:47 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: e5f78efa-07e0-49bc-9de3-775505681ff5
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:47 GMT
Odata-Version: 4.0
Request-Id: e5f78efa-07e0-49bc-9de3-775505681ff5
Splogid: ae43d1a1-108e-e000-6201-d902f619368b
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:47 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:47 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:47 DEBUG : HTTP REQUEST (req 0x4000be4a00)
2025/10/20 14:37:47 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!115:/Computers%20and%20Phones%20Info: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:47 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:48 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:48 DEBUG : HTTP RESPONSE (req 0x4000be4a00)
2025/10/20 14:37:48 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: a3351e24-04ee-424d-8dad-4eb4a8e62c90
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:48 GMT
Odata-Version: 4.0
Request-Id: a3351e24-04ee-424d-8dad-4eb4a8e62c90
Splogid: ae43d1a1-e0bf-e000-3885-45d23f580722
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:48 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:48 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:48 DEBUG : HTTP REQUEST (req 0x4000be5180)
2025/10/20 14:37:48 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!3519:/FriendlyElec: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:48 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:49 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:49 DEBUG : HTTP RESPONSE (req 0x4000be5180)
2025/10/20 14:37:49 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: b43fe822-c212-4a65-a0ec-74f995572cca
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:48 GMT
Odata-Version: 4.0
Request-Id: b43fe822-c212-4a65-a0ec-74f995572cca
Splogid: ae43d1a1-20df-e000-6201-db8b169a2f7f
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:49 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:49 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:49 DEBUG : HTTP REQUEST (req 0x4000a5ea00)
2025/10/20 14:37:49 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!s916f64b2981e49f08b01978b0d1c83c3:/R5C: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:49 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:49 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:49 DEBUG : HTTP RESPONSE (req 0x4000a5ea00)
2025/10/20 14:37:49 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: 429f640c-f8df-4a0d-8eaf-e5dab05dd11b
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:49 GMT
Odata-Version: 4.0
Request-Id: 429f640c-f8df-4a0d-8eaf-e5dab05dd11b
Splogid: af43d1a1-d010-e000-6201-d5df61fe6f5e
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:49 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:49 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:49 DEBUG : HTTP REQUEST (req 0x4000be5a40)
2025/10/20 14:37:49 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!s5f92e1a8cf614174bc6701b998c70e3b:/firmware: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:49 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:50 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:50 DEBUG : HTTP RESPONSE (req 0x4000be5a40)
2025/10/20 14:37:50 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: d7976c5e-1e83-465f-8acb-40334b6f2085
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:50 GMT
Odata-Version: 4.0
Request-Id: d7976c5e-1e83-465f-8acb-40334b6f2085
Splogid: af43d1a1-3043-e000-1de9-d0560b35cb2f
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:50 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:50 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:50 DEBUG : HTTP REQUEST (req 0x4000a5f180)
2025/10/20 14:37:50 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!s57ac2217687d4b48a880a8fa8e9b5d9c:/EDE-R5C-Production-Backup-28JUN25.img.gz: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:50 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:51 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:51 DEBUG : HTTP RESPONSE (req 0x4000a5f180)
2025/10/20 14:37:51 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: 322a0b65-2cef-41c2-b085-2d156dca6d56
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:50 GMT
Odata-Version: 4.0
Request-Id: 322a0b65-2cef-41c2-b085-2d156dca6d56
Splogid: af43d1a1-105e-e000-6201-dc150a5e0636
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:51 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:51 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:51 DEBUG : HTTP REQUEST (req 0x4000a5fa40)
2025/10/20 14:37:51 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!sea8cc6beffdb43d7976fbc7da445c639:/Documents: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:51 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:51 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:51 DEBUG : HTTP RESPONSE (req 0x4000a5fa40)
2025/10/20 14:37:51 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: 03c2c4b0-7b70-4699-beee-f6f9827e11ac
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:50 GMT
Odata-Version: 4.0
Request-Id: 03c2c4b0-7b70-4699-beee-f6f9827e11ac
Splogid: af43d1a1-9076-e000-6201-dc71c6b3397a
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:51 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:51 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:51 DEBUG : HTTP REQUEST (req 0x4000c303c0)
2025/10/20 14:37:51 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!115:/Computers%20and%20Phones%20Info: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:51 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:51 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:51 DEBUG : HTTP RESPONSE (req 0x4000c303c0)
2025/10/20 14:37:51 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: 5de42155-753f-43cc-b1ff-cda8ae061e2f
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:51 GMT
Odata-Version: 4.0
Request-Id: 5de42155-753f-43cc-b1ff-cda8ae061e2f
Splogid: af43d1a1-f08e-e000-3885-4c6576e04d7b
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:51 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:51 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:51 DEBUG : HTTP REQUEST (req 0x4000c30b40)
2025/10/20 14:37:51 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!3519:/FriendlyElec: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:51 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:52 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:52 DEBUG : HTTP RESPONSE (req 0x4000c30b40)
2025/10/20 14:37:52 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: aab754cd-b309-4712-85ee-ad31c1e38748
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:52 GMT
Odata-Version: 4.0
Request-Id: aab754cd-b309-4712-85ee-ad31c1e38748
Splogid: af43d1a1-70c0-e000-6201-d16c8d71f37f
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:52 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:52 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:52 DEBUG : HTTP REQUEST (req 0x4000cd0500)
2025/10/20 14:37:52 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!s916f64b2981e49f08b01978b0d1c83c3:/R5C: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:52 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:53 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:53 DEBUG : HTTP RESPONSE (req 0x4000cd0500)
2025/10/20 14:37:53 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: eb2c508d-8b33-4dea-9194-8283a8d30700
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:52 GMT
Odata-Version: 4.0
Request-Id: eb2c508d-8b33-4dea-9194-8283a8d30700
Splogid: af43d1a1-30d9-e000-6201-d8f1575d2ffa
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:53 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:53 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:53 DEBUG : HTTP REQUEST (req 0x4000c31540)
2025/10/20 14:37:53 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!s5f92e1a8cf614174bc6701b998c70e3b:/firmware: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:53 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:53 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:53 DEBUG : HTTP RESPONSE (req 0x4000c31540)
2025/10/20 14:37:53 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: 121b69fd-575c-4683-ab23-a4cb5a6c65ff
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:53 GMT
Odata-Version: 4.0
Request-Id: 121b69fd-575c-4683-ab23-a4cb5a6c65ff
Splogid: b043d1a1-f009-e000-1de9-d5e7824419a4
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:53 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:53 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:53 DEBUG : HTTP REQUEST (req 0x4000cd0b40)
2025/10/20 14:37:53 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!s57ac2217687d4b48a880a8fa8e9b5d9c:/EDE-R5C-Production-Backup-28JUN25.img.gz: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:53 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:54 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:54 DEBUG : HTTP RESPONSE (req 0x4000cd0b40)
2025/10/20 14:37:54 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: b7195e52-564a-46bb-8eb0-1d89dbac9265
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:54 GMT
Odata-Version: 4.0
Request-Id: b7195e52-564a-46bb-8eb0-1d89dbac9265
Splogid: b043d1a1-a03e-e000-1de9-d63958c0c350
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:54 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:54 DEBUG : fs cache: renaming child cache item "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware/EDE-R5C-Production-Backup-28JUN25.img.gz" to be canonical for parent "OneDriveMain:Documents/Computers and Phones Info/FriendlyElec/R5C/firmware"
2025/10/20 14:37:54 DEBUG : Creating backend with remote "."
2025/10/20 14:37:54 DEBUG : fs cache: renaming cache item "." to be canonical "/tmp/w/Y"
2025/10/20 14:37:54 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:54 DEBUG : HTTP REQUEST (req 0x4000cd12c0)
2025/10/20 14:37:54 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!s57ac2217687d4b48a880a8fa8e9b5d9c:/EDE-R5C-Production-Backup-28JUN25.img.gz: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:54 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:55 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:55 DEBUG : HTTP RESPONSE (req 0x4000cd12c0)
2025/10/20 14:37:55 DEBUG : HTTP/2.0 200 OK
Cache-Control: no-store, no-cache
Client-Request-Id: 832f6c73-1d29-447e-829e-00cb1b011101
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Mon, 20 Oct 2025 14:37:54 GMT
Odata-Version: 4.0
Request-Id: 832f6c73-1d29-447e-829e-00cb1b011101
Splogid: b043d1a1-805a-e000-1de9-d6c02459ea6a
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}

2025/10/20 14:37:55 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:55 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Need to transfer - File not found at Destination
2025/10/20 14:37:55 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:55 DEBUG : HTTP REQUEST (req 0x4000c78140)
2025/10/20 14:37:55 DEBUG : GET /v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!sf10dcb49116c4e599bab7d33fe3b54f2/content HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.71.1
Authorization: XXXX
Accept-Encoding: gzip

2025/10/20 14:37:55 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:55 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:55 DEBUG : HTTP RESPONSE (req 0x4000c78140)
2025/10/20 14:37:55 DEBUG : HTTP/2.0 302 Found
Cache-Control: no-store, no-cache
Client-Request-Id: 848ee825-e350-462c-b500-90b20087353a
Date: Mon, 20 Oct 2025 14:37:54 GMT
Location: https://my.microsoftpersonalcontent.com/personal/c72aaf4efd335c2a/_layouts/15/download.aspx?UniqueId=f10dcb49-116c-4e59-9bab-7d33fe3b54f2&Translate=false&tempauth=v1e.eyJzaXRlaWQiOiI0OGE3YWFmNS05MmZiLTQ0YTgtOWY5MS0zNTRkNTZlMjE4NWEiLCJhcHBfZGlzcGxheW5hbWUiOiJyY2xvbmUiLCJhcHBpZCI6ImIxNTY2NWQ5LWVkYTYtNDA5Mi04NTM5LTBlZWMzNzZhZmQ1OSIsImF1ZCI6IjAwMDAwMDAzLTAwMDAtMGZmMS1jZTAwLTAwMDAwMDAwMDAwMC9teS5taWNyb3NvZnRwZXJzb25hbGNvbnRlbnQuY29tQDkxODgwNDBkLTZjNjctNGM1Yi1iMTEyLTM2YTMwNGI2NmRhZCIsImV4cCI6IjE3NjA5NzQ2NzUifQ.iZLy4RUnlqcCnULjgujlMFbQDGrm-AfLXGa3M7x6nQCt9iiPse4PKrFq-s9oMFI4zeOHtbGWQJG1rOMo5uec8rGcUund2dlwyvTmkHe30IpBKVbOm1bw2pS8mY5gBJ3QVXuFd1CNE7uparDt6_QoVn3RyeWNczux4__8mh0Z1ssp-wIHN4Im1F3JU92ej5EID5si2-mOo77AdMzM3LeoMGiL_gGJu5g02vnIEfjDiEEj4UpH4EpNHPWPGmSB2iyMCidWdaulkZHRo_G50WcOIh3-A9Nf5SC_hzRSf4mAId8dT522sody7OYhV0BdnCNsif9Y7Elp1WmWo5MCM4BiIAaQhhdT2o0IsU8I-XyWbLfiKadNrytAJjtqATWYNSa9IH3QXuRu-Z4iAny6Y88b2x1H9qUugVClg6bRtLb8bEjggjdYo3Sgwthhm8KdfKgHaaMCld27Z8EPJ2GSn84FZg.Z9QWEj6gDVyg-D0NkQbx1oVhuKo5BwQ52WB_R8Cm_28&ApiVersion=2.0
Request-Id: 848ee825-e350-462c-b500-90b20087353a
Splogid: b043d1a1-5074-e000-6201-d868b5f62daa
Strict-Transport-Security: max-age=31536000
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"Canada East","Slice":"E","Ring":"3","ScaleUnit":"001","RoleInstance":"QB1PEPF000057A2"}}
Content-Length: 0

2025/10/20 14:37:55 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:37:55 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:37:55 DEBUG : HTTP REQUEST (req 0x4000c78640)
2025/10/20 14:37:55 DEBUG : GET /personal/c72aaf4efd335c2a/_layouts/15/download.aspx?UniqueId=f10dcb49-116c-4e59-9bab-7d33fe3b54f2&Translate=false&tempauth=v1e.eyJzaXRlaWQiOiI0OGE3YWFmNS05MmZiLTQ0YTgtOWY5MS0zNTRkNTZlMjE4NWEiLCJhcHBfZGlzcGxheW5hbWUiOiJyY2xvbmUiLCJhcHBpZCI6ImIxNTY2NWQ5LWVkYTYtNDA5Mi04NTM5LTBlZWMzNzZhZmQ1OSIsImF1ZCI6IjAwMDAwMDAzLTAwMDAtMGZmMS1jZTAwLTAwMDAwMDAwMDAwMC9teS5taWNyb3NvZnRwZXJzb25hbGNvbnRlbnQuY29tQDkxODgwNDBkLTZjNjctNGM1Yi1iMTEyLTM2YTMwNGI2NmRhZCIsImV4cCI6IjE3NjA5NzQ2NzUifQ.iZLy4RUnlqcCnULjgujlMFbQDGrm-AfLXGa3M7x6nQCt9iiPse4PKrFq-s9oMFI4zeOHtbGWQJG1rOMo5uec8rGcUund2dlwyvTmkHe30IpBKVbOm1bw2pS8mY5gBJ3QVXuFd1CNE7uparDt6_QoVn3RyeWNczux4__8mh0Z1ssp-wIHN4Im1F3JU92ej5EID5si2-mOo77AdMzM3LeoMGiL_gGJu5g02vnIEfjDiEEj4UpH4EpNHPWPGmSB2iyMCidWdaulkZHRo_G50WcOIh3-A9Nf5SC_hzRSf4mAId8dT522sody7OYhV0BdnCNsif9Y7Elp1WmWo5MCM4BiIAaQhhdT2o0IsU8I-XyWbLfiKadNrytAJjtqATWYNSa9IH3QXuRu-Z4iAny6Y88b2x1H9qUugVClg6bRtLb8bEjggjdYo3Sgwthhm8KdfKgHaaMCld27Z8EPJ2GSn84FZg.Z9QWEj6gDVyg-D0NkQbx1oVhuKo5BwQ52WB_R8Cm_28&ApiVersion=2.0 HTTP/1.1
Host: my.microsoftpersonalcontent.com
User-Agent: rclone/v1.71.1
Referer: https://graph.microsoft.com/v1.0/drives/C72AAF4EFD335C2A/items/C72AAF4EFD335C2A!sf10dcb49116c4e599bab7d33fe3b54f2/content
Accept-Encoding: gzip

2025/10/20 14:37:55 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/10/20 14:38:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:38:15 DEBUG : HTTP RESPONSE (req 0x4000c78640)
2025/10/20 14:38:15 DEBUG : HTTP/2.0 500 Internal Server Error
Content-Length: 3490
Accept-Ranges: bytes
Alt-Svc: h3=":443";ma=86400
Cache-Control: private,private
Content-Disposition: attachment;filename*=utf-8''EDE%2DR5C%2DProduction%2DBackup%2D28JUN25%2Eimg%2Egz;filename="EDE-R5C-Production-Backup-28JUN25.img.gz"
Content-Security-Policy: frame-ancestors 'self' teams.microsoft.com *.teams.microsoft.com *.skype.com *.teams.microsoft.us local.teams.office.com teams.cloud.microsoft teams.live.com *.teams.live.com *.office365.com goals.cloud.microsoft *.powerapps.com *.powerbi.com *.yammer.com engage.cloud.microsoft word.cloud.microsoft excel.cloud.microsoft powerpoint.cloud.microsoft *.officeapps.live.com *.office.com *.microsoft365.com m365.cloud.microsoft *.cloud.microsoft *.stream.azure-test.net *.dynamics.com *.microsoft.com onedrive.live.com *.onedrive.live.com securebroker.sharepointonline.com;
Content-Type: application/x-gzip; charset=utf-8
Ctag: {F10DCB49-116C-4E59-9BAB-7D33FE3B54F2},2,2
Date: Mon, 20 Oct 2025 14:38:14 GMT
Docid: my.microsoftpersonalcontent.com_48a7aaf5-92fb-44a8-9f91-354d56e2185a_f10dcb49-116c-4e59-9bab-7d33fe3b54f2
Etag: "{F10DCB49-116C-4E59-9BAB-7D33FE3B54F2},2"
Isocdi: 0
Microsoftsharepointteamservices: 16.0.0.26601
Microsoftsharepointteamservices: 16.0.0.26608
Ms-Cv: odFDsJLQAADzOwQbNB7rFQ.0
P3p: CP="ALL IND DSP COR ADM CONo CUR CUSo IVAo IVDo PSA PSD TAI TELo OUR SAMo CNT COM INT NAV ONL PHY PRE PUR UNI"
Request-Id: b043d1a1-d092-0000-f33b-041b341eeb15
Server: Microsoft-IIS/10.0
Server: Microsoft-IIS/10.0
Spiislatency: 1
Splogid: b043d1a1-a0b0-e000-6201-d0b3b31f476a
Spnumhops: 1
Sprequestduration: 19265
Sprequestguid: b043d1a1-d092-0000-f33b-041b341eeb15
Strict-Transport-Security: max-age=31536000
Via: 201559;189392
X-1dscollectorurl: https://eu-mobile.events.data.microsoft.com/OneCollector/1.0/
X-Ariacollectorurl: https://eu-mobile.events.data.microsoft.com/Collector/3.0/
X-Aspnet-Version: 4.0.30319
X-Aspnet-Version: 4.0.30319
X-Content-Type-Options: nosniff
X-Databoundary: EU
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ms-Invokeapp: 1; RequireReadOnly
X-Networkstatistics: 0,4194720,0,0,355,24584,24584,113311
X-Powered-By: ASP.NET
X-Sharepointhealthscore: 2

2025/10/20 14:38:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/10/20 14:38:15 DEBUG : pacer: low level retry 1/1 (error <nil>)
2025/10/20 14:38:15 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/10/20 14:38:15 DEBUG : EDE-R5C-Production-Backup-28JUN25.img.gz: Received error: failed to open source object: needs retry - low level retry 0/1
2025/10/20 14:38:15 ERROR : EDE-R5C-Production-Backup-28JUN25.img.gz: Failed to copy: failed to open source object: needs retry
2025/10/20 14:38:15 ERROR : Attempt 1/1 failed with 1 errors and: failed to open source object: needs retry
2025/10/20 14:38:15 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:        19.9s

2025/10/20 14:38:15 DEBUG : 7 go routines active
2025/10/20 14:38:15 NOTICE: Failed to copy: failed to open source object: needs retry

i wonder if this is a server issue, that will go away on its own.
else, soon, we should more new topics about it.

Looks like, for whatever reason, that the server doesn't like GET requests without a Range header on those big files.

I'm guessing @asdffdsa is right and this will clear up when the provider fixes it.

I just re-ran the test script, with the same results, where:

rclone hashsum quickxor --download  FAILED
rclone copy WORKED
rclone copy --multi-thread-streams=0 FAILED

I will check it daily and will report back if it fixes itself.

Might be worth trying the --disable-http2 flag.

You were correct that the problem might fix itself. I just re-ran the test script a couple times, and it is working now, without any errors.

I did not add the --disable-http2 flag.

Good news :slight_smile: In general "500 Server errors" are usually caused by something going wrong at the provider. Most usual cause is overloading but it can be anything.

Thank you for looking into this.

The error was difficult to explain, as it affected only a handful of files out of more than 10,000, and occurred over several days. It consistently failed on the same files, so I added them to an exclude list and created a test case for this bug report on a second client system. All of the affected files were large, though not the largest in the set. Using the OneDrive web interface, I could download all the affected files.

I removed the exclued file list in the product script, and it also ran without errors.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.