Attempting to copy from Wasabi to B2 fails on random files

Help and Support
1

What is the problem you are having with rclone?

seemingly random files fail to copy from wasabi-s3 remote to backblaze b2 remote. The error is similar to the one from this post: Wasabi copy between 2 buckets error.

Run the command 'rclone version' and share the full output of the command.

$ rclone --version
rclone v1.69.1
- os/version: ubuntu 24.04 (64 bit)
- os/kernel: 6.8.0-57-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.0
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Wasabi-S3 and Backblaze B2

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy --progress --verbose --log-file=rclone-debug.log --dump=headers --retries=1 --low-level-retries=1 "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4" "b2:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08"

note, I was originally trying to sync the two remotes using:

rclone sync --progress --verbose --log-file=rclone.log --stats 1m --transfers 8 --checkers 8 wasabi-s3:/bucket.name/Media b2:/bucket.name/Media

this worked for all but 56 files. The filesize of these files that won't copy is ~750MB-~6GiB. I have also confirmed that I can access these files on the wasabi-s3 remote and they appear to be whole/not corrupted.

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[b2]
type = b2
account = XXX
key = XXX

[immich-wasabi-s3]
type = s3
provider = Wasabi
access_key_id = XXX
secret_access_key = XXX
endpoint = s3.wasabisys.com
acl = private

[wasabi-s3]
type = s3
provider = Wasabi
access_key_id = XXX
secret_access_key = XXX
endpoint = s3.us-central-1.wasabisys.com
acl = private
bucket_acl = private

[wasabi-us-central]
type = s3
provider = Wasabi

A log from the command that you were trying to run with the -vv flag

2025/05/05 16:43:24 NOTICE: Automatically setting -vv as --dump is enabled
2025/05/05 16:43:24 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "copy" "--progress" "--verbose" "--log-file=rclone-debug.log" "--dump=headers" "--retries=1" "--low-level-retries=1" "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4" "b2:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08"]
2025/05/05 16:43:24 DEBUG : Creating backend with remote "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4"
2025/05/05 16:43:24 DEBUG : Using config file from "/home/ryan/.config/rclone/rclone.conf"
2025/05/05 16:43:24 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2025/05/05 16:43:24 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2025/05/05 16:43:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:24 DEBUG : HTTP REQUEST (req 0xc0002c2a00)
2025/05/05 16:43:24 DEBUG : HEAD /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4 HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: identity
Amz-Sdk-Invocation-Id: 7976e033-4fe7-4656-bf39-5a7191cf27ab
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T214324Z

2025/05/05 16:43:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:24 DEBUG : HTTP RESPONSE (req 0xc0002c2a00)
2025/05/05 16:43:24 DEBUG : HTTP/1.1 200 OK
Content-Length: 749531959
Accept-Ranges: bytes
Content-Type: video/mp4
Date: Mon, 05 May 2025 21:43:24 GMT
Etag: "dac02aab2eb54d783e5aeb7af08cf8a9-143"
Last-Modified: Wed, 31 Jul 2024 05:11:12 GMT
Server: WasabiS3/7.23.4333-2025-04-08-ca765aa880
X-Amz-Id-2: yHX7s54HBFUhwgbzrq80x+6kSUl7fIfhHGXvHsvwTwja6CTwdcDsA3DrWNzGTtmNH2HYlTvq5HyT
X-Amz-Meta-Md5chksum: rB/9d85U/KBmPoK1OTHatA==
X-Amz-Meta-Mtime: 1650332080
X-Amz-Request-Id: 5DA6254FE81CCF01:B
X-Wasabi-Cm-Reference-Id: 1746481404528 38.91.42.100 ConID:1250305830/EngineConID:12288978/Core:4

2025/05/05 16:43:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:24 DEBUG : fs cache: renaming child cache item "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4" to be canonical for parent "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08"
2025/05/05 16:43:24 DEBUG : Creating backend with remote "b2:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08"
2025/05/05 16:43:24 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2025/05/05 16:43:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:24 DEBUG : HTTP REQUEST (req 0xc000a26140)
2025/05/05 16:43:24 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/v1.69.1
Authorization: XXXX
Accept-Encoding: gzip

2025/05/05 16:43:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:24 DEBUG : HTTP RESPONSE (req 0xc000a26140)
2025/05/05 16:43:24 DEBUG : HTTP/1.1 200 
Content-Length: 1205
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=UTF-8
Date: Mon, 05 May 2025 21:43:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000

<snip to fit in post character limit>

2025/05/05 16:43:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:25 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2025/05/05 16:43:25 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Starting multi-thread copy with 8 chunks of size 96Mi with 4 parallel streams
2025/05/05 16:43:25 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 4/8 (301989888-402653184) size 96Mi starting
2025/05/05 16:43:25 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 1/8 (0-100663296) size 96Mi starting
2025/05/05 16:43:25 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 2/8 (100663296-201326592) size 96Mi starting
2025/05/05 16:43:25 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 3/8 (201326592-301989888) size 96Mi starting
2025/05/05 16:43:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:25 DEBUG : HTTP REQUEST (req 0xc000cac140)
2025/05/05 16:43:25 DEBUG : GET /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: gzip
Amz-Sdk-Invocation-Id: 3eed7866-e394-46e9-918e-e53ef8da93b5
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
Range: bytes=301989888-402653183
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T214325Z

2025/05/05 16:43:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:25 DEBUG : HTTP REQUEST (req 0xc000b42280)
2025/05/05 16:43:25 DEBUG : GET /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: gzip
Amz-Sdk-Invocation-Id: 1f0a148c-a2a0-4e75-981e-334d40eebf92
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
Range: bytes=100663296-201326591
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T214325Z

2025/05/05 16:43:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:25 DEBUG : HTTP REQUEST (req 0xc000d30280)
2025/05/05 16:43:25 DEBUG : GET /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: gzip
Amz-Sdk-Invocation-Id: f96328ff-a8e2-4ab2-a63d-8307e901c854
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
Range: bytes=0-100663295
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T214325Z

<snip to fit in post character limit>

2025/05/05 16:43:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Reopening on read failure after offset 85949822 bytes: retry 0/1: unexpected EOF
2025/05/05 16:43:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:28 DEBUG : HTTP REQUEST (req 0xc000614280)
2025/05/05 16:43:28 DEBUG : GET /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: gzip
Amz-Sdk-Invocation-Id: 5fe618c2-f6f4-4136-945d-627c1ea0a8e3
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
Range: bytes=387939710-402653183
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T214328Z

2025/05/05 16:43:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : HTTP RESPONSE (req 0xc000614280)
2025/05/05 16:43:28 DEBUG : Error: EOF
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : pacer: low level retry 1/2 (error operation error S3: GetObject, exceeded maximum number of attempts, 1, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "https://s3.us-central-1.wasabisys.com/bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject": EOF)
2025/05/05 16:43:28 DEBUG : pacer: Rate limited, increasing sleep to 10ms
2025/05/05 16:43:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:28 DEBUG : HTTP REQUEST (req 0xc000d30a00)
2025/05/05 16:43:28 DEBUG : GET /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: gzip
Amz-Sdk-Invocation-Id: 7676ecd7-5c85-4c74-9193-d8a6bdc2b622
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
Range: bytes=387939710-402653183
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T214328Z

2025/05/05 16:43:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : HTTP RESPONSE (req 0xc000d30a00)
2025/05/05 16:43:28 DEBUG : Error: EOF
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : pacer: low level retry 2/2 (error operation error S3: GetObject, exceeded maximum number of attempts, 1, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "https://s3.us-central-1.wasabisys.com/bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject": EOF)
2025/05/05 16:43:28 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : HTTP RESPONSE (req 0xc000d30dc0)
2025/05/05 16:43:28 DEBUG : Error: unexpected EOF
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 3 (retry=true): Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF: &url.Error{Op:"Post", URL:"https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043", Err:(*errors.errorString)(0x4016210)}
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Clearing part upload URL because of error: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : pacer: low level retry 1/1 (error Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF)
2025/05/05 16:43:28 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 3: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 4/8 failed: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 5/8 (402653184-503316480) size 96Mi starting
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : HTTP RESPONSE (req 0xc000d30500)
2025/05/05 16:43:28 DEBUG : Error: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Reopening on read failure after offset 68222333 bytes: retry 0/1: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 1 (retry=false): Post "https://pod-040-2022-09.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0034": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF: &url.Error{Op:"Post", URL:"https://pod-040-2022-09.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0034", Err:(*fmt.wrapError)(0xc00097d000)}
2025/05/05 16:43:28 DEBUG : pacer: Reducing sleep to 10ms
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 1: Post "https://pod-040-2022-09.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0034": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : HTTP RESPONSE (req 0xc000c423c0)
2025/05/05 16:43:28 DEBUG : Error: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 0 (retry=false): Post "https://pod-040-2022-02.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0031": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF: &url.Error{Op:"Post", URL:"https://pod-040-2022-02.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0031", Err:(*fmt.wrapError)(0xc00097d000)}
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 0: Post "https://pod-040-2022-02.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0031": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : pacer: Reducing sleep to 15ms
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 5/8 failed: multi-thread copy: failed to open source: operation error S3: GetObject, context canceled
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 1/8 failed: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-02.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0031": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 2/8 failed: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-09.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0034": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : pacer: Reducing sleep to 11.25ms
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : HTTP RESPONSE (req 0xc000b42000)
2025/05/05 16:43:28 DEBUG : Error: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 2 (retry=false): Post "https://pod-040-2022-03.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0015": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF: &url.Error{Op:"Post", URL:"https://pod-040-2022-03.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0015", Err:(*fmt.wrapError)(0xc00097d000)}
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Error sending chunk 2: Post "https://pod-040-2022-03.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0015": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: chunk 3/8 failed: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-03.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0015": multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: multi-thread copy: cancelling transfer on exit
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Cancelling large file upload
2025/05/05 16:43:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:28 DEBUG : HTTP REQUEST (req 0xc0002c2b40)
2025/05/05 16:43:28 DEBUG : POST /b2api/v1/b2_cancel_large_file HTTP/1.1
Host: api004.backblazeb2.com
User-Agent: rclone/v1.69.1
Content-Length: 112
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip

2025/05/05 16:43:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : HTTP RESPONSE (req 0xc0002c2b40)
2025/05/05 16:43:28 DEBUG : HTTP/1.1 200 
Content-Length: 312
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=UTF-8
Date: Mon, 05 May 2025 21:43:28 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000

2025/05/05 16:43:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 16:43:28 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Received error: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF - low level retry 0/1
2025/05/05 16:43:28 ERROR : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Failed to copy: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 ERROR : Attempt 1/1 failed with 1 errors and: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2025/05/05 16:43:28 INFO  : 
Transferred:   	  219.874 MiB / 219.874 MiB, 100%, 61.115 MiB/s, ETA 0s
Errors:                 1 (retrying may help)
Elapsed time:         3.8s

2025/05/05 16:43:28 DEBUG : 15 go routines active
2025/05/05 16:43:28 NOTICE: Failed to copy: multi-thread copy: failed to write chunk: Post "https://pod-040-2022-11.backblaze.com/b2api/v1/b2_upload_part/4_z4747728c736f471b90400f10_f208b2097d937bab8_d20250505_m214325_c004_v0402022_t0014_u01746481405019/0043": unexpected EOF
2

welcome to the forum,

very strange. that the same exact set of files fail every time?
are all those files with extension .mp4 or something else in common?

not sure it will matter, but might try --multi-thread-streams=0

3

yep, same files each time. and trying to copy them individually like this fails each time as well

most of the files are .mkv, a few are .mp4 and a few are .webp

yeah, same result.

4

to be clear, does the same exact file fail every time, or what?

for file c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4, what is you do it in two steps?

  1. download from wasabi to local
  2. upload from local to b2
5

I would assume so. since S3 and B2 are different protocols.

6

not sure what you mean, assume what?

7

I'm not manually doing both steps, but my understanding is that those 2 steps is how rclone copy handles copying across different protocol remotes (since it can't use server-side copying)

8

fwiw, b2 offers a s3 interface, which is what i use.

no, that is not the case.
the 2-step will download the entire file from wasabi to local, then upload the entire file from local to b2.
rclone uses local storage equal in size of the entire file.

whereas, the 1-step using rclone copy s3: b2:, as seen in the debug log uses chunks, copy: chunk 1/8

  1. read chunk x from wasabi
  2. write chunk x to b2
    rclone not using local storage.
9

ah ok. Is there a flag to have rclone do things the 2-step way automatically?

tried manually copying the file to my /tmp/, same issue. so it's definitely something to do with wasabi

log

2025/05/05 17:39:39 NOTICE: Automatically setting -vv as --dump is enabled
2025/05/05 17:39:39 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "copy" "--progress" "--verbose" "--log-file=rclone-debug.log" "--dump=headers" "--retries=1" "--low-level-retries=1" "--multi-thread-streams=0" "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4" "/tmp/"]
2025/05/05 17:39:39 DEBUG : Creating backend with remote "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4"
2025/05/05 17:39:39 DEBUG : Using config file from "/home/ryan/.config/rclone/rclone.conf"
2025/05/05 17:39:39 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2025/05/05 17:39:39 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2025/05/05 17:39:39 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 17:39:39 DEBUG : HTTP REQUEST (req 0xc00015edc0)
2025/05/05 17:39:39 DEBUG : HEAD /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4 HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: identity
Amz-Sdk-Invocation-Id: 1156e125-c83b-4c84-939d-9a43cdb14c36
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T223939Z

2025/05/05 17:39:39 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 17:39:39 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 17:39:39 DEBUG : HTTP RESPONSE (req 0xc00015edc0)
2025/05/05 17:39:39 DEBUG : HTTP/1.1 200 OK
Content-Length: 749531959
Accept-Ranges: bytes
Content-Type: video/mp4
Date: Mon, 05 May 2025 22:39:39 GMT
Etag: "dac02aab2eb54d783e5aeb7af08cf8a9-143"
Last-Modified: Wed, 31 Jul 2024 05:11:12 GMT
Server: WasabiS3/7.23.4333-2025-04-08-ca765aa880
X-Amz-Id-2: iphZk3yqxg33bbc+fyXiYEj6wOnjIO+MKz4B2B1TfkaaP4OhGRdlYc6cM5+eGNSp++tO32UeAx2f
X-Amz-Meta-Md5chksum: rB/9d85U/KBmPoK1OTHatA==
X-Amz-Meta-Mtime: 1650332080
X-Amz-Request-Id: FC98C02678494879:A
X-Wasabi-Cm-Reference-Id: 1746484779683 38.91.42.108 ConID:487104070/EngineConID:4679482/Core:66

2025/05/05 17:39:39 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 17:39:39 DEBUG : fs cache: renaming child cache item "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4" to be canonical for parent "wasabi-s3:bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08"
2025/05/05 17:39:39 DEBUG : Creating backend with remote "/tmp/"
2025/05/05 17:39:39 DEBUG : fs cache: renaming cache item "/tmp/" to be canonical "/tmp"
2025/05/05 17:39:39 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 17:39:39 DEBUG : HTTP REQUEST (req 0xc000ba8280)
2025/05/05 17:39:39 DEBUG : HEAD /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4 HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: identity
Amz-Sdk-Invocation-Id: 72fc121e-7ee0-475a-994b-f497edc21992
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T223939Z

2025/05/05 17:39:39 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 17:39:39 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 17:39:39 DEBUG : HTTP RESPONSE (req 0xc000ba8280)
2025/05/05 17:39:39 DEBUG : HTTP/1.1 200 OK
Content-Length: 749531959
Accept-Ranges: bytes
Content-Type: video/mp4
Date: Mon, 05 May 2025 22:39:39 GMT
Etag: "dac02aab2eb54d783e5aeb7af08cf8a9-143"
Last-Modified: Wed, 31 Jul 2024 05:11:12 GMT
Server: WasabiS3/7.23.4333-2025-04-08-ca765aa880
X-Amz-Id-2: ptXm8wzJJxkU3yn5siT0sNY6V5H8oEGw9Lp9AMkT/isL5O1IiOcV5hw+ZmR1Pxxzy3KejnfxW5yf
X-Amz-Meta-Md5chksum: rB/9d85U/KBmPoK1OTHatA==
X-Amz-Meta-Mtime: 1650332080
X-Amz-Request-Id: 598C0E939C2EC304:A
X-Wasabi-Cm-Reference-Id: 1746484779683 38.91.42.108 ConID:487104070/EngineConID:4679482/Core:66

2025/05/05 17:39:39 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 17:39:39 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Need to transfer - File not found at Destination
2025/05/05 17:39:39 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 17:39:39 DEBUG : HTTP REQUEST (req 0xc000c34280)
2025/05/05 17:39:39 DEBUG : GET /bucket.name/Media/Photos/upload/c7b2957c-bb62-45e3-b663-2368405fc875/c4/08/c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4?x-id=GetObject HTTP/1.1
Host: s3.us-central-1.wasabisys.com
User-Agent: rclone/v1.69.1
Accept-Encoding: gzip
Amz-Sdk-Invocation-Id: f3089691-dd39-47f2-afc1-622dd0ded527
Amz-Sdk-Request: attempt=1; max=1
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20250505T223939Z

2025/05/05 17:39:39 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/05/05 17:39:39 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 17:39:39 DEBUG : HTTP RESPONSE (req 0xc000c34280)
2025/05/05 17:39:39 DEBUG : HTTP/1.1 200 OK
Content-Length: 749531959
Accept-Ranges: bytes
Content-Type: video/mp4
Date: Mon, 05 May 2025 22:39:39 GMT
Etag: "dac02aab2eb54d783e5aeb7af08cf8a9-143"
Last-Modified: Wed, 31 Jul 2024 05:11:12 GMT
Server: WasabiS3/7.23.4333-2025-04-08-ca765aa880
X-Amz-Id-2: VX423jvLK1NOJypupYngX87iV59OS2XWg8jmo9/BzFM0A2QB+NrwDksoFsbuXNZ8e0zvTGK2d/w8
X-Amz-Meta-Md5chksum: rB/9d85U/KBmPoK1OTHatA==
X-Amz-Meta-Mtime: 1650332080
X-Amz-Request-Id: D8069B44E4981F29:B
X-Wasabi-Cm-Reference-Id: 1746484779683 38.91.42.108 ConID:487104070/EngineConID:4679482/Core:66

2025/05/05 17:39:39 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/05/05 17:39:51 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Reopening on read failure after offset 387939776 bytes: retry 1/1: unexpected EOF
2025/05/05 17:39:51 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Reopen failed after offset 387939776 bytes read: failed to reopen: too many retries
2025/05/05 17:39:51 NOTICE: c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4.4ef49810.partial: Removing partially written file on error: unexpected EOF
2025/05/05 17:39:51 DEBUG : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Received error: unexpected EOF - low level retry 0/1
2025/05/05 17:39:51 ERROR : c408fa39-8d7b-49ab-a7f3-4d6bd0118896.mp4: Failed to copy: unexpected EOF
2025/05/05 17:39:51 ERROR : Attempt 1/1 failed with 1 errors and: unexpected EOF
2025/05/05 17:39:51 INFO  : 
Transferred:   	  369.968 MiB / 369.968 MiB, 100%, 30.750 MiB/s, ETA 0s
Errors:                 1 (retrying may help)
Elapsed time:        12.1s

2025/05/05 17:39:51 DEBUG : 5 go routines active
2025/05/05 17:39:51 NOTICE: Failed to copy: unexpected EOF
10

I just went and tried to download these files using a presigned url, and they each failed there too. using the percentage it failed at as a marker I tried to view one of the video files that failed, and sure enough, playback hangs at roughly that % of the way through the file. so I guess these files are just bad somehow.

I had initially done a basic spot check by just opening the file and confirming that it started playing, but that obviously wasn't enough in this case!

either way, this isn't an rclone issue. thanks for your help debugging @asdffdsa !

11

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.