"write: result too large" Error

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.

What is the problem you are having with rclone?

In the last few days, I have problems with the error "write: result too large" when trying to upload files to OpenDrive.
Before mid last week, this problem never happened and it started happening in the old Version 1.64.0 and continued when I updated to the latest version.
The problem doesn't occur always, and sometimes correct itself in subsequent retries (sometimes in 1, sometimes in more, sometimes never).
The problem happens more often the bigger (from 100 MB upwards) the files gets, but also happens for smaller (5/6 MB) files (but for them only once every hundred files, but then corrects itself mostly always in the retry ).
The number of retries also depends on the file size (the bigger, the more retries are needed).
The problem occurs with OpenDrive (with files encrypted with Rclone as well as for unencrypted files). I tried it today with a free jottacloud account and the same problem occurred there.
In the example below, the error occurred during the upload of the 6th junk of the file, but it differs for each run, at what point the error occurs, even when retrying the same file.

Run the command 'rclone version' and share the full output of the command.

rclone v1.66.0
- os/version: darwin 12.6 (64 bit)
- os/kernel: 21.6.0 (x86_64)
- os/type: darwin
- os/arch: amd64
- go/version: go1.22.1
- go/linking: dynamic
- go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

OpenDrive and jottacloud

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy "/Volumes/Daten/z-Test/Test-File.mp4" "OpenDrive-Archives:/Z-Test" -P -vv

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[OpenDrive]
type = opendrive
password = XXX
username = XXX

[OpenDrive-Archives]
type = crypt
password2 = XXX
remote = OpenDrive:Archives
password = XXX

A log from the command that you were trying to run with the -vv flag

2024/03/15 21:55:34 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "copy" "/Volumes/Daten/z-Test/Test-File.mp4" "OpenDrive-Archives:/Z-Test" "-P" "-vv"]
2024/03/15 21:55:34 DEBUG : Creating backend with remote "/Volumes/Daten/z-Test/Test-File.mp4"
2024/03/15 21:55:34 DEBUG : Using config file from "/Users/*********/.config/rclone/rclone.conf"
2024/03/15 21:55:34 DEBUG : fs cache: adding new entry for parent of "/Volumes/Daten/z-Test/Test-File.mp4", "/Volumes/Daten/z-Test"
2024/03/15 21:55:34 DEBUG : Creating backend with remote "OpenDrive-Archives:/Z-Test"
2024/03/15 21:55:34 DEBUG : Creating backend with remote "OpenDrive:Archives/fs95mp01ccf7vdf0ouvkoit8js"
2024/03/15 21:55:35 DEBUG : Starting OpenDrive session with ID: 1d7af8db2f41b326710bebbdaea6bfad605cfd94998edf8e83de57e073bd1d39
2024/03/15 21:55:36 DEBUG : Test-File.mp4: Need to transfer - File not found at Destination
2024/03/15 21:55:37 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 0, size=10485760, remain=3621424865
2024/03/15 21:56:24 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 1, size=10485760, remain=3610939105
2024/03/15 21:57:10 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 2, size=10485760, remain=3600453345
2024/03/15 21:57:57 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 3, size=10485760, remain=3589967585
2024/03/15 21:58:43 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 4, size=10485760, remain=3579481825
2024/03/15 21:59:30 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 5, size=10485760, remain=3568996065
2024/03/15 22:00:17 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 6, size=10485760, remain=3558510305
2024/03/15 22:00:19 ERROR : Test-File.mp4: Failed to copy: failed to create file: Post "https://dev.opendrive.com/api/v1/upload/upload_file_chunk.json": write tcp 192.0.0.1:53769->184.105.177.79:443: write: result too large
2024/03/15 22:00:19 ERROR : Attempt 1/3 failed with 1 errors and: failed to create file: Post "https://dev.opendrive.com/api/v1/upload/upload_file_chunk.json": write tcp 192.0.0.1:53769->184.105.177.79:443: write: result too large
2024/03/15 22:00:20 DEBUG : Test-File.mp4: Need to transfer - File not found at Destination
2024/03/15 22:00:21 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 0, size=10485760, remain=3621424865
2024/03/15 22:01:08 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 1, size=10485760, remain=3610939105
2024/03/15 22:01:55 DEBUG : agbq9av7cjvtqufm9farl07nvo: Uploading chunk 2, size=10485760, remain=3600453345
Transferred:   	   96.454 MiB / 3.447 GiB, 3%, 383.404 KiB/s, ETA 2h32m48s
Transferred:            0 / 1, 0%
Elapsed time:       7m1.3s
Transferring:
 *                                 Test-File.mp4:  0% /3.382Gi, 55.387Ki/s, 17h37m45s

I terminated the command at this point
********* is my redacted Username

welcome to the forum,

i searched the forum, for write: result too large, could not find a single post.

very strange, that your setup gets the same error for two different providers.
opendrive and jottacloud.
do both providers use the same software?

for a deeper look, might try --dump=headers --retries=1

This error is ERANGE and is being returned from the kernel. It looks like it is being returned directly from a TCP write which is odd.

This would tend to indicate a bug in the Go standard library, or the kernel or something in between. There are no hits for reported bugs in either though.

Are you using any local firewall software that might inspect TCP streams? Or something unusual in your networking stack? That is the only other thing that might cause this that comes to mind.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.