Low speed in Opendrive (chunks)

Help and Support
1

What is the problem you are having with rclone?

First of all, hello everybody. It is the first time that I post. I am new in the forum.

During the last 5 months ago, I have noted a significant decrease in the upload speed when I try to upload my files using rclone to Opendrive(Ubuntu).

Before March, I uploaded my files in 7-8 hours, but now, the same files expend more than 2 days to be uploaded.

I have checked the speed with the server Phoenix, AZ and my upload speed is 43.51 Mbps.

I know that the speed of opendrive is limited but I think that something is wrong because it is so slow.

When I check the rclone command output, I have noted that it splits the file in chunks, and it expends a lot of time when finishes the first chunk and uploads the next chunk.

Thanks and best regards!

What is your rclone version (output from rclone version)

v1.52.3-307-g29d6358f-beta

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Ubuntu 18.04.3 LTS (GNU/Linux 5.4.0-42-generic x86_64)

Which cloud storage system are you using? (eg Google Drive)

Opendrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone --transfers=8 --checkers=4 --opendrive-chunk-size=16384k  -P copy /path/to/folder Name_server:path/to/folder

The rclone config contents with secrets removed.

[Name_server]
type = opendrive
username = XXXXX
password = XXXXX

A log from the command with the -vv flag

2020/08/26 08:58:01 DEBUG : rclone: Version "v1.52.3-307-g29d6358f-beta" starting with parameters ["rclone" "--transfers=8" "--checkers=4" "--opendrive-chunk-size=16384k" "-P" "copy" "test.7z" "Name_server:Documents" "-vv"]
2020/08/26 08:58:01 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2020/08/26 08:58:01 DEBUG : fs cache: adding new entry for parent of "test.7z", "/path/to/folder"
2020/08/26 08:58:02 DEBUG : Starting OpenDrive session with ID: XXXXXXX
2020-08-26 08:58:03 DEBUG : test.7z: Need to transfer - File not found at Destination
2020-08-26 08:58:06 DEBUG : test.7z: Uploading chunk 0, size=16777216, remain=108724737
Transferred:           16M / 119.688 MBytes, 13%, 848.665 kBytes/s, ETA 2m5s
Transferred:            0 / 1, 0%
Elapsed time:        21.4s
Transferring:
 *                                       test.7z: 13% /119.688M, 843.721k/s, 2m5s
2

Rclone has to wait for OpenDrive to process the chunk. If you make the chunks larger there processing takes longer so it doesn't really help.

You could try uploading a test file from somewhere else to see if it is to do with your internet connection.

3

Thanks for your answer.

I know that opendrive is slow but I don't know why now the speed is so slow (the time to process a chunk is high) meanwhile a few months ago, I didn't have this problem. My internet connection is good.

Apart of reduce the chunk size, is there any other way to increase the speed?

5

In my case, if I increase the size of the chunk, more time it expends to process the chunk. The chunk is uploaded faster but it takes a lot of time to upload the next chunk.

I am using rclone to upload files in opendrive. I don't know if for other servers it is work correctly.

6

Ouch. I read the title as OneDrive, kindly ignore.

7

I think is is probably the open drive servers being busier.

You can upload more files at once with --transfers quick helps with overall throughput.

You could also try at a different time of day.

8

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.