Single file upload is not using entire upload speed

Help and Support
1

hello everyone,

i started to use rclone a few days ago. everything except this issue goes well.

What is the problem you are having with rclone?

my upload speed is bad nowadays but it's 20mbit/s normally. when i upload a single file, it shows that i'm uploading with 900kbit/s. but if i upload multiple files, it uses my entire upload speed capacity. like; file1>900kbit/s, file2>800kbit/s, file3>300kbit/s

i forgot to take screenshots when my upload speed is normal, but i swear it's what i describe. i tried to get same output though.

i can't embed or links more than one because i'm a new user. so i uploaded to imgur so you can see as album.

[Album] imgur.com

i found a thread same as my issue but it's locked, i can't post reply.
https://forum.rclone.org/t/rclone-copy-upload-single-file-at-full-speed

Run the command 'rclone version' and share the full output of the command.

C:\Windows\system32>rclone --version
rclone v1.68.1

  • os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
  • os/kernel: 10.0.19045.4046 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.23.1
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

hetzner storage box, smb, crypt configured.

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy c:\users\emre\desktop\tightrope.ova emre_enc:/testarea2/ -P

[emre_enc]
type = crypt
remote = hetzner:/backup/emre_enc
filename_encryption = off
directory_name_encryption = false
password = XXX
password2 = XXX

[hetzner]
type = smb
host = XXX
user = XXX
pass = XXX
### Double check the config for sensitive info before posting publicly

log doesn't show a thing related to my issue.
2

It is normal for high latency links (like Internet) and protocol like SMB which is designed for local network.

Try different protocols. Ideally something like S3 which supports multipart transfers.

3

welcome to the forum,

as a windows user, i never use rclone to access smb.
i use windows os native tools, might get better performance and bonus, checksum verification of file transfers.

check out my howto guide https://forum.rclone.org/t/how-to-access-smb-samba-with-rclone/42754

imho, accessing smb direct over the internet is not safe.
smb was not designed to be used over slow, high latency networks such as the internet.
so i would test webdav or maybe sftp

4

thank you @kapitainsky and @asdffdsa, i've enabled ssh/sftp on storagebox and i'm getting full speed of download and upload. this thread can be closed.

1 Like
5

great

there are some best practices using sftp on hetzner storagebox?
can you post the output of rclone config redacted for the new remote?

6

sure!

here is hetzner's guide:
https://docs.hetzner.com/storage/storage-box/access/access-ssh-rsync-borg

my config with crypt:

[emre_enc]
type = crypt
remote = hetzner:emre_enc
filename_encryption = off
directory_name_encryption = false
password = XXX
password2 = XXX

[hetzner]
type = sftp
host = XXX
user = XXX
port = 23
pass = XXX
shell_type = unix
md5sum_command = md5 -r
sha1sum_command = sha1 -r
### Double check the config for sensitive info before posting publicly
7

the problem of the guide with rclone is using password instead of key file
this is my remote:

[sbox01_sftp]
type = sftp
host = XXX
port = 23
user = XXX
key_file = c:\data\c\combined\hetzner\sbox01\keys\id_ed25519
shell_type = unix
md5sum_command = md5 -r
sha1sum_command = sha1 -r
8

i really don't know because i'm login it with password, not key. but i got the idea, if i figure it out i will ping you.

9

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.