Speed & Performance under Windows

Help and Support
1

What is the problem you are having with rclone?

speed. general stuff.

Run the command 'rclone version' and share the full output of the command.

rclone v1.63.1

  • os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
  • os/kernel: 10.0.19045.3208 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.20.6
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Dropbox

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone mount CRYPT: /RCTEMP --vvP --vfs-cache-mode full --vfs-cache-max-size 100G --vfs-cache-poll-interval 5m --vfs-read-ahead 2G --dropbox-batch-mode sync --transfers 64 --dropbox-chunk-size 128M --buffer-size 128M --tpslimit 12 --tpslimit-burst 16

The rclone config contents with secrets removed.

[RCC]
type = dropbox
client_id = REMOVED
client_secret = REMOVED
token = {"access_token":"sl.Bj5BeKEyJcsbr1xxiX6eF2mvVa_W-duox5Nm6FARhXI9aT9nwBS4fhLOjpxc_G7LGosysMJp_ml-azS5pKULt1LT010ZLGiHCIqySjPf9wQdgSX4HtUMpP7e3XUhDLvF2v4eL8aYl-jP_Kc","token_type":"bearer","refresh_token":"hUb_hl-xkDcAAAAAAAAAATbt9bTVMcJW4p-vnroN8bsfQ4RnC5rcrA2eOQNDxLOC","expiry":"2023-08-11T02:28:08.5315698+02:00"}

[CRYPT]
type = crypt
remote = RCC:Rob LB/RCC/CRYPT
password = REMOVED
password2 = REMOVED

A log from the command with the -vv flag

Paste  log here

windows 10 user.

using --vvP I didnt get that summary in the end that I've seen in many other posts, where it says how fast the transfer speed was and such. how do I get that?

still looking at the log output in the command window, there's a few things that I'm unsure about. like why did it use 81 chunks?

anyway, as you've probably guessed, new to rclone. and not really a fan of cli. but if that's what it takes, so be it.

what I want is, to transfer my massive amount of data from the dheads over at google to dropbox. and for that I most likely will use rclone and an intermediary anyway. but thinking about it, I figured maybe decrypt my current data and re-encrypt it using rclone crypt.

since I'm actually quite happy with my current encryption - gocryptfs - I want to see if rclone covers my needs at least as well.

gocryptfs lets me easily mount the cloud remote. I can then drag n drop away, everything is very smooth and fast (assuming loads of local caching) and always up to date without having to hit refresh or anything. just like all the data would be if it was on a local drive. also, even large folders and deep nested stuff lists smoothly.

I was able to mount rclone remote in a local folder but not on a drive letter (refused to use Z saying invalid mount point, which it is not but whatever) but for test purposes I dont care about that right now.

I used the above command because just a bare one without all the flags made it freak out while testing a 10GB file. the used command is basically cobbled together from other users posts in this forum, I really dont know what it does exactly. why isnt there just a template for e.g. Dropbox. like: use that, it works.

anyhow, I digress. I would appreciate hints and tips on how to construct the command so I get max performance and by that I mean mostly upload speed/performance. the google drive client does concurrent uploads and maxes my gigabit internet at around 108MB/s. something like that would be nice.

thanks

2

Do not use random flags - as results will be random too:)

If not sure use defaults e.g. for Dropbox this is good general start:

rclone mount CRYPT: /RCTEMP --vvP --vfs-cache-mode full --vfs-cache-max-size 100G --tpslimit 12 --tpslimit-burst 0

Here you are example of a bit more complex mount with comments:

You can customise it to your needs - all mount flags details are in documentation.

Because people have different workloads and requirements. There is no one fit all solution.

IMO do not use mount for it. Transfer your data using rclone copy/move/sync

3

I wont. just using mount to test some things. and speed test. thanks for the above! I'll try the basic dropbox command and see where it leads.

4

I tried this for a copy operation to the rclone crypt on dropbox

Transferred:        1.896 GiB / 1.896 GiB, 100%, 4.504 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:       3m2.8s

using the dropbox windows client or a gocrypt mount I get the same file done in around 30 seconds. so around 70MB/s. still far off from the 100+ I get with google drive but I can live with 70MB/s.

what am I doing wrong with rclone?

5

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.