Rclone Commands

Help and Support
1

What is the problem you are having with rclone?

My upload speed is really slow (not an rclone problem)

What is your rclone version (output from rclone version)

v1.50.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows Server 2016

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync --progress "D:\1 - Plex\Movies" gdrive:backup\Movies

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

no log

The Problem im having is slow upload speed i have done everything i need to do with client id's and such to make it as quick as possible. So the question:

What command can i use to upload 5 or 6 movies at once? i cant get the string to work and im not sure what im missing.

2

--transfers=6 is probably what you’re looking for.

3

and you are a legend, thank you sir that is working. I have it planned to go to a buddies house to finish the upload eventually.... Hes got gig down and up.....

4

Actually that didnt work still grabbing all files in the folder.

rclone sync --progress --transfers 4 "D:\1 - Plex\Movies" gdrive:backup\Movies

5

Add --transfers 6 to transfer 6 things at once.

One thing which speeds drive uploads for big files at the expense of memory is --drive-chunk-size 128M

6

anyway to choose a set of 5 items to upload and then stop?

7

If you have a fixed set of items to upload then --files-from is the way to go

8

If you want to optimize upload speed then there is no better tweak than --drive-chunk-size 64M (or even 128M as NCW said). rclone can't make a slow connection fast, but this will make the best possible use of it at least.

There is not much point to using more than 4-5 transfers on Gdrive. You will run into a backend limit on how fast you can open new files on small files anyway, and on large files it should not matter. Gdrive has plenty of bandwidth - that is not an issue, trust me.

1 Like
9

How does that command work? --files-from what is the syntax that i put in.

10

--files-from MyFileList.txt
https://rclone.org/filtering/#files-from-read-list-of-source-file-names

MyFileList.txt will be a normal .txt file that just has a list of files in it for rclone to transfer.
It may look something like this:

ISOs/ubuntu-19.04-desktop-amd64.iso
TESTING/TESTFILES/e2hj4jfo9dfev5i5a035bt59dc
TESTING/TESTFILES/extensionstest/
TESTING/TESTFILES/1KPHOTOS_2/
TESTING/TESTFILES/extensionfails/
TESTING/TESTFILES/1KPHOTOS/
TESTING/TESTFILES/PHOTOFILES/
TESTING/TESTFILES/1KFILES/
TESTING/TESTFILES/Stigmatest/
TESTING/TESTFILES/SMALLFILES/

Rclone can generate these files for you with one of many listing commands, like rclone lsf
For example, listing a directory to a file we can use later in files-from:
rclone lsf -R MyRemote:\mystuff\importantfiles > filelist.txt
(this is windows syntax for reference).
https://rclone.org/commands/rclone_ls/
https://rclone.org/commands/rclone_lsf/

Then of course you can use all the other filtering tools to help create exactly the list you want.
You can get pretty spesific with that... but it is far too much to cover all filtering options here. Go read the docs for info on what is possible:
https://rclone.org/filtering/

11

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.