It is slow to upload to google drive

[kikimouse]

Hi,
I upload lots of files to google drive. But, the speed is quite slow. My board band’s uploading rate is 20 Mbps. I run rclone on raspberry pi. The command is as below.

rclone moveto /media/usb/backup gaccount:/backup --log-file /home/pi/rclone_gaccount.log --transfers=2 --drive-chunk-size 128M --fast-list

This is the log file.

2019/03/04 03:58:43 DEBUG : rclone: Version "v1.43.1" starting with parameters ["rclone" "moveto" "/media/usb/backup" "gaccount:/backup" "--log-file" "/home/pi/rclone_gaccount.log" "-vv"]
2019/03/04 03:58:43 DEBUG : Using config file from "/home/pi/.config/rclone/rclone.conf"
2019/03/04 03:58:48 INFO  : Google drive root 'backup': Waiting for checks to finish
2019/03/04 03:58:48 INFO  : Google drive root 'backup': Waiting for transfers to finish
2019/03/04 03:58:48 DEBUG : Document 01 2019/file1.2019.pdf: Sending chunk 0 length 8388608
2019/03/04 03:58:48 DEBUG : Document 02 2019/file2.2019.pdf: Sending chunk 0 length 8388608
2019/03/04 03:58:48 DEBUG : Document 03 2019/file3.2019.pdf: Sending chunk 0 length 8388608
2019/03/04 03:58:48 DEBUG : Document 04 2019/file4.2019.pdf: Sending chunk 0 length 8388608
2019/03/04 03:59:45 INFO  : 
Transferred:   	    1.660M / 40.211 GBytes, 0%, 27.566 kBytes/s, ETA 424h50m57s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            0 / 1410, 0%
Elapsed time:      1m1.6s
Transferring:
 *   ... 2019/file1.2019.pdf:  0% /115.742M, 4.850k/s, 6h46m16s
 *   ... 2019/file2.2019.pdf:  0% /93.278M, 4.735k/s, 5h35m0s
 *   ... 2019/file3.2019.pdf:  1% /34.650M, 7.947k/s, 1h13m8s
 *   ... 2019/file4.2019.pdf:  0% /58.716M, 9.200k/s, 1h48m1s

2019/03/04 04:00:45 INFO  : 
Transferred:   	    2.820M / 40.211 GBytes, 0%, 23.736 kBytes/s, ETA 493h23m24s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            0 / 1410, 0%
Elapsed time:      2m1.6s
Transferring:
 *   ... 2019/file1.2019.pdf:  0% /115.742M, 2.480k/s, 13h12m50s
 *   ... 2019/file2.2019.pdf:  0% /93.278M, 4.154k/s, 6h20m40s
 *   ... 2019/file3.2019.pdf:  2% /34.650M, 5.405k/s, 1h46m41s
 *   ... 2019/file4.2019.pdf:  1% /58.716M, 7.792k/s, 2h6m38s

I had seen many people having the similar issue on slow speed to upload files to google drive.

I have changed the client id. But, the speed is still slow.

Each of file is around 10MB to 100MB in every directory. The total size is about 40GB.

Are there any methods to increase the speed?

[Animosity022]

Are you using your own client ID/API key?

https://rclone.org/drive/#making-your-own-client-id

You are using a very old version and you should grab the stable 1.46

drive-chunk-size should be 32M .as that seems to be a sweet spot . I personally use 32M.

You’d want to limit the checkers and transfers to keep something that add up to around 10 at most as Google’s limit in 10 per second. You can start with 5/5 or 4/4.

I do something like as I run a mount as well:

/usr/bin/rclone move /data/local/ gcrypt: -P --checkers 3 --log-file /opt/rclone/logs/upload.log -v --tpslimit 3 --transfers 3 --drive-chunk-size 32M --exclude-from /opt/rclone/scripts/excludes --delete-empty-src-dirs

And my final output from my upload:

Transferred:   	   16.471G / 16.471 GBytes, 100%, 80.226 MBytes/s, ETA 0s
Errors:                 0
Checks:                 9 / 9, 100%
Transferred:            9 / 9, 100%
Elapsed time:     3m30.2s