Hi,
I’m using v1.44 and I see big differences in the upload speed with web browser or with Rclone. For example, a 500mb file needs 1 minute to be uploaded in Drive using Chromium or Firefox and 8m55 to be uploaded using Rclone. This using same computer, same connection and the same file. I notice this in all my remotes.
Looks strange to me
Sure, but can you share some details? How are you testing?
Yes, I’m using Windows 7 and I tried uploading the same file first with Rclone and again with Chromium and Firefox, using web interface. I tested Google Drive, Onedrive and Mega. Here is the log from Drive:
2018/11/04 21:26:46 DEBUG : rclone: Version “v1.44” starting with parameters [“rclone” “copy” “C:\Users\Win7\Downloads\file.exe” “gdrive2:” “-P” “-vv” “–log-file=loguploadgoogle.txt”]
2018/11/04 21:26:46 DEBUG : Using config file from “C:\Users\Win7\.config\rclone\rclone.conf”
2018/11/04 21:26:46 DEBUG : file.exe: Couldn’t find file - need to transfer
2018/11/04 21:26:47 DEBUG : file.exe: Sending chunk 0 length 8388608
2018/11/04 21:26:55 DEBUG : file.exe: Sending chunk 8388608 length 8388608
2018/11/04 21:27:03 DEBUG : file.exe: Sending chunk 16777216 length 8388608
2018/11/04 21:27:11 DEBUG : file.exe: Sending chunk 25165824 length 8388608
2018/11/04 21:27:19 DEBUG : file.exe: Sending chunk 33554432 length 8388608
2018/11/04 21:27:28 DEBUG : file.exe: Sending chunk 41943040 length 8388608
2018/11/04 21:27:36 DEBUG : file.exe: Sending chunk 50331648 length 8388608
2018/11/04 21:27:44 DEBUG : file.exe: Sending chunk 58720256 length 8388608
2018/11/04 21:27:52 DEBUG : file.exe: Sending chunk 67108864 length 8388608
2018/11/04 21:28:01 DEBUG : file.exe: Sending chunk 75497472 length 8388608
2018/11/04 21:28:09 DEBUG : file.exe: Sending chunk 83886080 length 8388608
2018/11/04 21:28:17 DEBUG : file.exe: Sending chunk 92274688 length 8388608
2018/11/04 21:28:25 DEBUG : file.exe: Sending chunk 100663296 length 8388608
2018/11/04 21:28:33 DEBUG : file.exe: Sending chunk 109051904 length 8388608
2018/11/04 21:28:42 DEBUG : file.exe: Sending chunk 117440512 length 8388608
2018/11/04 21:28:50 DEBUG : file.exe: Sending chunk 125829120 length 8388608
2018/11/04 21:28:58 DEBUG : file.exe: Sending chunk 134217728 length 8388608
2018/11/04 21:29:06 DEBUG : file.exe: Sending chunk 142606336 length 8388608
2018/11/04 21:29:15 DEBUG : file.exe: Sending chunk 150994944 length 8388608
2018/11/04 21:29:23 DEBUG : file.exe: Sending chunk 159383552 length 8388608
2018/11/04 21:29:31 DEBUG : file.exe: Sending chunk 167772160 length 8388608
2018/11/04 21:29:39 DEBUG : file.exe: Sending chunk 176160768 length 8388608
2018/11/04 21:29:47 DEBUG : file.exe: Sending chunk 184549376 length 8388608
2018/11/04 21:29:56 DEBUG : file.exe: Sending chunk 192937984 length 8388608
2018/11/04 21:30:04 DEBUG : file.exe: Sending chunk 201326592 length 8388608
2018/11/04 21:30:12 DEBUG : file.exe: Sending chunk 209715200 length 8388608
2018/11/04 21:30:20 DEBUG : file.exe: Sending chunk 218103808 length 8388608
2018/11/04 21:30:29 DEBUG : file.exe: Sending chunk 226492416 length 8388608
2018/11/04 21:30:37 DEBUG : file.exe: Sending chunk 234881024 length 8388608
2018/11/04 21:30:45 DEBUG : file.exe: Sending chunk 243269632 length 8388608
2018/11/04 21:30:53 DEBUG : file.exe: Sending chunk 251658240 length 8388608
2018/11/04 21:31:01 DEBUG : file.exe: Sending chunk 260046848 length 8388608
2018/11/04 21:31:10 DEBUG : file.exe: Sending chunk 268435456 length 8388608
2018/11/04 21:31:18 DEBUG : file.exe: Sending chunk 276824064 length 8388608
2018/11/04 21:31:26 DEBUG : file.exe: Sending chunk 285212672 length 8388608
2018/11/04 21:31:34 DEBUG : file.exe: Sending chunk 293601280 length 8388608
2018/11/04 21:31:42 DEBUG : file.exe: Sending chunk 301989888 length 8388608
2018/11/04 21:31:50 DEBUG : file.exe: Sending chunk 310378496 length 8388608
2018/11/04 21:31:59 DEBUG : file.exe: Sending chunk 318767104 length 8388608
2018/11/04 21:32:07 DEBUG : file.exe: Sending chunk 327155712 length 8388608
2018/11/04 21:32:15 DEBUG : file.exe: Sending chunk 335544320 length 8388608
2018/11/04 21:32:23 DEBUG : file.exe: Sending chunk 343932928 length 8388608
2018/11/04 21:32:31 DEBUG : file.exe: Sending chunk 352321536 length 8388608
2018/11/04 21:32:40 DEBUG : file.exe: Sending chunk 360710144 length 8388608
2018/11/04 21:32:48 DEBUG : file.exe: Sending chunk 369098752 length 8388608
2018/11/04 21:32:56 DEBUG : file.exe: Sending chunk 377487360 length 8388608
2018/11/04 21:33:04 DEBUG : file.exe: Sending chunk 385875968 length 8388608
2018/11/04 21:33:12 DEBUG : file.exe: Sending chunk 394264576 length 8388608
2018/11/04 21:33:21 DEBUG : file.exe: Sending chunk 402653184 length 8388608
2018/11/04 21:33:29 DEBUG : file.exe: Sending chunk 411041792 length 8388608
2018/11/04 21:33:37 DEBUG : file.exe: Sending chunk 419430400 length 8388608
2018/11/04 21:33:45 DEBUG : file.exe: Sending chunk 427819008 length 8388608
2018/11/04 21:33:53 DEBUG : file.exe: Sending chunk 436207616 length 8388608
2018/11/04 21:34:02 DEBUG : file.exe: Sending chunk 444596224 length 8388608
2018/11/04 21:34:10 DEBUG : file.exe: Sending chunk 452984832 length 8388608
2018/11/04 21:34:18 DEBUG : file.exe: Sending chunk 461373440 length 8388608
2018/11/04 21:34:26 DEBUG : file.exe: Sending chunk 469762048 length 8388608
2018/11/04 21:34:34 DEBUG : file.exe: Sending chunk 478150656 length 8388608
2018/11/04 21:34:43 DEBUG : file.exe: Sending chunk 486539264 length 8388608
2018/11/04 21:34:51 DEBUG : file.exe: Sending chunk 494927872 length 8388608
2018/11/04 21:34:59 DEBUG : file.exe: Sending chunk 503316480 length 8388608
2018/11/04 21:35:07 DEBUG : file.exe: Sending chunk 511705088 length 8388608
2018/11/04 21:35:15 DEBUG : file.exe: Sending chunk 520093696 length 8388608
2018/11/04 21:35:24 DEBUG : file.exe: Sending chunk 528482304 length 8388608
2018/11/04 21:35:32 DEBUG : file.exe: Sending chunk 536870912 length 8286880
2018/11/04 21:35:41 INFO : file.exe: Copied (new)
2018/11/04 21:35:41 INFO :
Transferred: 519.903M / 519.903 MBytes, 100%, 994.648 kBytes/s, ETA 0s
Errors: 0
Checks: 0 / 0, -
Transferred: 1 / 1, 100%
Elapsed time: 8m55.2s
2018/11/04 21:35:41 DEBUG : 4 go routines active
2018/11/04 21:35:41 DEBUG : rclone: Version “v1.44” finishing with parameters [“rclone” “copy” “C:\Users\Win7\Downloads\file.exe” “gdrive2:” “-P” “-vv” “–log-file=loguploadgoogle.txt”]
Hi,
try increasing the chunk size:
For Google Drive: Start with 16M, then 32M etc. until you hit your sweet spot.
–drive-chunk-size SizeSuffix Upload chunk size. Must a power of 2 >= 256k. (default 8M)
For OneDrive:
–onedrive-chunk-size SizeSuffix Chunk size to upload files with - must be multiple of 320k. (default 10M)
Couldn’t find it for MEGA.
Have a nice day!
I’ve been struggling with this for a week or so trying different settings. Web upload is fast. Rclone copy local gdrive: is maxing out at certain speeds depending on which computer I’m on.
Work machine: ~750 kB/s
Home “server” rig: ~350 kB/s
Home “gaming” rig: 1.5 mB/s
Almost feels like it’s a CPU/RAM thing going on, but I’m pretty much in the dark when it comes to rclone. Otherwise, it’s really sweet software!! Download speeds are desirable and I have no complaints there.
EDIT: Windows 7 on all three systems, even the “server”
EDIT: Web upload to Google Drive using Chrome is 5 mB/s
Just did some more testing. On a VM running Server 2012 it’s reaching 9 mB/s which is more along the lines of what I’m looking for!
Something going on with Windows 7 / 10?
Tried this in both Drive and Onedrive but I get the same low speed in upload 
What’s your rclone.conf for that?
I did a bit more testing using other systems. It seems like Windows 7 seems to be the culprit for my environment. My Win10 (or Server) machines saturate my upload. If I find something, I’ll let you know since.
EDIT: Did another quick test. I ran a quick Ubuntu 18 LTS VM on my Work Machine (Windows 7) and the speeds were great under a NAT network adapter.
I did a quick test uploading from my Windows 7 VM to Google Drive and I got 17MB/s upload which I thought was pretty good!
Are there different fuse options on Windows that could be impacting the performance?
I hate to take over the OP since I thought it was a similar issue. I’ve got a clean Windows 7 VM I can spin up for testing on my network as well. If it works there, I bet it’s some weird issue with other software or settings that I do in my fresh-OS routine.
If I find it, I’ll post back here, otherwise, I’ll just make the jump to Windows 10 of what systems I have left on it.
I did try mounting it on my work computer but that resulted in the same speeds.
For the most part, I’m just using CLI to rule out any 3rd party stuff.