Rclone copy Google drive to Onedrive

What is the problem you are having with rclone?

rclone copy. uploading and downloading speed is limited to avg 50kb/s.

Run the command 'rclone version' and share the full output of the command.

rclone v1.61.1

  • os/version: Microsoft Windows 10 Home Single Language 22H2 (64 bit)
  • os/kernel: 10.0.19045.2546 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.19.4
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Copy source: Google drive
Dest source: Onedrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

C:\Users\parma\Downloads\Telegram Desktop\rclone-v1.58.1-windows-amd64>rclone copy Heaven:/Watch/TVShows/Willow.S01.2160p.DSNP.WEB-DL.x265.10bit.HDR.DDP5.1.Atmos-NTb[rartv] Onedrive:/Watch/TVShows -P

The rclone config contents with secrets removed.

C:\Users\parma\Downloads\Telegram Desktop\rclone-v1.58.1-windows-amd64>rclone config
Current remotes:

Name                 Type
====                 ====
Heaven               drive
Onedrive             onedrive

e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q>

Screenshot

What's your computers internet speed? (Both download and upload)

Moving from Google Drive to OneDrive will force the file to be downloaded and uploaded.

Do you get better speeds if you download the file first and then upload it?

60mbps (speedtest.net)

When i downloaded the file from google drive the speed was normal 6mbps(/8), but when i use rclone sync src to onedrive the uploading speed was very low 5kbps. then i checked my upload speed and it was normal 40mbps (speedtest.net).

note: i have my own clientid and secret for both drives.

Do you know that speedtest.net will test connection to your local nearest server for the best result. And do you think OneDrive servers are the same location as yours? No, it's not. Try uploading a file on your computer to onedrive using rclone to see your actual upload speed.

I want to upload files from my local computer by rclone, but due to low speed in rclone, I did check upload speed on speedtest to check whether the speed low or high, i checked upload speed on fast also.

If you have not great internet / bad peering to a service, it's going to be slow speeds.

You might want to use a VPS or something if you aren't keeping anything local with better bandwidth.

If you want to see more, do the things listed in the template.

Update the version to the latest stable.

Run your command with -vv and share the full debug log output as we can see what's going on.

1 Like

Also, some routers have awful QoS and will "choke" your internet while trying to upload.

Best troubleshooting would be to first download to local storage and check speed, then upload and check speed, then try to do a move using bw-limit flag to see if it helps overall performance.

Like multiple people mentioned, it could be routing issues from your ISP over to Google or Microsoft Servers, and all those steps will give a better picture on where is the bottleneck happening.

WHOLE LOG

C:\Users\parma\Downloads\Telegram Desktop\rclone-v1.58.1-windows-amd64>rclone copy Heaven:\Watch\Movies Onedrive:\Watch\Movies -P -vv
2023/02/06 10:23:48 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "copy" "Heaven:\\Watch\\Movies" "Onedrive:\\Watch\\Movies" "-P" "-vv"]
2023/02/06 10:23:48 DEBUG : Creating backend with remote "Heaven:\\Watch\\Movies"
2023/02/06 10:23:48 DEBUG : Using config file from "C:\\Users\\parma\\AppData\\Roaming\\rclone\\rclone.conf"
2023/02/06 10:23:49 DEBUG : fs cache: renaming cache item "Heaven:\\Watch\\Movies" to be canonical "Heaven:Watch/Movies"
2023/02/06 10:23:49 DEBUG : Creating backend with remote "Onedrive:\\Watch\\Movies"
2023/02/06 10:23:52 DEBUG : fs cache: renaming cache item "Onedrive:\\Watch\\Movies" to be canonical "Onedrive:Watch/Movies"
2023-02-06 10:23:52 DEBUG : OneDrive root 'Watch/Movies': Waiting for checks to finish
2023-02-06 10:23:52 DEBUG : OneDrive root 'Watch/Movies': Waiting for transfers to finish
2023-02-06 10:23:53 DEBUG : Jung_e.2023.1080p.NF.WEB-DL.MULTI.DDP5.1.Atmos.HDR-DV.H.265-Telly.mkv: Starting multipart upload
2023-02-06 10:23:53 DEBUG : M3GAN.2023.2160p.MA.WEB-DL.DDP5.1.Atmos.HDR.DV.HEVC-CM.mkv: Starting multipart upload
2023-02-06 10:23:53 DEBUG : Babylon.2022.2160p.WEB-DL.DDP5.1.Atmos.DV.HDR10.H.265-CM.mkv: Starting multipart upload
2023-02-06 10:23:54 DEBUG : Chhatriwali.2023.2160p.ZEE5.WEB-DL.DDP5.1.H.265-Telly.mkv: Starting multipart upload
2023-02-06 10:23:54 DEBUG : Babylon.2022.2160p.WEB-DL.DDP5.1.Atmos.DV.HDR10.H.265-CM.mkv: Uploading segment 0/35782449105 size 10485760
2023-02-06 10:23:55 DEBUG : M3GAN.2023.2160p.MA.WEB-DL.DDP5.1.Atmos.HDR.DV.HEVC-CM.mkv: Uploading segment 0/19165589055 size 10485760
2023-02-06 10:23:55 DEBUG : Jung_e.2023.1080p.NF.WEB-DL.MULTI.DDP5.1.Atmos.HDR-DV.H.265-Telly.mkv: Uploading segment 0/2364998586 size 10485760
2023-02-06 10:23:57 DEBUG : Chhatriwali.2023.2160p.ZEE5.WEB-DL.DDP5.1.H.265-Telly.mkv: Uploading segment 0/3345979075 size 10485760
2023-02-06 10:29:26 DEBUG : pacer: low level retry 1/10 (error Put "https://ashadevipolytechniccol-my.sharepoint.com/personal/XYZ": read tcp 192.168.0.104:5945->13.107.136.8:443: wsarecv: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.)
2023-02-06 10:29:26 DEBUG : pacer: low level retry 1/10 (error Put "https://ashadevipolytechniccol-my.sharepoint.com/personal/XYZ": read tcp 192.168.0.104:5945->13.107.136.8:443: wsarecv: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.)
2023-02-06 10:29:26 DEBUG : pacer: low level retry 1/10 (error Put "https://ashadevipolytechniccol-my.sharepoint.com/personalXYZ": read tcp 192.168.0.104:5945->13.107.136.8:443: wsarecv: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.)
2023-02-06 10:29:26 DEBUG : pacer: low level retry 1/10 (error Put "https://ashadevipolytechniccol-my.sharepoint.com/personal/XYZ": read tcp 192.168.0.104:5945->13.107.136.8:443: wsarecv: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.)
2023-02-06 10:29:26 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2023-02-06 10:29:26 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2023-02-06 10:29:26 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2023-02-06 10:29:26 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2023-02-06 10:37:32 DEBUG : Chhatriwali.2023.2160p.ZEE5.WEB-DL.DDP5.1.H.265-Telly.mkv: Reopening on read failure after 23080304 bytes: retry 1/10: read tcp 192.168.0.104:5933->142.250.183.106:443: i/o timeout
2023-02-06 10:37:41 DEBUG : Jung_e.2023.1080p.NF.WEB-DL.MULTI.DDP5.1.Atmos.HDR-DV.H.265-Telly.mkv: Reopening on read failure after 23093692 bytes: retry 1/10: read tcp 192.168.0.104:5940->142.250.183.106:443: i/o timeout
2023-02-06 10:38:47 DEBUG : Babylon.2022.2160p.WEB-DL.DDP5.1.Atmos.DV.HDR10.H.265-CM.mkv: Reopening on read failure after 24116366 bytes: retry 1/10: read tcp 192.168.0.104:5939->142.250.183.106:443: i/o timeout
2023-02-06 10:38:49 DEBUG : M3GAN.2023.2160p.MA.WEB-DL.DDP5.1.Atmos.HDR.DV.HEVC-CM.mkv: Reopening on read failure after 24146358 bytes: retry 1/10: read tcp 192.168.0.104:5938->142.250.183.106:443: i/o timeout
2023-02-06 10:41:00 DEBUG : pacer: Reducing sleep to 120ms
2023-02-06 10:41:00 DEBUG : Babylon.2022.2160p.WEB-DL.DDP5.1.Atmos.DV.HDR10.H.265-CM.mkv: Uploading segment 10485760/35782449105 size 10485760
2023-02-06 10:41:00 DEBUG : pacer: Reducing sleep to 90ms
2023-02-06 10:41:00 DEBUG : Chhatriwali.2023.2160p.ZEE5.WEB-DL.DDP5.1.H.265-Telly.mkv: Uploading segment 10485760/3345979075 size 10485760
2023-02-06 10:41:02 DEBUG : pacer: Reducing sleep to 67.5ms
2023-02-06 10:41:02 DEBUG : Jung_e.2023.1080p.NF.WEB-DL.MULTI.DDP5.1.Atmos.HDR-DV.H.265-Telly.mkv: Uploading segment 10485760/2364998586 size 10485760
2023-02-06 10:41:03 DEBUG : pacer: Reducing sleep to 50.625ms
2023-02-06 10:41:03 DEBUG : M3GAN.2023.2160p.MA.WEB-DL.DDP5.1.Atmos.HDR.DV.HEVC-CM.mkv: Uploading segment 10485760/19165589055 size 10485760
2023-02-06 10:53:49 DEBUG : pacer: Reducing sleep to 37.96875ms
2023-02-06 10:53:49 DEBUG : Babylon.2022.2160p.WEB-DL.DDP5.1.Atmos.DV.HDR10.H.265-CM.mkv: Uploading segment 20971520/35782449105 size 10485760
2023-02-06 10:54:03 DEBUG : pacer: Reducing sleep to 28.476562ms
2023-02-06 10:54:03 DEBUG : Chhatriwali.2023.2160p.ZEE5.WEB-DL.DDP5.1.H.265-Telly.mkv: Uploading segment 20971520/3345979075 size 10485760
2023-02-06 10:54:03 DEBUG : pacer: Reducing sleep to 21.357421ms
2023-02-06 10:54:03 DEBUG : Jung_e.2023.1080p.NF.WEB-DL.MULTI.DDP5.1.Atmos.HDR-DV.H.265-Telly.mkv: Uploading segment 20971520/2364998586 size 10485760
2023-02-06 10:54:04 DEBUG : pacer: Reducing sleep to 16.018065ms
2023-02-06 10:54:04 DEBUG : M3GAN.2023.2160p.MA.WEB-DL.DDP5.1.Atmos.HDR.DV.HEVC-CM.mkv: Uploading segment 20971520/19165589055 size 10485760
2023-02-06 11:01:08 DEBUG : Chhatriwali.2023.2160p.ZEE5.WEB-DL.DDP5.1.H.265-Telly.mkv: Reopening on read failure after 39873904 bytes: retry 2/10: read tcp 192.168.0.104:6006->142.250.67.202:443: wsarecv: An existing connection was forcibly closed by the remote host.
`

I have already troubleshooted like this. FIRST TO DOWNLOAD IN LOCAL DRIVE THEN UPLOAD TO ONEDRIVE BUT NOTHING...
I have uploaded it on youtube ALSO.

Those are network errors meaning you have something blocking / dropping / getting in the way of your connection.

You'd want to fix that first as anything you tweak won't matter at that point as rclone can't do anything if there is a network issue like that.

If you have something, what should I do, network reset or something? how to fix it?

If you are at home, you can reset routers/networking devices.

If you are somewhere else, you'd want to hit their support department I'd imagine.

Could be a firewall/AntiVirus or some other device along the way as that how to fix it is really very specific to your setup and/or devices.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.