GDrive to Dropbox. It's possible download first, then upload automatically?

[viniciusmi00 (Vinicius Miranda)]

Hello everybody!

With the new limits on Google Drive plans, it became unfeasible to continue using it, so I'm going to subscribe to Unlimited Dropbox.
With that, I need to target my 14TB of Google Drive to Dropbpx.

The problem is the following: I have an internet of 1000 Mbps down, 500 Mbps up. Using the rclone copy command, I can only reach 500Mbps down 500 Up (a little less actually), because of the limitation of the Cat 5e cable and 1000Mbps router, and because rclone downloads and uploads files at the same time.
I would like to know if there is any command that can download 1TB to the cache and only after downloading, upload 1TB, clear the cache and continue doing this until complete. That way would have the total download speed, followed by the total upload speed.
Note: It would be interesting to continue with the hash check.

I know I could do this manually, but it would be too much work and it would be much more interesting if there was a way to do it automatically through Rclone.

I searched a lot and read the documentation but didn't find anything about it. If anyone knows, can you help me with this?

Command I'm using:

rclone copy GDrive:Storage/ Dropbox:Storage/ -P

Rclone version:

rclone v1.62.2
- os/version: darwin 13.4 (64 bit)
- os/kernel: 22.5.0 (x86_64)
- os/type: darwin
- os/arch: amd64
- go/version: go1.20.2
- go/linking: dynamic
- go/tags: cmount

[Animosity022]

What problem are you trying to solve? Just copy remote to remote and be done with it as it does checking and all that automatically.

[viniciusmi00 (Vinicius Miranda)]

I want the command to download a specific amount of files like 1TB for example, and only after downloading do the upload. Not simultaneously.
In this way it takes all the speed of the connection.
Did I explain? Sorry English is not my native language.

[Animosity022]

That feels really painful in terms of a process.

1. rclone copy remote: /local --max-transfer 1TB
2. rclone copy /local otherremote:

repeat.

You'd be better off just grabbing a cheap VPS and let it run in the background as the time invested to do a 1TB at a time feels not great.

[kapitainsky]

@viniciusmi00

The problem is the following: I have an internet of 1000 Mbps down, 500 Mbps up. Using the rclone copy command, I can only reach 500Mbps down 500 Up (a little less actually), because of the limitation of the Cat 5e cable and 1000Mbps router, and because rclone downloads and uploads files at the same time.

It is wrong math. Doing it in steps will take longer.

Lets say you can download n GB in 1h but only sent 0.5n GB per hour.

1. Download n (1h) and then upload n (2h) = 3h all together
2. Download/Upload the same time is 0.5n up and down per hour = 2h in total

So forget your plan:)

[viniciusmi00 (Vinicius Miranda)]

Good to know.
Thanks kapitainsky!

@kapitainsky, @Animosity022
I'm going to copy my 15TB Google Drive to Dropbox using Unraid OS as the server. There is a shell in it that I can use Rclone through PC.
As it will take about 96h if I close the shell window, do you know if there is any command that I can use in the shell again to see the progress?

I know that when copying I can use -P or --progress to see the progress, but if I close the shell window and reopening it? Something I can use to show progress again?

[alneven]

You can use the command “screen”
Before you start the copy
And then exit the screen with ctrl + a + d (detach it)
Reenter the screen: screen -r [enter]

[kapitainsky]

or tmux - I guess Unraid OS is some linux flavour

A beginner's guide to tmux

[viniciusmi00 (Vinicius Miranda)]

Thank you very much guys, I tested it and it worked.