I'm trying to move 300GB from a Google Drive to a different user's Google Team Drive. I've made a client ID, which is that of a third user. I read somewhere that it doesn't matter who set up the client ID.
I have a couple of questions. The first is why my speeds aren't great. I was hoping for faster. Does it use my local bandwidth when transferring from one remote drive to another remote drive? I assumed not.
The second question relates to how I'm controlling it. I'm using a Mac laptop to ssh to a headless Ubuntu box that runs 24/7 under my stairs. It seems that while that ssh session is live the files continue transferring but they stop when I close my laptop and break the ssh session. I assumed that the transfers would keep going but that doesn't seem to be the case. Does the ssh session need to be open?
The command that I'm currently using to transfer files is this:
Thank you. I've gone from 500Kbyte/s to 50Mbyte/s. Thanks for you help. I assume it was the --drive-server-side-across-configs setting.
Can you answer my second question, namely why the transfers stop when I close my laptop, despite rclone running on a Ubuntu box? See above for more detail.
I noticed an issue with copying certain filetypes server-side. I assume the problem is with Google and not rclone, but I haven't done any digging.
I was able to transfer a few TB, but certain files (anything .m4v) would never transfer. Using --disable copy fixed the problem entirely. The same could be the case with other stuff as well.
Also note that the transfer speed is an average. 556 kBytes/s is what you are currently averaging, since you started the transfer- you might actually be sitting at 0 bytes/s and your numbers are just slowly sinking. You can check by taking a look at amount transferred. If it continues to sit at 45.559G and doesn't move for a little bit, then you know you aren't moving anymore.
By default server side copies are off in the latest stable.
If you remove
You will be using your local bandwidth rather than using server side. No reason to turn it on to turn it off via another command line.
With Google, you can only get 10 transactions per seconds so having 5 transfers and 5 checkers might be causing you a few of those 403s which are ok as they retry.
For Google Drive, you can also use --fast-list which speeds up things a bit as well.
Thank you. I don't want to use local bandwidth so presumably I should leave --drive-server-side-across-configs in the command? I'm still a bit confused why I'm getting slow speeds again when transferring between remote sources.
If you turn on server side copy by using --drive-server-side-across-configs and turn off server side copies by disabling copies, you are using local bandwidth and not server side.
It's a binary type thing so either you are doing server side copies or you are not.
Without seeing the logs too much, I wouldn't worry too much as you get a token refresh every 10 minutes I think it is so seeing those messages are normal.