Rclone Move/Transfer Help

I use rClone to mount two different cloud storage providers and use ssh to manage those mounts. I am discontinuing use of one of these cloud storage providers and need to move everythere there to the other one I use. I need to transfer everyone from Google Drive Enterprise to my other cloud storage provider, Storj. I will need to move 110 TB of data.

Two primary concerns:

  1. Can I do this without running into quota issues with Google Drive.
  2. What happens if it drops, stops, or is otherwise interrupted while moving a file? Does it stop with the last successfully moved file and I simply have to reissue the move command to pickup from there again?

My command will simply be this, unless advised otherwise:

rclone move --progress remote1:Media remote2:Media
Are there any suggestions or recommendations?

Run the command 'rclone version' and share the full output of the command.

rclone v1.61.1

  • os/version: gentoo 2.14 (64 bit)
  • os/kernel: 6.1.67-gentoo-whatbox (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.19.4
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive and Storj. Began using Storj a few months ago and need to move everything previously uploaded to Google Drive over to Storj.

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Potentially...

rclone move --progress remote1:Media remote2:Media

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

This command does not work and there are limits to my ability to update rclone (seedbox).

Paste config here

A log from the command that you were trying to run with the -vv flag

I haven't run the command yet, so no log is available. I want to ensure I am using the best command possible before running it. This will be a big deal for me to make this move lol. Doing my homework first.

Paste  log here

downloads from gdrive are capped at 10TiB/day, tho i think that is undocumented.
the question is, will you hit that limit using your internet connection?

if your internet connection speed is not fast enough to hit that limit,
then you should be fine.

if your internet connection speed is fast enough to hit that limit,
then can to throttle the connection using --bwlimit=120M
in this way, no need to reissue the move command.

i believe that the file should finish.
if not, if you reissue the move command, rclone will re-copy the entire file.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.