Trying to copy all the contents of a Google shared drive to USB backup drive

Help and Support
1

What is the problem you are having with rclone?

I'm trying to copy all files and folders from a Google Shared Drive to a USB backup drive. I don't know the command to copy all the contents of the Shared Drive that I have configured.

Run the command 'rclone version' and share the full output of the command.

rclone v1.68.1

  • os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
  • os/kernel: 10.0.19045.5011 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.23.1
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)
Google Drive

The command you were trying to run

rclone copy -P gdrive:Test/ local:d:\backup/

This is a test of just one of the folders on the Google Shared Drive called "Test" but ultimately I'd like to just select the full drive or all files and folder within the shared drive

Please run 'rclone config redacted' and share the full output.

type = drive
scope = drive.readonly
token = XXX
team_drive = XXX
root_folder_id =

I can see the folders within the Shared Drive using rclone lsf
How do I select all contents of a Google Share Drive?
How do i select the end destination of d:\

2

welcome to the forum,

use copy instead of lsf and point to the root of the remote.

rclone copy gdrive: d:\backup -vv --dry-run -P

1 Like
3

Big thanks for taking the time to look at this and reply, that's working. I see the default for copying is ignore a folder if empty. is it possible to turn that off?

The switch -vv just displays a lot more info I presume?

Any recommendations for copying 300GB worth of data using this method?

Do I need to make sure I have enough temp space on the client machines local drive or is the file copied directly to the destination d: ?

4

rclone sync --create-empty-src-dirs

https://rclone.org/docs/#log-level-level

create your own client id+secret.
there are settings to tweak, but in most cases, the default values are good enough.
if the transfer speed is slower than you want/expect. post a debug log and we will look at it.

direct to dest

1 Like
5

Again big thanks for taking the time to reply :smile: Does the logging level effect transfer speed?

Its been running for 3 hours so far and I've got 35GB downloaded so not too bad. Internet connection is 900mb

6

welcome

no

seems very slow. 35GB at 900Mb/s is approx. 5 minutes.
did you create your own client id+secret?
are you using debug output, to look for pacing, errors and other issues?

what transfer speed does rclone show? can use --progress

7

Its showing 76.48 GB / 84.3 91% 4.3 MiB/s ETA 49mins
Transferred 77035 / 87075 , 89%
Elapsed time 6h 13, 57s

These speeds change quite a bit.
And clearly is not the correct amount of data. seems to only see 84GB

Yes I created client id and secret

How do i run - what transfer speed does rclone show? can use --progress
Do I have to load up another Powershell and run rclone --progress ?

are you using debug output, to look for pacing, errors and other issues?
No not sure how to do this. sorry rclone noob.

8

try --check-first

check rclone docs

--log-level=debug--log-file=$env:userprofile\rclone\rclone.log

9

Thanks I 'll give us this a try and check the docs.
I presume I can leave one PowerShell window open doing the copy while running another PowerShell to check progress of the job.

10

well, that is posssible, but is much more complex to do.

fwiw, just kill the current running instance of rclone, re-run the command with --progress

1 Like
11

Again thanks again for answering my questions.
So I kill mid copy then run

rclone copy gdrive: d:\backup -vv --check-first -progress

How would add a log file to this command ? something like this

rclone copy gdrive: d:\backup -vv --check-first -progress --log-level=debug--log-file=$env:userprofile\rclone\rclone.log

12

yes, ok to kill rclone copy. as rclone will not re-copy unchanged files.
Does not transfer files that are identical on source and destination

rclone copy gdrive: d:\backup --check-first --progress --log-level=debug --log-file=$env:userprofile\rclone\rclone.log

and for testing, add --dry-run

13

Took me 24 hours to download 340gb.

I'm now doing another download and speed is even worse.

How do you know if Google Drive is Throttling the download?

I presume when you input client ID and secret if they are not setup correctly I'd get an error msg and the download would fail? I'm not seeing any errors in the log.

14

might tweak --transfers, --checkers

check the debug log.
the forum is full of posts about gdrive and throttling.

15

thanks, I'm seeing some pacer warning in the debug log.

16

post the output of

  • rclone config redacted gdrive:
  • the exact command you ran.
17

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.