Google drive sync issues

Help and Support
1

Hi,

I started a copy to a crypt folder Google Drive. It proceeded very slowly— at around 50KBytes/sec. After about 30 minutes, I ended the process with Control- C. Of course, some data were uploaded. I did not see an Error Message, as such.

I then tried a rsync (plain; no additional arguments) later in the day, hoping the process would resume and go faster. This is an excerpt of what I now see:

2017/02/04 22:09:04 Google drive root 'laptopcrypt/NoPrivEmailBackup': Finished reading "Cabinet/Report confirms and consults/2008/06/352/attachments/" 2017/02/04 22:09:04 Google drive root 'laptopcrypt/NoPrivEmailBackup': Reading "Cabinet/Report confirms and consults/2012/03/334/" 2017/02/04 22:09:04 Google drive root 'laptopcrypt/NoPrivEmailBackup': Finished reading "Cabinet/Report confirms and consults/2008/10/356/" 2017/02/04 22:09:04 Google drive root 'laptopcrypt/NoPrivEmailBackup': Reading "Cabinet/Report confirms and consults/2013/08/283/attachments/" 2017/02/04 22:09:05 pacer: Rate limited, sleeping for 1.453606385s (1 consecutive low level retries) 2017/02/04 22:09:05 pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded) 2017/02/04 22:09:05 pacer: Rate limited, sleeping for 2.328998779s (2 consecutive low level retries) 2017/02/04 22:09:05 pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded) 2017/02/04 22:09:05 pacer: Rate limited, sleeping for 4.895730807s (3 consecutive low level retries) 2017/02/04 22:09:05 pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded) 2017/02/04 22:09:05 pacer: Rate limited, sleeping for 8.529358657s (4 consecutive low level retries) 2017/02/04 22:09:05 pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded) 2017/02/04 22:09:05 pacer: Rate limited, sleeping for 16.592368908s (5 consecutive low level retries) 2017/02/04 22:09:05 pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded) 2017/02/04 22:09:05 pacer: Rate limited, sleeping for 16.625537313s (6 consecutive low level retries) 2017/02/04 22:09:05 pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded) 2017/02/04 22:09:05 pacer: Rate limited, sleeping for 16.444995145s (7 consecutive low level retries) 2017/02/04 22:09:05 pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded) 2017/02/04 22:09:07 pacer: Resetting sleep to minimum 10ms on success 2017/02/04 22:09:07 Google drive root 'laptopcrypt/NoPrivEmailBackup': Finished reading "Cabinet/Report confirms and consults/2013/08/283/attachments/" 2017/02/04 22:09:07 Google drive root 'laptopcrypt/NoPrivEmailBackup': Reading "Cabinet/Report confirms and consults/2014/01/288/" 2017/02/04 22:09:17 Transferred: 0 Bytes (0 Bytes/s) Errors: 0 Checks: 0 Transferred: 0 Elapsed time: 28m1.9s

__

So, after 28 minutes, I don’t really know what’s happening.

I’d appreciate ideas/guidance.

Thanks.

Howard

2

Update 2/5/17:

Summary of (very slow!) new upload (copy of folder):

Transferred: 777.332 MBytes (50.070 kBytes/s) Errors: 0 Checks: 0 Transferred: 11270 Elapsed time: 4h24m57.2s 2017/02/05 12:58:46 Go routines at exit 9

Howard

3

You have lots of small files which is the worst case for drive. You don’t seem to be able to upload more than 2 files per second to drive. You managed 0.75 files per second which is a bit on the slow side.

Did rclone need a retry?

You could try making your own credentials (see the drive help).

4

Hello @ncw, @howardm,

For the record, I’m using my own credentials on Google Drive and I’m seeing numbers very close to 3 files/second (it does jitter a little, but usually varies between 2 and 3).

Cheers,

Durval.

5

I’ve just asked Google for some more quota for rclone which may help! (Not a problem if you are using your own credentials - you’ll get to have your own discussions with google about quota!)