Unable to copy some file from one google shared drive to another

What is the problem you are having with rclone?

I have 2 shared drives (I will call them BU1 and BU2) in an account. I use them as backups for my original shared drive (OD) in another account (I am a bit paranoid). Now, I have made the original account a member of both BU1 and BU2 (as manager) so they are both visible in that account.

I usually sync OD to BU1 and then OD to BU2 as a way to create backups, which runs perfectly.

Recently, I tried copying a few files directly from BU1 to BU2 and was not able to. Then, I tried doing it the other way, i.e. BU2 to BU1 for which I faced the same results. So to look into it a bit further, I tried testing and found out that this was not the same case with all the files. There were few files which were able to copy back and forth from OD1 and OD2, however a few others wont just get copied.

So, I think I am messing up somewhere with the permissions or something, can someone please help me with this?

All the accounts are set as remotes with the same client id and secrets. Therefore I have 5 remotes,

OD Account1
BU1-Shared Account 1
BU2-Shared Account 1
BU1 Account2
BU2 Account2

What is your rclone version (output from rclone version)

rclone v1.53.2
- os/arch: windows/amd64
- go version: go1.15.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 10, 64bit

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync "Backup2:Movies/Bad Education (2019)" "Backup1:Movies/Bad Education (2019)" -P

The rclone config contents with secrets removed.

[Backup1]
type = drive
client_id = 
client_secret = 
scope = drive
server_side_across_configs = true
token = {"access_token":"xxx","token_type":"Bearer","refresh_token":"xxx","expiry":"yyyy-mm--dd"}
team_drive = 1a2b3c4d5e6g7h8i
root_folder_id = 

[Backup2]
type = drive
client_id = 
client_secret = 
scope = drive
server_side_across_configs = true
token = token = {"access_token":"xxx","token_type":"Bearer","refresh_token":"xxx","expiry":"yyyy-mm--dd"}
team_drive = 0z9y8x7w6v5u4t3s
root_folder_id =

A log from the command with the -vv flag

rclone sync "Backup2:Movies/Bad Education (2019)" "Backup1:Movies/Bad Education (2019)" -vv
2020/11/06 19:02:01 DEBUG : rclone: Version "v1.53.2" starting with parameters ["rclone" "sync" "Backup2:Movies/Bad Education (2019)" "Backup1:Movies/Bad Education (2019)" "-vv"]
2020/11/06 19:02:01 DEBUG : Using config file from "C:\\Users\\username\\.config\\rclone\\rclone.conf"
2020/11/06 19:02:01 DEBUG : Creating backend with remote "Backup2:Movies/Bad Education (2019)"
2020/11/06 19:02:02 DEBUG : Creating backend with remote "Backup1:Movies/Bad Education (2019)"
2020/11/06 19:02:04 DEBUG : Google drive root 'Movies/Bad Education (2019)': Waiting for checks to finish
2020/11/06 19:02:04 DEBUG : Google drive root 'Movies/Bad Education (2019)': Waiting for transfers to finish
2020/11/06 19:02:04 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:04 DEBUG : pacer: Rate limited, increasing sleep to 1.97603245s
2020/11/06 19:02:05 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:05 DEBUG : pacer: Rate limited, increasing sleep to 2.133461201s
2020/11/06 19:02:07 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:07 DEBUG : pacer: Rate limited, increasing sleep to 4.329746015s
2020/11/06 19:02:09 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:09 DEBUG : pacer: Rate limited, increasing sleep to 8.747902687s
2020/11/06 19:02:13 DEBUG : pacer: low level retry 5/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:13 DEBUG : pacer: Rate limited, increasing sleep to 16.305733524s
2020/11/06 19:02:22 DEBUG : pacer: low level retry 6/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:22 DEBUG : pacer: Rate limited, increasing sleep to 16.381196732s
2020/11/06 19:02:39 DEBUG : pacer: low level retry 7/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:39 DEBUG : pacer: Rate limited, increasing sleep to 16.228246335s
2020/11/06 19:02:55 DEBUG : pacer: low level retry 8/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:02:55 DEBUG : pacer: Rate limited, increasing sleep to 16.84535325s
2020/11/06 19:03:03 INFO  :
Transferred:             0 / 7.491 GBytes, 0%, 0 Bytes/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:       1m1.8s
Transferring:
 * Bad.Education.2019.108…L.DDP5.1.H.264-NTG.mkv:  0% /7.491G, 0/s, -

2020/11/06 19:03:11 DEBUG : pacer: low level retry 9/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:03:11 DEBUG : pacer: Rate limited, increasing sleep to 16.408997139s
2020/11/06 19:03:28 DEBUG : pacer: low level retry 10/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:03:28 DEBUG : pacer: Rate limited, increasing sleep to 16.518492907s
2020/11/06 19:03:28 DEBUG : Bad.Education.2019.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTG.mkv: Received error: googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded - low level retry 1/10
2020/11/06 19:03:44 DEBUG : pacer: Reducing sleep to 0s
2020/11/06 19:04:01 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:01 DEBUG : pacer: Rate limited, increasing sleep to 1.399584472s
2020/11/06 19:04:02 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:02 DEBUG : pacer: Rate limited, increasing sleep to 2.586567994s
2020/11/06 19:04:03 INFO  :
Transferred:             0 / 7.491 GBytes, 0%, 0 Bytes/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:       2m1.8s
Transferring:
 * Bad.Education.2019.108…L.DDP5.1.H.264-NTG.mkv:  0% /7.491G, 0/s, -

2020/11/06 19:04:03 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:03 DEBUG : pacer: Rate limited, increasing sleep to 4.034122946s
2020/11/06 19:04:06 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:06 DEBUG : pacer: Rate limited, increasing sleep to 8.928016341s
2020/11/06 19:04:10 DEBUG : pacer: low level retry 5/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:10 DEBUG : pacer: Rate limited, increasing sleep to 16.807421441s
2020/11/06 19:04:19 DEBUG : pacer: low level retry 6/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:19 DEBUG : pacer: Rate limited, increasing sleep to 16.621409167s
2020/11/06 19:04:35 DEBUG : pacer: low level retry 7/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:35 DEBUG : pacer: Rate limited, increasing sleep to 16.755110611s
2020/11/06 19:04:52 DEBUG : pacer: low level retry 8/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:04:52 DEBUG : pacer: Rate limited, increasing sleep to 16.828695055s
2020/11/06 19:05:03 INFO  :
Transferred:             0 / 7.491 GBytes, 0%, 0 Bytes/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:       3m1.7s
Transferring:
 * Bad.Education.2019.108…L.DDP5.1.H.264-NTG.mkv:  0% /7.491G, 0/s, -

2020/11/06 19:05:09 DEBUG : pacer: low level retry 9/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:05:09 DEBUG : pacer: Rate limited, increasing sleep to 16.642325467s
2020/11/06 19:05:26 DEBUG : pacer: low level retry 10/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:05:26 DEBUG : pacer: Rate limited, increasing sleep to 16.40893607s
2020/11/06 19:05:26 DEBUG : Bad.Education.2019.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTG.mkv: Received error: googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded - low level retry 2/10
2020/11/06 19:05:42 DEBUG : pacer: Reducing sleep to 0s
2020/11/06 19:05:59 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:05:59 DEBUG : pacer: Rate limited, increasing sleep to 1.502036442s
2020/11/06 19:05:59 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2020/11/06 19:05:59 DEBUG : pacer: Rate limited, increasing sleep to 2.975629242s

Looks like you are out of quota to copy.

Many reports of team drives/edu drives and odd limits recently.

Nothing is published from Google so you can retry and that's about it.

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.