Need assistance with Intermittent 403 errors

What is the problem you are having with rclone?

I've been running rClone mount for a while and haven't had any issues, until recently. A few weeks ago I started getting 403's. Immediately checked the cloud console for my projects. First thing I did was check the quotas for my projects, and the current usage is well within quota. What I usually do to resolve it is wait a few hours and the ban is lifted.

These are my stats for the 5 projects over the last day:

Run the command 'rclone version' and share the full output of the command.

rclone v1.58.1

  • os/version: ubuntu 18.04 (64 bit)
  • os/kernel: 4.15.0-176-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.17.9
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

ExecStart=/usr/bin/rclone mount tcrypt: /mnt/tcrypt \
--log-level="ERROR" \
--uid=1000 --gid=1000 --umask=002 \
--allow-other \
--timeout=1h \
--tpslimit=8 \
--drive-skip-gdocs \
--user-agent="vwzVMH0rIsTwxjQn" \
--dir-cache-time="5m" \
--vfs-cache-mode="writes" \
--vfs-cache-max-age="1h" \
--vfs-cache-max-size="10G" \
--vfs-read-chunk-size-limit="2048M" \
--vfs-read-chunk-size="64M" \
--buffer-size="16M"

I've been running this mount command for years without issue.

The rclone config contents with secrets removed.

#------------------------------------------
# rClone.config created over rclone
#------------------------------------------
[gdrive]
client_id = 329992016063-6kpb25brcgersdobbah8u336tcn9bfii.apps.googleusercontent.com
client_secret = [redacted]
type = drive
server_side_across_configs = true
token = [redacted]

[gcrypt]
type = crypt
remote = gdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = [redacted]
password2 = [redacted]

[tdrive]
client_id = 329992016063-6kpb25brcgersdobbah8u336tcn9bfii.apps.googleusercontent.com
client_secret = [redacted]
type = drive
server_side_across_configs = true
token = [redacted]
team_drive = 0AFsVct4HDKPrUk9PVA

[tcrypt]
type = crypt
remote = tdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = [redacted]
password2 = [redacted]

[GDSA01]
type = drive
scope = drive
service_account_file = /opt/appdata/plexguide/.blitzkeys/GDSA01
team_drive = 0AFsVct4HDKPrUk9PVA

[GDSA01C]
type = crypt
remote = GDSA01:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = [redacted]
password2 = [redacted]

[GDSA02]
type = drive
scope = drive
service_account_file = /opt/appdata/plexguide/.blitzkeys/GDSA02
team_drive = 0AFsVct4HDKPrUk9PVA

[GDSA02C]
type = crypt
remote = GDSA02:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = [redacted]
password2 = [redacted]

A log from the command with the -vv flag

2022/05/25 12:10:43 Failed to copy: multipart copy: failed to open source: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded

I remember there used to be a rule that you couldn't do more than 100k get requests per day, but I don't see that in the quotas anymore. I wonder if I'm being banned because I'm doing more than 100k get requests across my projects (cumulatively).

I've been banned 3 times in 3 weeks. Is there another place I can check for quotas or see what's triggering the 403? Also, I'm thinking of changing my mount command because the method I'm using is a little old, so any suggestions would be great.

You don't get banned for hitting upload and/or download quotas. They are just quotas that reset on a daily basis.

Google Support unfortunately won't give you any details on why you are hitting a download quota so the only real fix is to download less per day.

I'd imagine they are continuing to plug things up with service accounts and those downloads are going back to a user.

1 Like

hi,
there are a huge amount of errors, up to 21%.
is that new or what?
maybe that is causing rclone to do a lot of retries

The rate is somewhat not relevant.

Once you hit a quota and you keep hitting a file to download, it just errors out.

Thanks for the response. What's weird is that I haven't changed behaviour, I haven't really increased downloads and things have been the same for a while now. It's just strange that the bans started out of nowhere, and there isn't really a way to check what's causing the ban. It sucks.

It isn't a ban.

You are hitting a download quota issue.

I don't doubt your experience as Google can change things without knowledge and you won't get an answer from support on what threshold you crossed. You only get 'download less'.

you dont receive any email from google regarding service account?because i seen many people last 2week got ban from using sa(mostly try bypass quota)

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.