Google drive limits file sizeGoogle Drive limits file size for upload

talesam · January 26, 2024, 2:16pm

What is the problem you are having with rclone?

This is a problem that started to appear these days, and I don't know if it's just me, the file size download limit is at 2G, I haven't changed anything. I have an automated system and I noticed that it stopped sending files to the drive and I went to check and found that they were not being sent.

I started creating 1G, 2G, 3G... 2.5G files and I was only able to send files up to 2G. Has this happened to anyone else?

Run the command 'rclone version' and share the full output of the command.

rclone v1.65.2
- os/version: arch (64 bit)
- os/kernel: 6.2.10-1-aarch64-ARCH (aarch64)
- os/type: linux
- os/arch: arm64 (ARMv8 compatible)
- go/version: go1.21.6
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg `rclone copy /tmp

dd if=/dev/zero of=2548MB_file bs=1M count=2548 1 ↵

2548+0 records in
2548+0 records out
2671771648 bytes (2.7 GB, 2.5 GiB) copied, 2.42907 s, 1.1 GB/s

mv 2548MB_file ~/Stories/NEWS
mv: error writing '/home/jelly/Contos/NOVOS/arquivo_de_2548MB': Input/output error
mv: failed to close '/home/jelly/Contos/NOVOS/arquivo_de_2548MB': Input/output error

Please run 'rclone config redacted' and share the full output. If

rclone config redacted
[Tales]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
token = XXX
team_drive = XXX
root_folder_id =

[contos-crypt]
type = crypt
remote = stories:/
password = XXX
password2 = XXX

[mirabel]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
token = XXX
team_drive = XXX
root_folder_id =

[mirabel-crypt]
type = crypt
remote = mirabel:/
password = XXX
password2 = XXX
### Double check the config for sensitive info before posting publicly

╭─jelly@jellyfin ~  
╰─➤  dd if=/dev/zero of=arquivo_de_2049MB bs=1M count=2049

2049+0 records in
2049+0 records out
2148532224 bytes (2.1 GB, 2.0 GiB) copied, 2.01343 s, 1.1 GB/s
╭─jelly@jellyfin ~  
╰─➤  mv arquivo_de_2049MB ~/Contos/NOVOS 
╭─jelly@jellyfin ~  
╰─➤

╭─jelly@jellyfin ~  
╰─➤  ls -lh arquivo_de_2548MB 
-rw-r--r-- 1 jelly jelly 2.5G Jan 26 11:03 arquivo_de_2548MB
╭─jelly@jellyfin ~  
╰─➤  mv arquivo_de_2548MB ~/Contos/NOVOS 
mv: failed to close '/home/jelly/Contos/NOVOS/arquivo_de_2548MB': Input/output error
╭─jelly@jellyfin ~  
╰─➤

Animosity022 · January 26, 2024, 2:25pm

Looks like the mount stopped or something.

Debug log would be superb as that would show you what's going on and why we ask for it.

talesam · January 26, 2024, 3:20pm

Did you see that a file of up to 2G can be moved to the drive without any problems?

What command to generate the log? I'm using it assembled with fuse

cat /etc/systemd/system/contos-crypt.service                                                                                            1 ↵
[Install]
WantedBy=multi-user.target

[Unit]
Description=rClone montar drive criptografado
AssertPathIsDirectory=/home/jelly/Contos
After=network-online.target

[Service]
Type=simple
ExecStart=/usr/bin/rclone mount \
  --config=/home/jelly/.config/rclone/rclone.conf \
        --buffer-size=128M \
        --max-read-ahead=256M \
        --poll-interval=1m \
        --dir-cache-time=12h \
        --timeout=10m \
        --transfers=14 \
        --drive-chunk-size=128M \
        --allow-other \
        --umask=027 \
        --log-file=/home/jelly/rclone_contos.log \
        -vP \
        contos-crypt:/ /home/jelly/Contos
ExecStop=/usr/bin/fusermount -u /home/jelly/Contos
Restart=on-failure
RestartSec=10
User=jelly

[Install]
WantedBy=multi-user.target

Animosity022 · January 26, 2024, 3:34pm

You'd want to change the log level to debug.

Change that to -vv

and recreate, capture, the log, share the log.

talesam · January 26, 2024, 4:11pm

Log: Cloud T4l35

Animosity022 · January 26, 2024, 4:15pm

Looks like Google throttled you.

2024/01/26 13:10:05 DEBUG : Google drive root '': Checking for changes on remote
2024/01/26 13:10:14 ERROR : NOVOS/arquivo_de_3072MB: WriteFileHandle.New Rcat failed: googleapi: got HTTP response code 429 with body: <html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"/><title>Sorry...</title><style> body { font-family: verdana, arial, sans-serif; background-color: #fff; color: #000; }</style></head><body><div><table><tr><td><b><font face=sans-serif size=10><font color=#4285f4>G</font><font color=#ea4335>o</font><font color=#fbbc05>o</font><font color=#4285f4>g</font><font color=#34a853>l</font><font color=#ea4335>e</font></font></b></td><td style="text-align: left; vertical-align: bottom; padding-bottom: 15px; width: 50%"><div style="border-bottom: 1px solid #dfdfdf;">Sorry...</div></td></tr></table></div><div style="margin-left: 4em;"><h1>We're sorry...</h1><p>... but your computer or network may be sending automated queries. To protect our users, we can't process your request right now.</p></div><div style="margin-left: 4em;">See <a href="https://support.google.com/websearch/answer/86640">Google Help</a> for more information.<br/><br/></div><div style="text-align: center; border-top: 1px solid #dfdfdf;"><a href="https://www.google.com">Google Home</a></div></body></html>
2024/01/26 13:10:14 ERROR : NOVOS/arquivo_de_3072MB: WriteFileHandle.Write error: io: read/write on closed pipe
2024/01/26 13:10:14 ERROR : IO error: io: read/write on closed pipe
2024/01/26 13:10:14 DEBUG : &{NOVOS/arquivo_de_3072MB (w)}: >Write: written=0, err=io: read/write on closed pipe
2024/01/26 13:10:14 DEBUG : &{NOVOS/arquivo_de_3072MB (w)}: Flush:
2024/01/26 13:10:14 DEBUG : NOVOS/arquivo_de_3072MB: Remove:
2024/01/26 13:10:14 DEBUG : NOVOS: Added virtual directory entry vDel: "arquivo_de_3072MB"
2024/01/26 13:10:14 DEBUG : NOVOS/arquivo_de_3072MB: >Remove: err=<nil>
2024/01/26 13:10:14 ERROR : NOVOS/arquivo_de_3072MB: WriteFileHandle.Flush error: googleapi: got HTTP response code 429 with body: <html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"/><title>Sorry...</title><style> body { font-family: verdana, arial, sans-serif; background-color: #fff; color: #000; }</style></head><body><div><table><tr><td><b><font face=sans-serif size=10><font color=#4285f4>G</font><font color=#ea4335>o</font><font color=#fbbc05>o</font><font color=#4285f4>g</font><font color=#34a853>l</font><font color=#ea4335>e</font></font></b></td><td style="text-align: left; vertical-align: bottom; padding-bottom: 15px; width: 50%"><div style="border-bottom: 1px solid #dfdfdf;">Sorry...</div></td></tr></table></div><div style="margin-left: 4em;"><h1>We're sorry...</h1><p>... but your computer or network may be sending automated queries. To protect our users, we can't process your request right now.</p></div><div style="margin-left: 4em;">See <a href="https://support.google.com/websearch/answer/86640">Google Help</a> for more information.<br/><br/></div><div style="text-align: center; border-top: 1px solid #dfdfdf;"><a href="https://www.google.com">Google Home</a></div></body></html>
2024/01/26 13:10:14 ERROR : IO error: googleapi: got HTTP response code 429 with body: <html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"/><title>Sorry...</title><style> body { font-family: verdana, arial, sans-serif; background-color: #fff; color: #000; }</style></head><body><div><table><tr><td><b><font face=sans-serif size=10><font color=#4285f4>G</font><font color=#ea4335>o</font><font color=#fbbc05>o</font><font color=#4285f4>g</font><font color=#34a853>l</font><font color=#ea4335>e</font></font></b></td><td style="text-align: left; vertical-align: bottom; padding-bottom: 15px; width: 50%"><div style="border-bottom: 1px solid #dfdfdf;">Sorry...</div></td></tr></table></div><div style="margin-left: 4em;"><h1>We're sorry...</h1><p>... but your computer or network may be sending automated queries. To protect our users, we can't process your request right now.</p></div><div style="margin-left: 4em;">See <a href="https://support.google.com/websearch/answer/86640">Google Help</a> for more information.<br/><br/></div><div style="text-align: center; border-top: 1px solid #dfdfdf;"><a href="https://www.google.com">Google Home</a></div></body></html>
2024/01/26 13:10:14 DEBUG : &{NOVOS/arquivo_de_3072MB (w)}: >Flush: err=googleapi: got HTTP response code 429 with body: <html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"/><title>Sorry...</title><style> body { font-family: verdana, arial, sans-serif; background-color: #fff; color: #000; }</style></head><body><div><table><tr><td><b><font face=sans-serif size=10><font color=#4285f4>G</font><font color=#ea4335>o</font><font color=#fbbc05>o</font><font color=#4285f4>g</font><font color=#34a853>l</font><font color=#ea4335>e</font></font></b></td><td style="text-align: left; vertical-align: bottom; padding-bottom: 15px; width: 50%"><div style="border-bottom: 1px solid #dfdfdf;">Sorry...</div></td></tr></table></div><div style="margin-left: 4em;"><h1>We're sorry...</h1><p>... but your computer or network may be sending automated queries. To protect our users, we can't process your request right now.</p></div><div style="margin-left: 4em;">See <a href="https://support.google.com/websearch/answer/86640">Google Help</a> for more information.<br/><br/></div><div style="text-align: center; border-top: 1px solid #dfdfdf;"><a href="https://www.google.com">Google Home</a></div></body></html>

Out of space? Out of quota? EDU account? Business account? You can always try contacting Google Support but doubtful they'll say why.

talesam · January 29, 2024, 4:40pm

Sorry for the delay, I've been feeling ill these days...

About the business account, I spoke to my friend, she will try to check it with Google.

The ralcone does not have any type of split, correct?

system · February 28, 2024, 4:40pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.