Download not saved after google drive limit reached

Help and Support
1

What is the problem you are having with rclone?

After I attempt to download a 4TB file to the university cluster from a google drive, the download cuts off after about 2.06 TB. This is because the daily gdrive limit was reached. However, I lose the downloaded data. -- the file size after the error becomes 0 kb

  1. Is there a way to retain downloaded data, and continue downloading later?

  2. I was reading about --bwlimit to limit bandwidth. Can I specifiy that in terms of TB/day?

Run the command 'rclone version' and share the full output of the command.

rclone v1.48.0

  • os/arch: linux/amd64
  • go version: go1.12.6

Which cloud storage system are you using? (eg Google Drive)

google drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone   --drive-shared-with-me --transfers=32 --checkers=16 --drive-chunk-size=16384k --drive-upload-cutoff=16384k --tpslimit=5  -P copy myGdrive:path/to/myFile .

The rclone config contents with secrets removed.

[myGdrive]
type = drive
scope = drive.readonly
token = removed secrets

~                                                                                              
~

A log from the command with the -vv flag

I did not use the -vv flag, but a similar message occured after downloading ~2.06 TB. Note, this is not the exact message, because I didn't use -vv , but similar.

2022/09/05 13:19:17 Failed to copy with 2 errors: last error was: multpart copy: failed to open source: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
[user@login 19k-sep2022]$ ./z
2022-09-05 14:45:15 ERROR : Re19000-N0-RunData.tar.gz: Failed to copy: multpart copy: write failed: write /scratch/miraba2/19k-sep2022/Re19000-N0-RunData.tar.gz: disk quota exceeded
2022-09-05 14:45:15 ERROR : Attempt 1/3 failed with 2 errors and: multpart copy: write failed: write /scratch/miraba2/19k-sep2022/Re19000-N0-RunData.tar.gz: disk quota exceeded
2022-09-05 14:45:19 ERROR : Re19000-N0-RunData.tar.gz: Failed to copy: multpart copy: failed to open source: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2022-09-05 14:45:19 ERROR : Attempt 2/3 failed with 2 errors and: multpart copy: failed to open source: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2022-09-05 14:45:20 ERROR : Re19000-N0-RunData.tar.gz: Failed to copy: multpart copy: failed to open source: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2022-09-05 14:45:20 ERROR : Attempt 3/3 failed with 2 errors and: multpart copy: failed to open source: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.