Unable to use --drive-acknowledge-abuse with Google Drive EDU to download stored files google flagged as malicious

eq-uestions · December 9, 2023, 9:39pm

Unable to use --drive-acknowledge-abuse with Google Drive EDU to download stored files google flagged as malicious.

I have been using Rclone for a long time, but I have not run it for the past 2-3 years to do a full backup. Some things have changed, and now I need to do a full download of my google drive, but I can't seem to fix the malicious file error. I appreciate any help I can get on solving this, especially with creating the correct Google Service Account to do it.

I am removing all my files from Google Drive EDU. Google Takeout doesn't work sadly.

I currently have a Google Console Project setup for this.
I created an OAuth 2.0 Client ID credential which works except for the malicious flagged files. I've been using this one since 2019/2020

The Error is SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile

I have a store of old executables and installers that do not exist anymore which I want to keep. Google sees all of these as malicious. I used to be able to bypass the with the --drive-acknowledge-abuse , which no longer works. I did some research, but I can't find a working bypass anymore.

Following the information here (Google drive) , I believe I need to switch to a Service Account with the Manager Permission. I can't find this permissions and was hoping someone before me had the right steps.

--drive-acknowledge-abuse
Note that if you are using service account it will need Manager permission (not Content Manager) to for this flag to work. If the SA does not have the right permission, Google will just ignore the flag.

Run the command 'rclone version' and share the full output of the command.

Rclone on WSL (windows linux subsystem)

rclone v1.65.0
- os/version: ubuntu 18.04 (64 bit)
- os/kernel: 4.4.0-22621-Microsoft (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.4
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive Education

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone sync google-drive-username123:/ "/mnt/f/Takeout-Extract1/Takeout/Drive/" --exclude "{_gsdata_,Encrypted-Files,.googlephotos,Google Photos,Shared_accross_machines}/**"  --drive-acknowledge-abuse --transfers 8 --progress

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[google-drive-username123]
type = drive
client_id = XXX
client_secret = XXX
token = XXX

A log from the command that you were trying to run with the `-vv` flag

This is an excerpt with redactions:

2023/12/09 15:08:58 NOTICE: REDACTEDFILENAM.pdf: Duplicate object found in source - ignoring
Transferred:        1.036 GiB / 15.437 GiB, 7%, 10.937 MiB/s, ETA 22m28s
2023/12/09 15:16:02 ERROR : School/friendshare/old project: Failed to copy: failed to open source object: can't read dangling shortcut
2023/12/09 15:31:56 ERROR : Pre-2019/Network Support Docs: Failed to copy: failed to open source object: can't read dangling shortcut
2023/12/09 15:32:09 ERROR : Pre-2019/SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/09 15:44:03 NOTICE: Resume and Job applications/Resume/MAINResume.pdf: Duplicate object found in source - ignoring

asdffdsa · December 10, 2023, 4:22pm

welcome to the forum,

no need for service account

rclone copy gdrive01:zork/eicar.com ./ -v
2023/12/10 11:26:46 ERROR : eicar.com: Failed to copy: failed to open source object: open file failed: use the --drive-acknowledge-abuse flag to download this file: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile

rclone copy gdrive01:zork/eicar.com ./ --drive-acknowledge-abuse -v
2023/12/10 11:26:59 INFO  : eicar.com: Copied (new)

eq-uestions · December 10, 2023, 10:44pm

@asdffdsa why was this not working in my original command? Is there difference between copy and sync with --drive-acknowledge-abuse ?

asdffdsa · December 11, 2023, 12:08am

root@wsl01:~/zork# rclone sync gdrive01:zork ./ -v
ERROR : eicar.com: Failed to copy: failed to open source object: open file failed: use the --drive-acknowledge-abuse flag to download this file: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile

rclone sync gdrive01:zork ./ --drive-acknowledge-abuse -v
INFO  : eicar.com: Copied (new)

eq-uestions · December 11, 2023, 12:35am

I am still getting the error. What version of rclone are you on and what OS? Using the information you gave me I just ran:

rclone sync google-drive-username123:/ "/mnt/f/Takeout-Extract1/Takeout/Drive/" --drive-acknowledge-abuse -v --exclude "{_gsdata_,Encrypted-Files,.googlephotos,Google Photos,Shared_accross_machines}/**" --transfers 8 --progress

I again got:
2023/12/10 19:31:05 ERROR : Pre-2019/SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile

asdffdsa · December 11, 2023, 12:39am

rclone v1.65.0
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.90.4-microsoft-standard-WSL2 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.4
- go/linking: static
- go/tags: none

eq-uestions · December 11, 2023, 12:47am

Thanks for the info, it looks like we have a similar setup.

What steps did you use to set up your remote and oauth key?

asdffdsa · December 11, 2023, 12:48am

rclone documentation

eq-uestions · December 11, 2023, 12:57am

Posting some full -vv output information about the error as it seems it might be useful.

We can see here it's still failing.

user@Desktop:/mnt/s/linux-rclone-test$ rclone copy google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi -vv "/mnt/s/linux-rclone-test/" --drive-acknowledge-abuse
2023/12/10 19:53:07 DEBUG : rclone: Version "v1.65.0" starting with parameters ["rclone" "copy" "google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi" "-vv" "/mnt/s/linux-rclone-test/" "--drive-acknowledge-abuse"]
2023/12/10 19:53:07 DEBUG : Creating backend with remote "google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi"
2023/12/10 19:53:07 DEBUG : Using config file from "/home/user/.config/rclone/rclone.conf"
2023/12/10 19:53:07 DEBUG : google-drive-username123: detected overridden config - adding "{P2dbo}" suffix to name
2023/12/10 19:53:07 DEBUG : Google drive root 'Pre-2019/SkypeSetup_7.40.0.104.msi': 'root_folder_id = 0AOh6eWIUaZIAUk9PVA' - save this in the config to speed up startup
2023/12/10 19:53:08 DEBUG : fs cache: adding new entry for parent of "google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi", "google-drive-username123{P2dbo}:Pre-2019"
2023/12/10 19:53:08 DEBUG : Creating backend with remote "/mnt/s/linux-rclone-test/"
2023/12/10 19:53:08 DEBUG : fs cache: renaming cache item "/mnt/s/linux-rclone-test/" to be canonical "/mnt/s/linux-rclone-test"
2023/12/10 19:53:08 DEBUG : SkypeSetup_7.40.0.104.msi: Need to transfer - File not found at Destination
2023/12/10 19:53:19 ERROR : SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 19:53:19 ERROR : Attempt 1/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 19:53:19 DEBUG : SkypeSetup_7.40.0.104.msi: Need to transfer - File not found at Destination
2023/12/10 19:53:29 ERROR : SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 19:53:29 ERROR : Attempt 2/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 19:53:29 DEBUG : SkypeSetup_7.40.0.104.msi: Need to transfer - File not found at Destination
2023/12/10 19:53:43 ERROR : SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 19:53:43 ERROR : Attempt 3/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 19:53:43 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:        36.3s

2023/12/10 19:53:43 DEBUG : 8 go routines active
2023/12/10 19:53:43 Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile

asdffdsa · December 11, 2023, 1:20am

i re-ran my command with --dump=headers and maybe, i noticed a problem.

can you run this command and post full output.
rclone copy google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi /mnt/s/linux-rclone-test --drive-acknowledge-abuse -vv --dump=headers --retries=1 --inplace

eq-uestions · December 11, 2023, 2:09am

Command and output:

USER@Desktop:/mnt/s/linux-rclone-test$ rclone copy google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi "/mnt/s/linux-rclone-test/" --drive-acknowledge-abuse --dump=headers


2023/12/10 21:03:13 NOTICE: Automatically setting -vv as --dump is enabled
2023/12/10 21:03:13 DEBUG : rclone: Version "v1.65.0" starting with parameters ["rclone" "copy" "google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi" "/mnt/s/linux-rclone-test/" "--drive-acknowledge-abuse" "--dump=headers"]
2023/12/10 21:03:13 DEBUG : Creating backend with remote "google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi"
2023/12/10 21:03:13 DEBUG : Using config file from "/home/USER/.config/rclone/rclone.conf"
2023/12/10 21:03:13 DEBUG : google-drive-username123: detected overridden config - adding "{P2dbo}" suffix to name
2023/12/10 21:03:13 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/12/10 21:03:13 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:13 DEBUG : HTTP REQUEST (req 0xc000a78200)
2023/12/10 21:03:13 DEBUG : GET /drive/v3/files/root?alt=json&fields=id&prettyPrint=false&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:13 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:13 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:13 DEBUG : HTTP RESPONSE (req 0xc000a78200)
2023/12/10 21:03:13 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:12 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:13 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:13 DEBUG : Google drive root 'Pre-2019/SkypeSetup_7.40.0.104.msi': 'root_folder_id = 0AOh6eWIUaZIAUk9PVA' - save this in the config to speed up startup
2023/12/10 21:03:13 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:13 DEBUG : HTTP REQUEST (req 0xc000a78600)
2023/12/10 21:03:13 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Csha1Checksum%2Csha256Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%270AOh6eWIUaZIAUk9PVA%27+in+parents%29+and+%28name%3D%27Pre-2019%27%29+and+%28mimeType%3D%27application%2Fvnd.google-apps.folder%27+or+mimeType%3D%27application%2Fvnd.google-apps.shortcut%27%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:13 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : HTTP RESPONSE (req 0xc000a78600)
2023/12/10 21:03:14 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:13 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : HTTP REQUEST (req 0xc000507800)
2023/12/10 21:03:14 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Csha1Checksum%2Csha256Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%271-iJPLz3BWN6sIs2nVRCtV3s9Q8DsMLVN%27+in+parents%29+and+%28name%3D%27SkypeSetup_7.40.0.104.msi%27%29+and+%28mimeType%3D%27application%2Fvnd.google-apps.folder%27+or+mimeType%3D%27application%2Fvnd.google-apps.shortcut%27%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : HTTP RESPONSE (req 0xc000507800)
2023/12/10 21:03:14 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:13 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : HTTP REQUEST (req 0xc000507900)
2023/12/10 21:03:14 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Csha1Checksum%2Csha256Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%270AOh6eWIUaZIAUk9PVA%27+in+parents%29+and+%28name%3D%27Pre-2019%27%29+and+%28mimeType%3D%27application%2Fvnd.google-apps.folder%27+or+mimeType%3D%27application%2Fvnd.google-apps.shortcut%27%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : HTTP RESPONSE (req 0xc000507900)
2023/12/10 21:03:14 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:13 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : HTTP REQUEST (req 0xc0008d6400)
2023/12/10 21:03:14 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Csha1Checksum%2Csha256Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%271-iJPLz3BWN6sIs2nVRCtV3s9Q8DsMLVN%27+in+parents%29+and+%28name%3D%27SkypeSetup_7.40.0.104.msi%27%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : HTTP RESPONSE (req 0xc0008d6400)
2023/12/10 21:03:14 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:13 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : HTTP REQUEST (req 0xc0008d6b00)
2023/12/10 21:03:14 DEBUG : GET /drive/v3/files/1AoHuJGMYkId54xW9WP6XOrkE2e-ySZbv?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Csha1Checksum%2Csha256Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey&prettyPrint=false&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : HTTP RESPONSE (req 0xc0008d6b00)
2023/12/10 21:03:14 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:14 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:14 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:14 DEBUG : fs cache: adding new entry for parent of "google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi", "google-drive-username123{P2dbo}:Pre-2019"
2023/12/10 21:03:14 DEBUG : Creating backend with remote "/mnt/s/linux-rclone-test/"
2023/12/10 21:03:14 DEBUG : fs cache: renaming cache item "/mnt/s/linux-rclone-test/" to be canonical "/mnt/s/linux-rclone-test"
2023/12/10 21:03:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:14 DEBUG : HTTP REQUEST (req 0xc0008d7000)
2023/12/10 21:03:14 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Csha1Checksum%2Csha256Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%271-iJPLz3BWN6sIs2nVRCtV3s9Q8DsMLVN%27+in+parents%29+and+%28name%3D%27SkypeSetup_7.40.0.104.msi%27%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:15 DEBUG : HTTP RESPONSE (req 0xc0008d7000)
2023/12/10 21:03:15 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:14 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:15 DEBUG : HTTP REQUEST (req 0xc0008d7500)
2023/12/10 21:03:15 DEBUG : GET /drive/v3/files/1AoHuJGMYkId54xW9WP6XOrkE2e-ySZbv?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Csha1Checksum%2Csha256Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey&prettyPrint=false&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/10 21:03:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:15 DEBUG : HTTP RESPONSE (req 0xc0008d7500)
2023/12/10 21:03:15 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:14 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

2023/12/10 21:03:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:15 DEBUG : SkypeSetup_7.40.0.104.msi: Need to transfer - File not found at Destination
2023/12/10 21:03:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:15 DEBUG : HTTP REQUEST (req 0xc0008d7900)
2023/12/10 21:03:15 DEBUG : GET /drive/v3/files/1AoHuJGMYkId54xW9WP6XOrkE2e-ySZbv?alt=media HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
Accept-Encoding: gzip

2023/12/10 21:03:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:22 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:22 DEBUG : HTTP RESPONSE (req 0xc0008d7900)
2023/12/10 21:03:22 DEBUG : HTTP/1.1 403 Forbidden
Content-Length: 340
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:21 GMT
Expires: Mon, 11 Dec 2023 02:03:21 GMT
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Guploader-Uploadid: ABPtcPrVn2v_plY56zEYMl6vXoajtD9Am0LG46o6E5u48X9K0ndoDXAK4PnXZBQeEKj1I9gj6vSQx98mvpR3AFZM20c8LouNa4uD
X-Xss-Protection: 0

2023/12/10 21:03:22 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:22 DEBUG : HTTP REQUEST (req 0xc00021bd00)
2023/12/10 21:03:22 DEBUG : GET /drive/v3/files/1AoHuJGMYkId54xW9WP6XOrkE2e-ySZbv?alt=media&acknowledgeAbuse=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
Accept-Encoding: gzip

2023/12/10 21:03:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/10 21:03:31 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:31 DEBUG : HTTP RESPONSE (req 0xc00021bd00)
2023/12/10 21:03:31 DEBUG : HTTP/1.1 403 Forbidden
Content-Length: 340
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Type: application/json; charset=UTF-8
Date: Mon, 11 Dec 2023 02:03:30 GMT
Expires: Mon, 11 Dec 2023 02:03:30 GMT
Server: ESF
Vary: Origin, X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Guploader-Uploadid: ABPtcPrLSsYqm1HAyj7EzC0BsiAL3ehAUsiFiHzXgTPah3PB-z6bvRdXIl2LNtuJEG3HleBx7eXwOCfCbdrsUPBHmpOWvmugLFsr
X-Xss-Protection: 0

2023/12/10 21:03:31 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/10 21:03:31 ERROR : SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 21:03:31 ERROR : Attempt 1/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded., cannotDownloadAbusiveFile
2023/12/10 21:03:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

(Header repeats 2 more times for the 2 more retries, I excluded the retries)

ncw · December 11, 2023, 2:37pm

You can see rclone putting the correct header on here acknowledgeAbuse=true

This is discussed more here

The conclusion being you'll need to get that Manager access somehow.

eq-uestions · December 11, 2023, 5:02pm

I am not currently using a Service Account. I actually looked a lot for this permission to add to a service account i created and could not find it. Do you happen to know where it would be?

Do you happen to know of a way for EDU users to self-grant that access to oauth?

asdffdsa · December 11, 2023, 6:36pm

i am not using SA and have --drive-acknowledge-abuse works, no problems.

ncw · December 11, 2023, 8:03pm

I don't, I'm afraid. Everything I know I wrote in the help and I don't remember where I got that info from.

You might have to ask your admin for help.

eq-uestions · December 13, 2023, 3:03am

Do you happen to know if there is a way I can have Rclone use Google Drive API v2 instead of v3?

I would like to see if this permission still applies to v2.

ncw · December 13, 2023, 10:41am

You can set --drive-v2-download-min-size 0 to download with the V2 API .

I don't think this code is used very much any more so it might not work properly.

eq-uestions · December 13, 2023, 11:09pm

Good news, I think rclone drive api v2 still works. Bad news is I still was not able to download the file.

USER@Desktop:~$ rclone copy google-drive-username123:Pre-2019/SkypeSetup_7.40.0.104.msi -v "/mnt/s/linux-rclone-test/" --drive-acknowledge-abuse --drive-v2-download-min-size 0


2023/12/13 18:08:41 ERROR : SkypeSetup_7.40.0.104.msi: Failed to copy: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded, abuse
2023/12/13 18:08:41 ERROR : Attempt 1/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 403: This file has been identified as malware or spam and cannot be downloaded, abuse

system · January 12, 2024, 11:09pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.