What is the problem you are having with rclone?
Downloading from GDrive with rclone copy
or rclone sync
results in a googleapi: Error 404: File not found:
error for some files in a remote, other files are copied fine.
Run the command 'rclone version' and share the full output of the command.
~# rclone --version
rclone v1.58.1
- os/version: debian 10.4 (64 bit)
- os/kernel: 4.19.0-9-amd64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.9
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy pro:"/COMUNICACIOĢ/10. Premsa/PORTADAS.pdf" .
The rclone config contents with secrets removed.
[pro]
type = drive
scope = drive
token = {"access_token":"ya****","token_type":"Bearer","refresh_token":"1//0****","expiry":"2022-05-12T11:40:04.844864123+02:00"}
client_id = 89****.apps.googleusercontent.com
client_secret = ****
root_folder_id = 1cv****
team_drive =
A log from the command with the -vv
flag
~# rclone copy pro:"/COMUNICACIOĢ/10. Premsa/PORTADAS.pdf" . -vv
2022/05/12 11:13:21 DEBUG : rclone: Version "v1.58.1" starting with parameters ["rclone" "copy" "pro:/COMUNICACIOĢ/10. Premsa/PORTADAS.pdf" "." "-vv"]
2022/05/12 11:13:21 DEBUG : Creating backend with remote "pro:/COMUNICACIOĢ/10. Premsa/PORTADAS.pdf"
2022/05/12 11:13:21 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2022/05/12 11:13:31 DEBUG : fs cache: adding new entry for parent of "pro:/COMUNICACIOĢ/10. Premsa/PORTADAS.pdf", "pro:COMUNICACIOĢ/10. Premsa"
2022/05/12 11:13:31 DEBUG : Creating backend with remote "."
2022/05/12 11:13:31 DEBUG : fs cache: renaming cache item "." to be canonical "/var/****/workdir"
2022/05/12 11:13:32 DEBUG : PORTADAS.pdf: Need to transfer - File not found at Destination
2022/05/12 11:13:32 ERROR : PORTADAS.pdf: Failed to copy: failed to open source object: open file failed: googleapi: Error 404: File not found: 0B15NJBKtA97odkgyZTVIMjhvMnZMWEFrRk9KdTlLNnhpT0Vz., notFound
2022/05/12 11:13:32 ERROR : Attempt 1/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 404: File not found: 0B15NJBKtA97odkgyZTVIMjhvMnZMWEFrRk9KdTlLNnhpT0Vz., notFound
2022/05/12 11:13:32 DEBUG : PORTADAS.pdf: Need to transfer - File not found at Destination
2022/05/12 11:13:33 ERROR : PORTADAS.pdf: Failed to copy: failed to open source object: open file failed: googleapi: Error 404: File not found: 0B15NJBKtA97odkgyZTVIMjhvMnZMWEFrRk9KdTlLNnhpT0Vz., notFound
2022/05/12 11:13:33 ERROR : Attempt 2/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 404: File not found: 0B15NJBKtA97odkgyZTVIMjhvMnZMWEFrRk9KdTlLNnhpT0Vz., notFound
2022/05/12 11:13:33 DEBUG : PORTADAS.pdf: Need to transfer - File not found at Destination
2022/05/12 11:13:33 ERROR : PORTADAS.pdf: Failed to copy: failed to open source object: open file failed: googleapi: Error 404: File not found: 0B15NJBKtA97odkgyZTVIMjhvMnZMWEFrRk9KdTlLNnhpT0Vz., notFound
2022/05/12 11:13:33 ERROR : Attempt 3/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 404: File not found: 0B15NJBKtA97odkgyZTVIMjhvMnZMWEFrRk9KdTlLNnhpT0Vz., notFound
2022/05/12 11:13:33 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 12.5s
2022/05/12 11:13:33 DEBUG : 5 go routines active
2022/05/12 11:13:33 Failed to copy: failed to open source object: open file failed: googleapi: Error 404: File not found: 0B15NJBKtA97odkgyZTVIMjhvMnZMWEFrRk9KdTlLNnhpT0Vz., notFound
I have seen that these 404 googleapi errors are often caused by lack of permissions, but this doesn't seem to be the case, since I can get the file details from the remote:
~# rclone lsl pro:"/COMUNICACIOĢ/10. Premsa/PORTADAS.pdf"
159789 2016-10-14 08:47:44.952000000 PORTADAS.pdf
There are 21311 objects in the "pro:"/COMUNICACIOĢ/" path. Most of them are copied correctly, but 92 of them throw this same 404 error. The failing files do exist in the remote, I can open them from the GDrive web UI using the same account that is authorized in the "pro:" remote.
I haven't been able to find a common pattern for the failing objects. Some of them are folders, most of them are files.
Any pointers will be appreciated!