What is the problem you are having with rclone?
I am trying to do a server side copy from one Google Drive account to another Google Drive account using the --drive-server-side-across-configs parameter. I have configured two remotes - one for the existing Google Drive and one for the new Google Drive I want to copy the data to. I have created a ClientID for each remote (as per https://rclone.org/drive/#making-your-own-client-id). The issue I am having is when I try to copy from one remote to the other the files are failing to copy with a
Failed to copy: googleapi: Error 404: File not found
error.
Run the command 'rclone version' and share the full output of the command.
rclone v1.58.0
- os/version: OmniOS omnios-r151040-852962cae3
- os/kernel: 5.11 (i86pc)
- os/type: illumos
- os/arch: amd64
- go/version: go1.17.8
- go/linking: dynamic
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone copy -vP --fast-list --max-backlog -1 --drive-server-side-across-configs --exclude .DS_Store --exclude ._.DS_Store --exclude _gsdata_/ --exclude Thumbs.db --exclude ._* ea-archive:Archive/Electric-Art electricart:Archive/Electric-Art
The rclone config contents with secrets removed.
[ea-archive]
type = drive
client_id = XXXXX
client_secret = XXXXX
scope = drive
token = {}
team_drive =
[electricart]
type = drive
client_id = YYYYY
client_secret = YYYYY
scope = drive
token = {}
team_drive =
A log from the command with the -vv flag
2022/04/13 13:52:39 DEBUG : rclone: Version "v1.58.0" starting with parameters ["rclone" "copy" "-vvP" "--fast-list" "--max-backlog" "-1" "--drive-server-side-across-configs" "--exclude" ".DS_Store" "--exclude" "._.DS_Store" "--exclude" "_gsdata_/" "--exclude" "Thumbs.db" "--exclude" "._*" "ea-archive:Archive/Electric-Art" "electricart:Archive/Electric-Art"]
2022/04/13 13:52:39 DEBUG : Creating backend with remote "ea-archive:Archive/Electric-Art"
2022/04/13 13:52:39 DEBUG : Using config file from "/export/home/eaadmin/.config/rclone/rclone.conf"
2022/04/13 13:52:39 DEBUG : ea-archive: detected overridden config - adding "{Db_Y9}" suffix to name
2022/04/13 13:52:39 DEBUG : Google drive root 'Archive/Electric-Art': 'root_folder_id = 0ADVUhGEh7w2eUk9PVA' - save this in the config to speed up startup
2022/04/13 13:52:40 DEBUG : fs cache: renaming cache item "ea-archive:Archive/Electric-Art" to be canonical "ea-archive{Db_Y9}:Archive/Electric-Art"
2022/04/13 13:52:40 DEBUG : Creating backend with remote "electricart:Archive/Electric-Art"
2022/04/13 13:52:40 DEBUG : electricart: detected overridden config - adding "{Db_Y9}" suffix to name
2022/04/13 13:52:40 DEBUG : electricart{Db_Y9}: Loaded invalid token from config file - ignoring
2022/04/13 13:52:41 DEBUG : Saving config "token" in section "electricart" of the config file
2022/04/13 13:52:41 DEBUG : electricart{Db_Y9}: Saved new token in config file
2022/04/13 13:52:41 DEBUG : Google drive root 'Archive/Electric-Art': 'root_folder_id = 0ABhlDJl9xd4bUk9PVA' - save this in the config to speed up startup
2022/04/13 13:52:42 DEBUG : fs cache: renaming cache item "electricart:Archive/Electric-Art" to be canonical "electricart{Db_Y9}:Archive/Electric-Art"
2022-04-13 13:52:43 DEBUG : Google drive root 'Archive/Electric-Art': Disabling ListR to work around bug in drive as multi listing (3) returned no entries
2022-04-13 13:52:43 DEBUG : Google drive root 'Archive/Electric-Art': Recycled 3 entries
2022-04-13 13:52:43 DEBUG : Google drive root 'Archive/Electric-Art': Re-enabling ListR as previous detection was in error
2022-04-13 13:52:44 DEBUG : Google drive root 'Archive/Electric-Art': Disabling ListR to work around bug in drive as multi listing (2) returned no entries
2022-04-13 13:52:44 DEBUG : Google drive root 'Archive/Electric-Art': Recycled 2 entries
2022-04-13 13:52:44 DEBUG : Google drive root 'Archive/Electric-Art': Re-enabling ListR as previous detection was in error
2022-04-13 13:54:20 DEBUG : ea-archive{Db_Y9}: Loaded invalid token from config file - ignoring
2022-04-13 13:54:20 DEBUG : Saving config "token" in section "ea-archive" of the config file
2022-04-13 13:54:20 DEBUG : ea-archive{Db_Y9}: Saved new token in config file
2022-04-13 14:09:14 DEBUG : Google drive root 'Archive/Electric-Art': Waiting for checks to finish
2022-04-13 14:09:14 DEBUG : Google drive root 'Archive/Electric-Art': Waiting for transfers to finish
2022-04-13 14:09:15 ERROR : Backup/Website/motion.alb: Failed to copy: googleapi: Error 404: File not found: 1O4YCA2fB68VU9eqpceDqlJdWXqpR4RO5., notFound
2022-04-13 14:09:15 ERROR : Production/.jpg: Failed to copy: googleapi: Error 404: File not found: 1SoVWjQLIm21-NDwUFjbAUrSB4P9R2DKD., notFound
2022-04-13 14:09:15 ERROR : Backup/Website/interactive.alb: Failed to copy: googleapi: Error 404: File not found: 1ImxRqbdlVh9GwE7k2Vy-Sbh0yxXREEpH., notFound
2022-04-13 14:09:15 ERROR : Catalogs/Retrospect/Archive/Retrospect Storage Sets.sparseimage: Failed to copy: googleapi: Error 404: File not found: 1B3NANCdTFBIowOTwO_LdXKHWvXqJRHNQ., notFound
2022-04-13 14:09:17 ERROR : Catalogs/Retrospect/Archive/PC Retrospect Catalogs/3D BACKUP #1 1-2004 Original.rbc: Failed to copy: googleapi: Error 404: File not found: 1WRjhHjCz5bAHGejfT01EieoYqfQAFBRH., notFound
2022-04-13 14:09:18 ERROR : Catalogs/Retrospect/Archive/PC Retrospect Catalogs/DIGITAL CAMERA-10-03.rbc: Failed to copy: googleapi: Error 404: File not found: 12QqNZpkq4oUnEXkwp-LCtOofWIaaHtLM., notFound
2022-04-13 14:09:18 ERROR : Catalogs/Retrospect/Archive/Preferences/com.dantz.Retrospect.plist: Failed to copy: googleapi: Error 404: File not found: 1zduuiiTLFvhcUAMsG2z8ae9P_X9OQzgW., notFound
2022-04-13 14:09:18 ERROR : Catalogs/Retrospect/Archive/PC Retrospect Catalogs/HP 3d Backup 09_03.rbc: Failed to copy: googleapi: Error 404: File not found: 1R0nEOReSVC8cluSid7KrWspVn88ECWoX., notFound
2022-04-13 14:09:18 ERROR : Catalogs/Retrospect/Archive/PC Retrospect Catalogs/3D BACKUP #1 1-2004.rbc: Failed to copy: googleapi: Error 404: File not found: 1AcMBkFxJEo0VKmEsWbyiRpjUHcClKtSG., notFound
2022-04-13 14:09:20 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 10:2004 A: Failed to copy: googleapi: Error 404: File not found: 1Mc1UgEG7h03umX9tNVAcn0jqlEXopOHZ., notFound
2022-04-13 14:09:20 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 10:2004 B: Failed to copy: googleapi: Error 404: File not found: 1CswpLCGz9AHjnsMfWHB7RO5t5pm1XDhc., notFound
2022-04-13 14:09:20 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 102004 B: Failed to copy: googleapi: Error 404: File not found: 1rx6Tnc7p7gmeHpTR_l3K4jjisvwkIKSx., notFound
2022-04-13 14:09:20 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 102004 A: Failed to copy: googleapi: Error 404: File not found: 1K4LzS2ubuncXO2a1gjzFCJFnOCN4Hnl5., notFound
2022-04-13 14:09:21 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 11:2003 A: Failed to copy: googleapi: Error 404: File not found: 1NsLLUVTM4Agzx_iGPAHRLZz2iZurAbbF., notFound
2022-04-13 14:09:21 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 112003 B: Failed to copy: googleapi: Error 404: File not found: 1hHlOGlDl4oFsAcHmURgI0APa2QE9A9sJ., notFound
2022-04-13 14:09:21 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 11:2003 B: Failed to copy: googleapi: Error 404: File not found: 1g_-Phtr2u7mMows_bAtwSynRbEOUPPJK., notFound
2022-04-13 14:09:21 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 112003 A: Failed to copy: googleapi: Error 404: File not found: 1db-GGJNXVaCXkj6Wmb8A3U112nzlVoIb., notFound
2022-04-13 14:09:21 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 7:2005 A: Failed to copy: googleapi: Error 404: File not found: 1pElP9hU70_M9-sRc5RigmdJhVXpvbxEI., notFound
2022-04-13 14:09:22 ERROR : Catalogs/Retrospect/Archive/Retrospect Backup 11-8-05/VXA 7:2005 B: Failed to copy: googleapi: Error 404: File not found: 1AUSXQRF0JfNttGnXSEnJbVqq3u_dwaic., notFound
I removed some entries from the log related to exclusions to slim it down a bit. This is just the first part of the log. After that, basically every file it tries to copy has the
Failed to copy: googleapi: Error 404: File not found
error.
I read a few other forum posts with similar issues but couldn't find a specific solution. I also tried sharing the folder I wanted to copy with the other Google account but this didn't help. I couldn't find anything in the documentation that suggested this was necessary but it was hinted at in one of the forum posts.
Any help on this would be greatly appreciated.
thanks so much,
Tristan.