What is the problem you are having with rclone?
I copy files to a Google Drive folder, I see in the logs the files are copied. Then a little later when I use the copy command to copy to local, rclone does not see the files. This occurs occasionally.
Run the command 'rclone version' and share the full output of the command.
rclone v1.68.1
- os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
- os/kernel: 10.0.19045.5131 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.23.1
- go/linking: static
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone: Version "v1.68.1" starting with parameters ["C:\\Windows\\system32\\rclone.exe" "copy" "drive:/path/to/folder/" "C:/path/to/folder/" "--include" "*.ext" "-vv" "--log-file=c:/path/to/log/file"]
The rclone config contents with secrets removed.
"drive": {
"root_folder_id": "",
"scope": "drive",
"service_account_file": "c:/path/to/file",
"team_drive": "drive_id",
"token": "...",
"type": "drive"
},
A log from the command with the -vv flag
2024/11/24 21:39:05 DEBUG : rclone: Version "v1.68.1" starting with parameters ["C:\\Windows\\system32\\rclone.exe" "copy" "gautomation:/Harman/in/insdes/" "C:/Users/Administrator/projects-data/harman/in/insdes/" "--include" "*.INSDES" "-vv" "--log-file=C:\\Users\\Administrator/projects-data/harman/logs/harman.log"]
2024/11/24 21:39:05 DEBUG : Creating backend with remote "gautomation:/Harman/in/insdes/"
2024/11/24 21:39:05 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2024/11/24 21:39:07 DEBUG : fs cache: renaming cache item "gautomation:/Harman/in/insdes/" to be canonical "gautomation:Harman/in/insdes"
2024/11/24 21:39:07 DEBUG : Creating backend with remote "C:/Users/Administrator/projects-data/harman/in/insdes/"
2024/11/24 21:39:07 DEBUG : fs cache: renaming cache item "C:/Users/Administrator/projects-data/harman/in/insdes/" to be canonical "//?/C:/Users/Administrator/projects-data/harman/in/insdes"
2024/11/24 21:39:07 DEBUG : Local file system at //?/C:/Users/Administrator/projects-data/harman/in/insdes: Waiting for checks to finish
2024/11/24 21:39:07 DEBUG : Local file system at //?/C:/Users/Administrator/projects-data/harman/in/insdes: Waiting for transfers to finish
2024/11/24 21:39:07 INFO : There was nothing to transfer
2024/11/24 21:39:07 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Elapsed time: 1.9s
2024/11/24 21:39:07 DEBUG : 6 go routines active
2024-11-24 21:39:07 - copy operation completed successfully.
*a few minutes before files were copied to the source location, these were not removed. rclone does not see the files*
2024/11/24 21:38:53 DEBUG : rclone: Version "v1.68.1" starting with parameters ["C:\\Windows\\system32\\rclone.exe" "move" "harmansftp:/Deonet/out_INSDES/" "gautomation:/Harman/in/insdes/" "--exclude" "archive/**" "-vv" "--log-file=C:\\Users\\Administrator/projects-data/harman/logs/harman.log"]
2024/11/24 21:38:53 DEBUG : Creating backend with remote "harmansftp:/Deonet/out_INSDES/"
2024/11/24 21:38:53 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2024/11/24 21:38:55 DEBUG : sftp://svc_deonet@wsftp-am.harman.com:3000//Deonet/out_INSDES/: New connection 192.168.17.181:54568->199.27.116.116:3000 to "SSH-2.0-VShell_4_9_0_3072 VShell"
2024/11/24 21:38:55 DEBUG : sftp://svc_deonet@wsftp-am.harman.com:3000//Deonet/out_INSDES/: Shell type "unix" from config
2024/11/24 21:38:55 DEBUG : sftp://svc_deonet@wsftp-am.harman.com:3000//Deonet/out_INSDES/: Using root directory "/Deonet/out_INSDES/"
2024/11/24 21:38:55 DEBUG : Creating backend with remote "gautomation:/Harman/in/insdes/"
2024/11/24 21:38:56 DEBUG : fs cache: renaming cache item "gautomation:/Harman/in/insdes/" to be canonical "gautomation:Harman/in/insdes"
2024/11/24 21:38:57 DEBUG : archive: Excluded
2024/11/24 21:38:57 DEBUG : JB-EM-06143017-1.INSDES: Need to transfer - File not found at Destination
2024/11/24 21:38:57 DEBUG : JB-EM-06143020-1.INSDES: Need to transfer - File not found at Destination
2024/11/24 21:38:57 DEBUG : Google drive root 'Harman/in/insdes': Waiting for checks to finish
2024/11/24 21:38:57 DEBUG : Google drive root 'Harman/in/insdes': Waiting for transfers to finish
2024/11/24 21:38:59 DEBUG : sftp://svc_deonet@wsftp-am.harman.com:3000//Deonet/out_INSDES/: New connection 192.168.17.181:54579->199.27.116.116:3000 to "SSH-2.0-VShell_4_9_0_3072 VShell"
2024/11/24 21:39:00 INFO : JB-EM-06143020-1.INSDES: Copied (new)
2024/11/24 21:39:00 INFO : JB-EM-06143020-1.INSDES: Deleted
2024/11/24 21:39:02 INFO : JB-EM-06143017-1.INSDES: Copied (new)
2024/11/24 21:39:02 INFO : JB-EM-06143017-1.INSDES: Deleted
2024/11/24 21:39:02 INFO :
Transferred: 1.969 KiB / 1.969 KiB, 100%, 403 B/s, ETA 0s
Checks: 2 / 2, 100%
Deleted: 2 (files), 0 (dirs), 1.969 KiB (freed)
Renamed: 2
Transferred: 2 / 2, 100%
Elapsed time: 9.6s
2024/11/24 21:39:02 DEBUG : 27 go routines active
2024/11/24 21:39:02 DEBUG : sftp://svc_deonet@wsftp-am.harman.com:3000//Deonet/out_INSDES/: Closing 2 unused connections
2024-11-24 21:39:03 - move operation completed successfully.