What is the problem you are having with rclone?
I'm trying to use bisync with Googledocs on googledrive and --drive-import-formats --drive-export-formats to do a 2 way conversion between MS formats on local and Googledoc formats on Googledrive
However this doesn't seem to work, with rclone getting confused with file extensions etc. An initial --resync works in either directions if you start with either local or google drive populated but any subsequent bisync without --resync fails
This may be a feature limitation or more likely me not understanding what options to use. Any help appreciated
The log file has 3 runs. 1st is with --resync. 2nd is without resync. 3rd is without resync after created 2 Googledocs on Googledrive. Hello world.docx and Sheet.xls get created on local as exports from Googledrive but the subsequent check-sync fails as the Googledocs don't have file extensions
Run the command 'rclone version' and share the full output of the command.
rclone v1.58.0
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.13.0-37-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.8
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone bisync --resync --drive-export-formats docx,xlsx,pptx,svg --drive-import-formats docx,xlsx,pptx,svg -vv --log-file=/home/admin/.config/rclone/googledrive_bisync.log /home/admin/Documents/Cloud_Storage/googledrive/bisync googledrive:
rclone bisync --drive-export-formats docx,xlsx,pptx,svg --drive-import-formats docx,xlsx,pptx,svg -vv --log-file=/home/admin/.config/rclone/googledrive_bisync.log /home/admin/Documents/Cloud_Storage/googledrive/bisync googledrive:
The rclone config contents with secrets removed.
[googledrive]
type = drive
client_secret = XYZ
token = {"access_token":"XYZ"}
client_id = XYZ
team_drive =
A log from the command with the -vv flag
2022/03/29 11:57:57 DEBUG : rclone: Version "v1.58.0" starting with parameters ["rclone" "bisync" "--resync" "--drive-export-formats" "docx,xlsx,pptx,svg" "--drive-import-formats" "docx,xlsx,pptx,svg" "-vv" "--log-file=/home/admin/.config/rclone/googledrive_bisync.log" "/home/admin/Documents/Cloud_Storage/googledrive/bisync" "googledrive:"]
2022/03/29 11:57:57 DEBUG : Creating backend with remote "/home/admin/Documents/Cloud_Storage/googledrive/bisync"
2022/03/29 11:57:57 DEBUG : Using config file from "/home/admin/.config/rclone/rclone.conf"
2022/03/29 11:57:57 DEBUG : Creating backend with remote "googledrive:"
2022/03/29 11:57:57 DEBUG : googledrive: detected overridden config - adding "{N0Krr}" suffix to name
2022/03/29 11:57:57 DEBUG : Google drive root '': 'root_folder_id = XYZ' - save this in the config to speed up startup
2022/03/29 11:57:57 DEBUG : fs cache: renaming cache item "googledrive:" to be canonical "googledrive{N0Krr}:"
2022/03/29 11:57:57 NOTICE: bisync is EXPERIMENTAL. Don't use in production!
2022/03/29 11:57:57 DEBUG : Lock file created: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.lck
2022/03/29 11:57:57 INFO : Synching Path1 "/home/admin/Documents/Cloud_Storage/googledrive/bisync/" with Path2 "googledrive{N0Krr}:/"
2022/03/29 11:57:57 INFO : Copying unique Path2 files to Path1
2022/03/29 11:57:58 INFO : Resynching Path1 to Path2
2022/03/29 11:57:58 DEBUG : Google drive root '': Waiting for checks to finish
2022/03/29 11:57:58 DEBUG : Google drive root '': Waiting for transfers to finish
2022/03/29 11:57:59 DEBUG : test1.txt: md5 = 3e7705498e8be60520841409ebc69bc1 OK
2022/03/29 11:57:59 INFO : test1.txt: Copied (new)
2022/03/29 11:57:59 DEBUG : test2.txt: md5 = 126a8a51b9d1bbd07fddc65819a542c3 OK
2022/03/29 11:57:59 INFO : test2.txt: Copied (new)
2022/03/29 11:57:59 DEBUG : Waiting for deletions to finish
2022/03/29 11:57:59 INFO : Resync updating listings
2022/03/29 11:58:00 DEBUG : Lock file removed: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.lck
2022/03/29 11:58:00 INFO : Bisync successful
2022/03/29 11:58:00 INFO :
Transferred: 12 B / 12 B, 100%, 11 B/s, ETA 0s
Transferred: 2 / 2, 100%
Elapsed time: 3.1s
2022/03/29 11:58:00 DEBUG : 9 go routines active
2022/03/29 11:58:26 DEBUG : rclone: Version "v1.58.0" starting with parameters ["rclone" "bisync" "--drive-export-formats" "docx,xlsx,pptx,svg" "--drive-import-formats" "docx,xlsx,pptx,svg" "-vv" "--log-file=/home/admin/.config/rclone/googledrive_bisync.log" "/home/admin/Documents/Cloud_Storage/googledrive/bisync" "googledrive:"]
2022/03/29 11:58:26 DEBUG : Creating backend with remote "/home/admin/Documents/Cloud_Storage/googledrive/bisync"
2022/03/29 11:58:26 DEBUG : Using config file from "/home/admin/.config/rclone/rclone.conf"
2022/03/29 11:58:26 DEBUG : Creating backend with remote "googledrive:"
2022/03/29 11:58:26 DEBUG : googledrive: detected overridden config - adding "{N0Krr}" suffix to name
2022/03/29 11:58:27 DEBUG : Google drive root '': 'root_folder_id = XYZ' - save this in the config to speed up startup
2022/03/29 11:58:27 DEBUG : fs cache: renaming cache item "googledrive:" to be canonical "googledrive{N0Krr}:"
2022/03/29 11:58:27 NOTICE: bisync is EXPERIMENTAL. Don't use in production!
2022/03/29 11:58:27 DEBUG : Lock file created: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.lck
2022/03/29 11:58:27 INFO : Synching Path1 "/home/admin/Documents/Cloud_Storage/googledrive/bisync/" with Path2 "googledrive{N0Krr}:/"
2022/03/29 11:58:27 INFO : Path1 checking for diffs
2022/03/29 11:58:27 INFO : Path2 checking for diffs
2022/03/29 11:58:27 INFO : No changes found
2022/03/29 11:58:27 INFO : Updating listings
2022/03/29 11:58:27 INFO : Validating listings for Path1 "/home/admin/Documents/Cloud_Storage/googledrive/bisync/" vs Path2 "googledrive{N0Krr}:/"
2022/03/29 11:58:27 DEBUG : Lock file removed: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.lck
2022/03/29 11:58:27 INFO : Bisync successful
2022/03/29 11:58:27 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Elapsed time: 1.0s
2022/03/29 11:58:27 DEBUG : 6 go routines active
2022/03/29 12:00:08 DEBUG : rclone: Version "v1.58.0" starting with parameters ["rclone" "bisync" "--drive-export-formats" "docx,xlsx,pptx,svg" "--drive-import-formats" "docx,xlsx,pptx,svg" "-vv" "--log-file=/home/admin/.config/rclone/googledrive_bisync.log" "/home/admin/Documents/Cloud_Storage/googledrive/bisync" "googledrive:"]
2022/03/29 12:00:08 DEBUG : Creating backend with remote "/home/admin/Documents/Cloud_Storage/googledrive/bisync"
2022/03/29 12:00:08 DEBUG : Using config file from "/home/admin/.config/rclone/rclone.conf"
2022/03/29 12:00:08 DEBUG : Creating backend with remote "googledrive:"
2022/03/29 12:00:08 DEBUG : googledrive: detected overridden config - adding "{N0Krr}" suffix to name
2022/03/29 12:00:08 DEBUG : Google drive root '': 'root_folder_id = XYZ' - save this in the config to speed up startup
2022/03/29 12:00:08 DEBUG : fs cache: renaming cache item "googledrive:" to be canonical "googledrive{N0Krr}:"
2022/03/29 12:00:08 NOTICE: bisync is EXPERIMENTAL. Don't use in production!
2022/03/29 12:00:08 DEBUG : Lock file created: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.lck
2022/03/29 12:00:08 INFO : Synching Path1 "/home/admin/Documents/Cloud_Storage/googledrive/bisync/" with Path2 "googledrive{N0Krr}:/"
2022/03/29 12:00:08 INFO : Path1 checking for diffs
2022/03/29 12:00:08 INFO : Path2 checking for diffs
2022/03/29 12:00:09 INFO : - Path2 File is new - Sheet.xlsx
2022/03/29 12:00:09 INFO : - Path2 File is new - Hello world.docx
2022/03/29 12:00:09 INFO : Path2: 2 changes: 2 new, 0 newer, 0 older, 0 deleted
2022/03/29 12:00:09 INFO : Applying changes
2022/03/29 12:00:09 INFO : - Path2 Queue copy to Path1 - /home/admin/Documents/Cloud_Storage/googledrive/bisync/Hello world.docx
2022/03/29 12:00:09 INFO : - Path2 Queue copy to Path1 - /home/admin/Documents/Cloud_Storage/googledrive/bisync/Sheet.xlsx
2022/03/29 12:00:09 INFO : - Path2 Do queued copies to - Path1
2022/03/29 12:00:09 DEBUG : test2.txt: Excluded
2022/03/29 12:00:09 DEBUG : test1.txt: Excluded
2022/03/29 12:00:09 DEBUG : test2.txt: Excluded
2022/03/29 12:00:09 DEBUG : test1.txt: Excluded
2022/03/29 12:00:09 DEBUG : Local file system at /home/admin/Documents/Cloud_Storage/googledrive/bisync: Waiting for checks to finish
2022/03/29 12:00:09 DEBUG : Local file system at /home/admin/Documents/Cloud_Storage/googledrive/bisync: Waiting for transfers to finish
2022/03/29 12:00:10 DEBUG : Local file system at /home/admin/Documents/Cloud_Storage/googledrive/bisync: File to upload is small (4680 bytes), uploading instead of streaming
2022/03/29 12:00:10 DEBUG : Sheet.xlsx: md5 = f9c04f18a71bc72be60223402584654e OK
2022/03/29 12:00:10 INFO : Sheet.xlsx: Copied (new)
2022/03/29 12:00:10 DEBUG : Sheet.xlsx: Updating size of doc after download to 4680
2022/03/29 12:00:10 INFO : Sheet.xlsx: Copied (Rcat, new)
2022/03/29 12:00:10 DEBUG : Local file system at /home/admin/Documents/Cloud_Storage/googledrive/bisync: File to upload is small (6123 bytes), uploading instead of streaming
2022/03/29 12:00:10 DEBUG : Hello world.docx: md5 = 8fcb9893146f609ecd071730db663207 OK
2022/03/29 12:00:10 INFO : Hello world.docx: Copied (new)
2022/03/29 12:00:10 DEBUG : Hello world.docx: Updating size of doc after download to 6123
2022/03/29 12:00:10 INFO : Hello world.docx: Copied (Rcat, new)
2022/03/29 12:00:10 INFO : Updating listings
2022/03/29 12:00:10 INFO : Validating listings for Path1 "/home/admin/Documents/Cloud_Storage/googledrive/bisync/" vs Path2 "googledrive{N0Krr}:/"
2022/03/29 12:00:10 NOTICE: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.path2.lst: Ignoring incorrect line: "- -1 - - 2022-03-29T10:59:46.969000000+0000 \"Sheet.xlsx\""
2022/03/29 12:00:10 NOTICE: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.path2.lst: Ignoring incorrect line: "- -1 - - 2022-03-29T10:59:06.123000000+0000 \"Hello world.docx\""
2022/03/29 12:00:10 ERROR : - Path1 file not found in Path2 - Hello world.docx
2022/03/29 12:00:10 ERROR : - Path1 file not found in Path2 - Sheet.xlsx
2022/03/29 12:00:10 DEBUG : Lock file removed: /home/admin/.cache/rclone/bisync/home_admin_Documents_Cloud_Storage_googledrive_bisync..googledrive{N0Krr}_.lck
2022/03/29 12:00:10 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover
2022/03/29 12:00:10 ERROR : Bisync aborted. Must run --resync to recover.