Rclone Mount: file is edited/updated locally, but not uploaded/replaced in remote

paschoaal_paschoaal · November 9, 2022, 2:47am

What is the problem you are having with rclone?

I am using Xubuntu 22.04; Rclone Version "v1.53.3-DEV" , and LibreOffice.
When I edit a file locally, and save it, the changes are correctly saved to /.cache... However, the corresponding file in the remote does not get updated.
This is the first time I create a topic. I apologize for any misplacement here.

Run the command 'rclone version' and share the full output of the command.

Which cloud storage system are you using? (eg Google Drive)

I am having the same issue with different systems. Google Drive, Onedrive Businness, Teams/Sharepoint and Dropbox. The example is on Sharepoint/Teams

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone mount -vv --vfs-cache-mode full Comeve-Prograd-TEAMS: /home/linus/Desktop/þchan@prograd_eventos/

The rclone config contents with secrets removed.

[Comeve-Prograd-TEAMS]
type = onedrive
token = {"access_token":" :grinning: :grinning: :grinning:}
drive_id = :grinning: :grinning: :grinning:
drive_type = documentLibrary

A log from the command with the `-vv` flag

linus@TORRE-2022:~$ rclone mount -vv --vfs-cache-mode full Comeve-Prograd-TEAMS: /home/linus/Desktop/þchan@prograd_eventos/
2022/11/08 23:22:30 DEBUG : rclone: Version "v1.53.3-DEV" starting with parameters ["rclone" "mount" "-vv" "--vfs-cache-mode" "full" "Comeve-Prograd-TEAMS:" "/home/linus/Desktop/þchan@prograd_eventos/"]
2022/11/08 23:22:30 DEBUG : Creating backend with remote "Comeve-Prograd-TEAMS:"
2022/11/08 23:22:30 DEBUG : Using config file from "/home/linus/.config/rclone/rclone.conf"
2022/11/08 23:22:31 INFO  : One drive root '': poll-interval is not supported by this remote
2022/11/08 23:22:31 DEBUG : vfs cache: root is "/home/linus/.cache/rclone/vfs/Comeve-Prograd-TEAMS"
2022/11/08 23:22:31 DEBUG : vfs cache: metadata root is "/home/linus/.cache/rclone/vfs/Comeve-Prograd-TEAMS"
2022/11/08 23:22:31 DEBUG : Creating backend with remote "/home/linus/.cache/rclone/vfs/Comeve-Prograd-TEAMS"
2022/11/08 23:22:31 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: truncate to size=14144
2022/11/08 23:22:31 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: setting modification time to 2022-11-08 23:16:57.860881397 -0300 -03
2022/11/08 23:22:31 INFO  : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: queuing for upload in 5s
2022/11/08 23:22:32 DEBUG : Eventos-PROGRAD/testes: Added virtual directory entry vAdd: "criado_em_cima.docx"
2022/11/08 23:22:32 DEBUG : Fotos-PROGRAD: Removing directory
2022/11/08 23:22:32 DEBUG : One drive root '': Mounting on "/home/linus/Desktop/þchan@prograd_eventos/"
2022/11/08 23:22:32 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item Eventos-PROGRAD/testes/criado_em_cima.docx not removed, freed 0 bytes
2022/11/08 23:22:32 INFO  : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 13.812k (was 13.812k)
2022/11/08 23:22:32 DEBUG : : Root: 
2022/11/08 23:22:32 DEBUG : : >Root: node=/, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Lookup: name=".xdg-volume-info"
2022/11/08 23:22:32 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Lookup: name="autorun.inf"
2022/11/08 23:22:32 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Lookup: name=".Trash"
2022/11/08 23:22:32 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Lookup: name=".Trash-1000"
2022/11/08 23:22:32 DEBUG : /: >Lookup: node=.Trash-1000/, err=<nil>
2022/11/08 23:22:32 DEBUG : .Trash-1000/: Attr: 
2022/11/08 23:22:32 DEBUG : .Trash-1000/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : .Trash-1000/: Lookup: name="files"
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : .Trash-1000/: >Lookup: node=.Trash-1000/files/, err=<nil>
2022/11/08 23:22:32 DEBUG : .Trash-1000/files/: Attr: 
2022/11/08 23:22:32 DEBUG : .Trash-1000/files/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : .Trash-1000/files/: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Attr: 
2022/11/08 23:22:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:32 DEBUG : /: ReadDirAll: 
2022/11/08 23:22:32 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/11/08 23:22:32 DEBUG : /: Lookup: name="autorun.inf"
2022/11/08 23:22:32 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/11/08 23:22:33 DEBUG : .Trash-1000/files/: >ReadDirAll: item=1, err=<nil>
2022/11/08 23:22:33 DEBUG : .Trash-1000/: Lookup: name="info"
2022/11/08 23:22:33 DEBUG : .Trash-1000/: >Lookup: node=.Trash-1000/info/, err=<nil>
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/: Attr: 
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/: Lookup: name="novo.docx.trashinfo"
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/: >Lookup: node=.Trash-1000/info/novo.docx.trashinfo, err=<nil>
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: Attr: 
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: >Attr: a=valid=1s ino=0 size=92 mode=-rw-rw-r--, err=<nil>
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: Open: flags=OpenReadOnly
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: Open: flags=O_RDONLY
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: newRWFileHandle: 
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: >newRWFileHandle: err=<nil>
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: >Open: fd=.Trash-1000/info/novo.docx.trashinfo (rw), err=<nil>
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: >Open: fh=&{.Trash-1000/info/novo.docx.trashinfo (rw)}, err=<nil>
2022/11/08 23:22:33 DEBUG : &{.Trash-1000/info/novo.docx.trashinfo (rw)}: Read: len=4096, offset=0
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): _readAt: size=4096, off=0
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): openPending: 
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: vfs cache: checking remote fingerprint "92,2022-11-07 15:21:21 +0000 UTC,4d53336b0c579cc668e100ec7e438a1f0638cc2f" against cached fingerprint ""
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: vfs cache: truncate to size=92
2022/11/08 23:22:33 DEBUG : .Trash-1000/info: Added virtual directory entry vAdd: "novo.docx.trashinfo"
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): >openPending: err=<nil>
2022/11/08 23:22:33 DEBUG : vfs cache: looking for range={Pos:0 Size:92} in [] - present false
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: ChunkedReader.RangeSeek from -1 to 0 length -1
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728
2022/11/08 23:22:33 DEBUG : .Trash-1000/info/novo.docx.trashinfo: ChunkedReader.openRange at 0 length 134217728
2022/11/08 23:22:34 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): >_readAt: n=92, err=EOF
2022/11/08 23:22:34 DEBUG : &{.Trash-1000/info/novo.docx.trashinfo (rw)}: >Read: read=92, err=<nil>
2022/11/08 23:22:34 DEBUG : &{.Trash-1000/info/novo.docx.trashinfo (rw)}: Flush: 
2022/11/08 23:22:34 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): RWFileHandle.Flush
2022/11/08 23:22:34 DEBUG : &{.Trash-1000/info/novo.docx.trashinfo (rw)}: >Flush: err=<nil>
2022/11/08 23:22:34 DEBUG : &{.Trash-1000/info/novo.docx.trashinfo (rw)}: Release: 
2022/11/08 23:22:34 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): RWFileHandle.Release
2022/11/08 23:22:34 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): close: 
2022/11/08 23:22:34 DEBUG : .Trash-1000/info/novo.docx.trashinfo: vfs cache: setting modification time to 2022-11-07 15:21:21 +0000 UTC
2022/11/08 23:22:34 DEBUG : .Trash-1000/info/novo.docx.trashinfo(0xc000889300): >close: err=<nil>
2022/11/08 23:22:34 DEBUG : &{.Trash-1000/info/novo.docx.trashinfo (rw)}: >Release: err=<nil>
2022/11/08 23:22:34 DEBUG : /: Lookup: name=".Trash-1000"
2022/11/08 23:22:34 DEBUG : /: >Lookup: node=.Trash-1000/, err=<nil>
2022/11/08 23:22:34 DEBUG : .Trash-1000/: Attr: 
2022/11/08 23:22:34 DEBUG : .Trash-1000/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:34 DEBUG : .Trash-1000/: Lookup: name="files"
2022/11/08 23:22:34 DEBUG : .Trash-1000/: >Lookup: node=.Trash-1000/files/, err=<nil>
2022/11/08 23:22:34 DEBUG : .Trash-1000/files/: Attr: 
2022/11/08 23:22:34 DEBUG : .Trash-1000/files/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/11/08 23:22:34 DEBUG : .Trash-1000/files/: Lookup: name="novo.docx"
2022/11/08 23:22:34 DEBUG : .Trash-1000/files/: >Lookup: node=.Trash-1000/files/novo.docx, err=<nil>
2022/11/08 23:22:34 DEBUG : .Trash-1000/files/novo.docx: Attr: 
2022/11/08 23:22:34 DEBUG : .Trash-1000/files/novo.docx: >Attr: a=valid=1s ino=0 size=18190 mode=-rw-rw-r--, err=<nil>
2022/11/08 23:22:36 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: starting upload
2022/11/08 23:22:36 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: Starting multipart upload
2022/11/08 23:22:37 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: Uploading segment 0/14144 size 14144
2022/11/08 23:22:38 ERROR : Eventos-PROGRAD/testes/criado_em_cima.docx: corrupted on transfer: sizes differ 14144 vs 15045
2022/11/08 23:22:38 INFO  : Eventos-PROGRAD/testes/criado_em_cima.docx: Removing failed copy
2022/11/08 23:22:38 ERROR : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: corrupted on transfer: sizes differ 14144 vs 15045
2022/11/08 23:22:48 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: starting upload
2022/11/08 23:22:48 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: Starting multipart upload
2022/11/08 23:22:49 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: Uploading segment 0/14144 size 14144
2022/11/08 23:22:50 ERROR : Eventos-PROGRAD/testes/criado_em_cima.docx: corrupted on transfer: sizes differ 14144 vs 15045
2022/11/08 23:22:50 INFO  : Eventos-PROGRAD/testes/criado_em_cima.docx: Removing failed copy
2022/11/08 23:22:50 ERROR : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: failed to upload try #2, will retry in 20s: vfs cache: failed to transfer file from cache to remote: corrupted on transfer: sizes differ 14144 vs 15045
2022/11/08 23:23:10 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: starting upload
2022/11/08 23:23:10 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: Starting multipart upload
2022/11/08 23:23:11 DEBUG : Eventos-PROGRAD/testes/criado_em_cima.docx: Uploading segment 0/14144 size 14144
2022/11/08 23:23:12 ERROR : Eventos-PROGRAD/testes/criado_em_cima.docx: corrupted on transfer: sizes differ 14144 vs 15045
2022/11/08 23:23:12 INFO  : Eventos-PROGRAD/testes/criado_em_cima.docx: Removing failed copy
2022/11/08 23:23:12 ERROR : Eventos-PROGRAD/testes/criado_em_cima.docx: vfs cache: failed to upload try #3, will retry in 40s: vfs cache: failed to transfer file from cache to remote: corrupted on transfer: sizes differ 14144 vs 15045
^C2022/11/08 23:23:21 INFO  : Signal received: interrupt
2022/11/08 23:23:21 DEBUG : vfs cache: cleaner exiting
2022/11/08 23:23:21 INFO  : Exiting...
linus@TORRE-2022:~$ rclone --version

Animosity022 · November 9, 2022, 2:50am

That’s an ancient version. You’d want to upgrade and test again.

Animosity022 · November 9, 2022, 4:04am

And check out:

That has some tips on the error there as well.

paschoaal_paschoaal · November 10, 2022, 2:38am

Hello. Thanks for replying.

I updated Rclone to version 1.60.0
this seems to have solved issues in Google Drive remote

I read the featured article for OneDrive and applied several extra flags, as suggested to the known issues described in the bottom of the article:
----Unexpected file size/hash differences on Sharepoint
----Replacing/deleting existing files on Sharepoint gets "item not found

In Sharepoint/Teams, the situation stays the same:

create a "test.docx" in the remote, via Microsoft Teams Web interface
open and add a line to "test.docx" in vfs mode, via Thunar and LibreOffice.
Save changes
go back to Microsoft Teams Web and... nothing is changed.

I will paste the new command and terminal

====command
rclone mount -vv --vfs-cache-mode full --backup-dir comeve_TEAMS:rclone-backup-dir --ignore-checksum --ignore-size comeve_TEAMS: /home/linus/Desktop/þchan@prograd_eventos/

====terminal

====
I am sort of begginer. I have been installing and using Linux for a long time, but I never developed skills.

Rclone is a big interest of mine, it could be the solution to my biggest linus drawback. Linux does not have official clients for important cloud services such as Microsoft and Google.
In my work, I have to monitor folders and files, and do collaborative work on different clouds, so it's a bit tiresome to always be changing from a website to another, never being used to the same interface. All I wanted was to control everything from my desktop filebrowser and office applications.

Please help.

I hope I have placed my request in good order.

Thanks in advance.

paschoaal_paschoaal · November 10, 2022, 12:07pm

EDIT:

what really happens is a bit different:

go "upstairs" and create a test.docx in the remote, via Microsoft Teams Web interface
go "downstairs", open and add a line to test.docx via Rclone (mount), Thunar and LibreOffice.
Save changes
go back to Microsoft Teams Web: the line that was added downstairs IS VISIBLE upstairs.
OK BUT...
go back downstairs, try to open again, Libreoffice says file is corrupt!

I cannot understand, by the terminal info what is really happening

Ole · November 10, 2022, 1:29pm

Many things could have happened here and the corruption error reported by LibreOffice may not be related to rclone. It could also be Microsoft Teams Web modifying the file during upload/download and thereby cauinsing issues to LibreOffice.

I there suggest you try this better understand what is happening:

create a new local testfolder somewhere outside your mount
copy the file you see in the mount (downstairs) to the testfolder and call it test_mount.docx
download the same file from Microsoft Teams Web (upstairs) to the testfolder and call it test_web.docx

then post the output of these two commands:

rclone lsl /path/to/local/testfolder
rclone sha1sum /path/to/local/testfolder

and finally try if Libreoffice can open both files

I also suggest you try this:

go "upstairs" and create a test2.docx in the remote, via Microsoft Teams Web interface
download the file to the local testfolder using Microsoft Teams Web
open and add a line to test2.docx with LibreOffice.
Save changes as test2.docx
make a copy of test2.docx and call it test2_before_upload.docx (both files in the local testfolder)
upload the test2.docx using Microsoft Teams Web
download test2.docx to the local testfolder using Microsoft Teams Web

then post the output of these two commands:

rclone lsl /path/to/local/testfolder
rclone sha1sum /path/to/local/testfolder

and finally try if Libreoffice can open both test2.docx and test2_before_upload.docx

paschoaal_paschoaal · November 11, 2022, 4:33pm

Thanks.
I will perform these tests and submit here soon.

paschoaal_paschoaal · November 14, 2022, 10:16pm

Hi again

I was not able to perform the test exactly as proposed

I also suggest you try this:

go "upstairs" and create a test2.docx in the remote, via Microsoft Teams Web interface

download the file to the local testfolder using Microsoft Teams Web

open and add a line to test2.docx with LibreOffice.

Save changes as test2.docx

make a copy of test2.docx and call it test2_before_upload.docx (both files in the local testfolder)

upload the test2.docx using Microsoft Teams Web

download test2.docx to the local testfolder using Microsoft Teams Web

I started with the same mount command:

rclone mount -vv --vfs-cache-mode full --backup-dir comeve_TEAMS:rclone-backup-dir --ignore-checksum --ignore-size comeve_TEAMS:Eventos-Prograd /home/linus/Desktop/þchan@prograd_eventos/

Upstairs
(using same remote via Teams and Sharepoint)

The REMOTE has a folder called 'testes'

via Teams Web: created file "teams_test.docx" in folder (remote):testes
via Sharepoint Web: created file called "sharepoitnt_test" in the same folder

Downstairs
(using same mount with LibreOffice and WPS)

FILES CREATED "upstairs" DO NOT APPEAR IN THE MOUNT
(I don't know why. I will post terminal output. Maybe it says there)

in LibreOffice: created file "libre.docx" in folder (local_drive):testes
in WPS: created file called "wps_test" in the same folder

Upstairs

FILES CREATED 'downstairs' are visible and editable in the remote, both in Teams and Sharepoint
I open them in Teams and add a line saying "teams". I open them in Sharepoint and add a line saying "sharepoint"

Downstairs

In LibreOffice:
FIles edited in Teams and Sharepoint are now Corrupt and cannot be recovered, cannot open

In WPS:
Files edited in Teams and Sharepoint behave oddly

the one created in Libre opens dialogue "open as read-only". click Yes, but it crashes. cannot open
the one created in WPS opens to previous version. None of the updates - "teams" or "sharepoint" - made upstairs. I add a line saying "wps" and save it, anyway

Upstairs

In Teams and Sharepoint

file created in Libre is there, unchanged
it says: "teams" and "sharepoint"
file created in WPS has been
it says: "wps"

the command for the mount

rclone mount -vv --vfs-cache-mode full --backup-dir comeve_TEAMS:rclone-backup-dir --ignore-checksum --ignore-size comeve_TEAMS:Eventos-Prograd /home/linus/Desktop/þchan@prograd_eventos/

the output from terminal

paschoaal_paschoaal · November 14, 2022, 10:31pm

I did another test, now with a simple ".jpg" file.

I did a print screen with Shutter.

Upstairs
I uploaded it directly to the REMOTE folder

Downstairs
The Mount folder immediately showed it. I opened and edited it with a hand brush: "downstairs".

Upstairs
The file had been updated. It said "downstairs" (OK!). I added another hand brush "upstairs".

Downstairs
Latest edits are not reflected

Conclusion
If we have the mount. Create a file upstairs. Then go downstairs, open and edit: OK. Then go back upstairs, open and edit: OK. Then go back again downstairs: not updated (BAD).
If we go back and forth, it will fail somewhere.
Office files, both in WPS or Libre
Jpg files too.

For that reason I could not perform the test as told.

Thanks all.

Animosity022 · November 15, 2022, 4:10am

The log file is only 5 seconds so I'm guessing that's just a snippet as you hit control c after 5 seconds so that's probably why you didn't see anything in the mount as it wasn't running.

^C2022/11/14 18:41:17 INFO  : Signal received: interrupt
2022/11/14 18:41:17 DEBUG : vfs cache: cleaner exiting
2022/11/14 18:41:17 ERROR : /home/linus/Desktop/þchan@prograd_eventos/: Unmounted rclone mount
2022/11/14 18:41:17 INFO  : Exiting...
linus@TORRE-2022:~/Desktop/local_test_folder$ D

Ole · November 15, 2022, 9:10am

Your conclusion is mistaken
1) because you didn't follow/understand the steps in my suggestions
2) you keep confusing yourself by performing additional tests based on mistaken assumptions/understandings.

I therefore suggest we take it in smaller steps and focus on one thing at the time, starting with the corruption issue you reported here 5 days ago.

Please perform the below and post the output from the execution the two rclone commands:

Ole:

I there suggest you try this better understand what is happening:

create a new local testfolder somewhere outside your mount

copy the file you see in the mount (downstairs) to the testfolder and call it test_mount.docx

download the same file from Microsoft Teams Web (upstairs) to the testfolder and call it test_web.docx

then post the output of these two commands:
rclone lsl /path/to/local/testfolder
rclone sha1sum /path/to/local/testfolder
and finally try if Libreoffice can open both files

Please let me know if in doubt or trouble, then I can help you step by step.

paschoaal_paschoaal · November 15, 2022, 11:27pm

Hello again.
About the terminal output: this 5 second short one was not the one I meant to send. I mistook it.
About the tests: indeed, at first I thought the situation presented was different. And so the same test would not apply.

I will get to it, and follow the instructions.

thanks

paschoaal_paschoaal · November 16, 2022, 12:23am

I followed the instructions

created a "local_test_folder" in my Desktop, outside the mount
there was a test file created "upstairs" in the mount, I copied to the local_test_folder, renamed it "test_mount"
then I downloaded directly from Teams Web to the local_test_folder, renamed it "test_web"
output for the commands are pasted below
(I also did the second test as instructed, and output is also below)

lin****************:~$ rclone lsl /home/linus/Desktop/local_test_folder/
    14144 2022-11-15 20:47:03.000000000 test_mount.docx
    18286 2022-11-15 23:56:00.000000000 test_web.docx
lin****************:~$ rclone sha1sum /home/linus/Desktop/local_test_folder/
88b4de5e22b4b11b0b55322148888be50da8787f  test_mount.docx
e43b057db2d2881d07bbaca0071d672c4ce387f2  test_web.docx
lin****************:~$ rclone lsl /home/linus/Desktop/local_test_folder/
    15073 2022-11-16 00:05:00.000000000 test2.docx
    14173 2022-11-15 21:04:05.261890000 test2_before_upload.docx
    14144 2022-11-15 20:47:03.000000000 test_mount.docx
    18286 2022-11-15 23:56:00.000000000 test_web.docx
lin****************:~$ rclone sha1sum /home/linus/Desktop/local_test_folder/
88b4de5e22b4b11b0b55322148888be50da8787f  test_mount.docx
0a65f10d46f63e318d30e07cb2f5f03153f35733  test2_before_upload.docx
0dac581328a680dff7ad7f66861fc7d204407977  test2.docx
e43b057db2d2881d07bbaca0071d672c4ce387f2  test_web.docx
lin****************:~$

LibreOffice is able to open all files

====
PS: along these days, I have repeated these tests many times, maybe I did something different somewhere, but it seemed to me that I have seen two different behaviors...

file created upstairs is edited downstairs, changes are not reflected upstairs;
other times, changes are reflected upstairs, but after that, file is no longer readable by LibreOffice downstairs (corrupt).

This is why I did not follow the test instructions previously. I needed behavior 1) to go through with your instructions. When I first got to it, I faced behavior 2)... that caused the confusion.

Sorry for that.

Thanks again for the help

Ole · November 16, 2022, 7:43am

Perfect, this is the kind of information I was looking for.

The tests show that Microsoft Teams modifies document files on upload/download. Here is a very good example:

paschoaal_paschoaal:

lin****************:~$ rclone lsl /home/linus/Desktop/local_test_folder/
    15073 2022-11-16 00:05:00.000000000 test2.docx
    14173 2022-11-15 21:04:05.261890000 test2_before_upload.docx

It shows that the size of test2.docx was increased by 1100 bytes just by uploading and then downloading to/from the Microsoft Teams website.

These (unexpected and silent) changes are a known issue, as @Animosity022 pointed out initially. The issue is described here: https://rclone.org/onedrive/#unexpected-file-size-hash-differences-on-sharepoint

Here is some technical information: https://github.com/rclone/rclone/issues/399

These changes performed by Teams/SharePoint most likely challenges the behavior and robustness of both rclone and LibreOffice and therefore may be part of the explanation behind the issues you experience.

I am not sure it will help in your situation, but suggest you try adding --ignore-size to your mount command. Perhaps it helps.

paschoaal_paschoaal · November 16, 2022, 4:09pm

Hello. Thanks again for the help.

I did read the offical Onedrive article in rclone.org after original posting.

I mean: "--ignore-size" has been in the command since. As well as other suggested workarounds (ignore checksum, backup dir):

rclone mount -vv --vfs-cache-mode full --backup-dir comeve_TEAMS:rclone-backup-dir --ignore-checksum --ignore-size comeve_TEAMS: /home/linus/Desktop/þchan@prograd_eventos/

First instruction was to update rclone to website version (before, I was installing via synaptic in xUbuntu 22.04). That seemd to work for other remotes: Google Drive is working ok; Dropbox has been creating exra copies of files it regards as conflictive (but it is not data loss).

However issues in Onedrive Business and Teams/Sharepoint remained, with some variation in behavior. It is possible that this variation in behavior is due to my use of two methods: ideally, I like to use the GUI client "rclone-browser". But when problems started I reverted to command line method.

Do you think there is more that can be tried/tested?

Is there a way to set up a trustable operation involving:

Linux
Rclone Mount
VFS 'way of life": creating, renaming, moving, deleting... doing everything downstairs in the mount - having all updates have been reflecte upstairs in the remote

For me it would perfect. if I could handle all my clouds in the same environment, all via local file browser and programs. It would take off a big overload of my head, as I have to switch and re-adapt from one interface to another constantly.

Do you know if other have issues? Or better, if someone has it succesfully implemented?

Thanks again

system · December 16, 2022, 4:09pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.