Failed to synchronize Excel files

Suspected Bug
1

What is the problem you are having with rclone?

Synchronizing of Excel (xlsx) files to Microsoft Sharepoint via webdav dont work. Tranferred file appears to be uploaded, but after close connection and new connection opened there is transferred file missing.

More detailed:
From log file is obvious, that copying xlsx file to remote host somehow fails at point of "flush" and rclone deletes copied file because of the copied file has other size, than original one at local. Other type of files, such as plain text, PDF or ZIP files works well (but slow), that means, copying of these kind of files didnt delete them and they are straightly accessible and openable from remote host.

Note, that remote dir path contains spaces and could have also strange characters, like ä, ö. å, etc. (but that didnt affect e.g. plain text files synchronizing).

Corresponding part of logfile:

2019/11/28 09:16:18 DEBUG : path/to/remote/dir/: Create: name="excel_file.xlsx"
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/excel_file.xlsx: Open: flags=O_RDWR|O_CREATE|O_TRUNC
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/excel_file.xlsx(0xc0004b40c0): Opening cached copy with flags=O_RDWR|O_CREATE|O_TRUNC
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/excel_file.xlsx: >Open: fd=path/to/remote/dir/excel_file.xlsx (rw), err=
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/: >Create: node=path/to/remote/dir/excel_file.xlsx, handle=&{path/to/remote/dir/excel_file.xlsx (rw)}, err=
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/excel_file.xlsx: Attr:
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/excel_file.xlsx: >Attr: a=valid=1s ino=0 size=0 mode=-rw-rw-r--, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=0
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=131072
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=262144
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=393216
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=524288
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=655360
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=786432
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=917504
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1048576
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1179648
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1310720
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1441792
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1572864
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1703936
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1835008
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=1966080
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=2097152
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=2228224
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=2359296
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=2490368
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=2621440
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=2752512
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=2883584
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3014656
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3145728
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3276800
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3407872
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3538944
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3670016
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3801088
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=3932160
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4063232
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4194304
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4325376
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4456448
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4587520
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4718592
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4849664
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=4980736
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=5111808
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=131072, offset=5242880
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=131072, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Write: len=122045, offset=5373952
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Write: written=122045, err=
2019/11/28 09:16:18 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Flush:
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/excel_file.xlsx(0xc0004b40c0): close:
2019/11/28 09:16:18 DEBUG : path/to/remote/dir/excel_file.xlsx: Couldn't find file - need to transfer
2019/11/28 09:16:20 ERROR : path/to/remote/dir/excel_file.xlsx: corrupted on transfer: sizes differ 5495997 vs 5504168
2019/11/28 09:16:20 INFO : path/to/remote/dir/excel_file.xlsx: Removing failed copy
2019/11/28 09:16:21 ERROR : path/to/remote/dir/excel_file.xlsx(0xc0004b40c0): failed to transfer file from cache to remote: corrupted on transfer: sizes differ 5495997 vs 5504168
2019/11/28 09:16:21 DEBUG : path/to/remote/dir/excel_file.xlsx(0xc0004b40c0): >close: err=failed to transfer file from cache to remote: corrupted on transfer: sizes differ 5495997 vs 5504168
2019/11/28 09:16:21 ERROR : path/to/remote/dir/excel_file.xlsx(0xc0004b40c0): RWFileHandle.Flush error: failed to transfer file from cache to remote: corrupted on transfer: sizes differ 5495997 vs 5504168
2019/11/28 09:16:21 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Flush: err=failed to transfer file from cache to remote: corrupted on transfer: sizes differ 5495997 vs 5504168
2019/11/28 09:16:21 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: Release:
2019/11/28 09:16:21 DEBUG : path/to/remote/dir/excel_file.xlsx(0xc0004b40c0): RWFileHandle.Release nothing to do
2019/11/28 09:16:21 DEBUG : &{path/to/remote/dir/excel_file.xlsx (rw)}: >Release: err=

What is your rclone version (output from rclone version)

rclone v1.44

  • os/arch: linux/amd64
  • go version: go1.11.1

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Linux Mint 19.1 Tessa
Kernel 4.15.0-20-generic
Architecture: x86_64

Which cloud storage system are you using? (eg Google Drive)

Microsoft Sharepoint via webdav access

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone --fast-list --vfs-cache-mode full mount sharepoint: /path/to/remote &

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

2019/11/28 10:22:46 DEBUG : rclone: Version "v1.44" starting with parameters ["rclone" "--vfs-cache-mode" "full" "mount" "sharepoint:" "/home/XXX/path/to/local/dir/" "-vv"]
2019/11/28 10:22:46 DEBUG : Using config file from "/home/XXX/.config/rclone/rclone.conf"
2019/11/28 10:22:49 DEBUG : webdav root '': Mounting on "/home/XXX/path/to/local/dir/"
2019/11/28 10:22:49 INFO : webdav root '': poll-interval is not supported by this remote
2019/11/28 10:22:49 DEBUG : vfs cache root is "/home/XXX/.cache/rclone/vfs/sharepoint"
2019/11/28 10:22:49 DEBUG : Adding path "vfs/forget" to remote control registry
2019/11/28 10:22:49 DEBUG : Adding path "vfs/refresh" to remote control registry
2019/11/28 10:22:49 DEBUG : Adding path "vfs/poll-interval" to remote control registry
2019/11/28 10:22:49 DEBUG : Cleaning the cache
2019/11/28 10:22:49 DEBUG : Delade dokument/Monitoring/Zero measurment/Kontrollobjekt_Import_Varbergstunneln-Ledningsomlaggning: updateTime: setting atime to 2019-11-28 09:52:50.782835998 +0100 CET
2019/11/28 10:22:49 DEBUG : : Root:
2019/11/28 10:22:49 DEBUG : : >Root: node=/, err=
2019/11/28 10:22:49 DEBUG : /: Lookup: name=".xdg-volume-info"
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: >Lookup: node=, err=no such file or directory
2019/11/28 10:22:49 DEBUG : /: Lookup: name="autorun.inf"
2019/11/28 10:22:49 DEBUG : /: >Lookup: node=, err=no such file or directory
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Lookup: name=".Trash"
2019/11/28 10:22:49 DEBUG : /: >Lookup: node=, err=no such file or directory
2019/11/28 10:22:49 DEBUG : /: Lookup: name=".Trash-1000"
2019/11/28 10:22:49 DEBUG : /: >Lookup: node=, err=no such file or directory
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Attr:
2019/11/28 10:22:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/11/28 10:22:49 DEBUG : /: ReadDirAll:
2019/11/28 10:22:49 DEBUG : /: >ReadDirAll: item=13, err=
2019/11/28 10:22:49 DEBUG : /: Lookup: name="autorun.inf"
2019/11/28 10:22:49 DEBUG : /: >Lookup: node=, err=no such file or directory
2019/11/28 10:22:58 DEBUG : rclone: Version "v1.44" finishing with parameters ["rclone" "--vfs-cache-mode" "full" "mount" "sharepoint:" "/home/XXX/path/to/local/dir/" "-vv"]

2

Sharepoint messes with excel files so when rclone uploads it it reads back as a different size so rclone deletes it...

See: https://rclone.org/webdav/#required-flags-for-sharepoint

You can use --ignore-size to skip the post copy size check. Though this will make rclone less reliable in general.

3

Thanks for quick response.

I have checked suggested solution and it works, so I was able to quickly solve my issue.

On another hand is neccessary to note, that with option --ignore-case is not possible to rewrite excel files already present at Sharepoint. There is neccessary to remove them from Sharepoint first and upload them again from local.

Thanks for help!

4

I wouldn't have thought --ignore-case would be doing that so I expect it will do it without it too...

What do you see in the log?

5

It tooks little time for opportunity to try it :slightly_smiling_face:

I am not exactly sure, what is going on, but if I try to rewrite straightforwardely xlsx file at Sharepoint, transaction seems successfull (no error message in DoubleCommander). But this corrupt the file at Sharepoint (proven also by access from Windows, where Excel pops "corrupted file" when opening -- but it opens the file (not sure, if old or new, that was done by my colleague)). From Libreoffice, straightforwardely opening Sharepoint file, it ends at import unknown data.

Corresponding part of log is attached, maybe it helps. Note, that I have only --ignore-case option, not all options mentioned in provided link.

(here was only lookups through folder tree)
2019/12/01 21:28:56 DEBUG : path/to/: Attr:
2019/12/01 21:28:56 DEBUG : path/to/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/12/01 21:28:56 DEBUG : path/to/: Lookup: name="sharepoint"
2019/12/01 21:28:56 DEBUG : path/to/: >Lookup: node=path/to/sharepoint/, err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/: Attr:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/12/01 21:28:56 DEBUG : : Statfs:
2019/12/01 21:28:56 DEBUG : : >Statfs: stat={Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/: Lookup: name="file.xlsx"
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/: >Lookup: node=path/to/sharepoint/file.xlsx, err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Attr:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Attr: a=valid=1s ino=0 size=102165 mode=-rw-rw-r--, err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Open: flags=OpenReadWrite
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Open: flags=O_RDWR
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Open: fd=path/to/sharepoint/file.xlsx (rw), err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Open: fh=&{path/to/sharepoint/file.xlsx (rw)}, err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Setattr: a=Setattr [ID=0xfc Node=0x3 Uid=1000 Gid=1000 Pid=5263] size=0 handle=INVALID-0x0 lockowner
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Truncating 1 file handles
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx(0xc00013e9c0): Opening cached copy with flags=O_RDWR
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Setattr: err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Attr:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Attr: a=valid=1s ino=0 size=0 mode=-rw-rw-r--, err=
2019/12/01 21:28:56 DEBUG : &{path/to/sharepoint/file.xlsx (rw)}: Write: len=97709, offset=0
2019/12/01 21:28:56 DEBUG : &{path/to/sharepoint/file.xlsx (rw)}: >Write: written=97709, err=
2019/12/01 21:28:56 DEBUG : &{path/to/sharepoint/file.xlsx (rw)}: Flush:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx(0xc00013e9c0): close:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Sizes identical
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Unchanged skipping
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: transferred to remote
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx(0xc00013e9c0): >close: err=
2019/12/01 21:28:56 DEBUG : &{path/to/sharepoint/file.xlsx (rw)}: >Flush: err=
2019/12/01 21:28:56 DEBUG : &{path/to/sharepoint/file.xlsx (rw)}: Release:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx(0xc00013e9c0): RWFileHandle.Release nothing to do
2019/12/01 21:28:56 DEBUG : &{path/to/sharepoint/file.xlsx (rw)}: >Release: err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Setattr: a=Setattr [ID=0x100 Node=0x3 Uid=1000 Gid=1000 Pid=5263] atime=2019-12-01 21:19:50 +0100 CET mtime=2019-12-01 21:17:42 +0100 CET handle=INVALID-0x0
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Setattr: err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Attr:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Attr: a=valid=1s ino=0 size=102165 mode=-rw-rw-r--, err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Setattr: a=Setattr [ID=0x101 Node=0x3 Uid=1000 Gid=1000 Pid=5263] mode=-rw-rw-r-- handle=INVALID-0x0
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Setattr: err=
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: Attr:
2019/12/01 21:28:56 DEBUG : path/to/sharepoint/file.xlsx: >Attr: a=valid=1s ino=0 size=102165 mode=-rw-rw-r--, err=
2019/12/01 21:29:09 DEBUG : /: Lookup: name="path"
2019/12/01 21:29:09 DEBUG : /: >Lookup: node=path/, err=
2019/12/01 21:29:09 DEBUG : path/: Attr:
2019/12/01 21:29:09 DEBUG : path/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/12/01 21:29:09 DEBUG : /: Lookup: name="path"
2019/12/01 21:29:09 DEBUG : /: >Lookup: node=path/, err=
2019/12/01 21:29:09 DEBUG : path/: Attr:
2019/12/01 21:29:09 DEBUG : path/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/12/01 21:29:09 DEBUG : path/: Lookup: name="to"
2019/12/01 21:29:09 DEBUG : path/: >Lookup: node=path/to/, err=
2019/12/01 21:29:09 DEBUG : path/to/: Attr:
2019/12/01 21:29:09 DEBUG : path/to/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/12/01 21:29:09 DEBUG : path/to/: Lookup: name="sharepoint"
2019/12/01 21:29:09 DEBUG : path/to/: >Lookup: node=path/to/sharepoint/, err=
2019/12/01 21:29:09 DEBUG : path/to/sharepoint/: Attr:
2019/12/01 21:29:09 DEBUG : path/to/sharepoint/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=
2019/12/01 21:29:09 DEBUG : : Statfs:
2019/12/01 21:29:09 DEBUG : : >Statfs: stat={Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/12/01 21:29:11 DEBUG : rclone: Version "v1.44" finishing with parameters ["rclone" "--log-file" "rclone.log" "--log-level" "DEBUG" "--fast-list" "--ignore-size" "--vfs-cache-mode" "full" "mount" "sharepoint:" "/path/to/local/folder"]

6

Hmm, thanks for that. I'm not 100% sure what is going on there but from the log it all looked successful. I wonder if rclone is managing to confuse sharepoint somehow.

It might be worth looking for the file in the cache directory on your computer to see if it is OK or not. If you do rclone help flags cache-dir you can see the default of where the cache directory is.

7

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.