RClone crash when uploding file to onerdive

What is the problem you are having with rclone?

Hi there,

My problem is very similar to Rclone crashes during upload - #4 by ncw

I use a onedrive mount and it crashes every time I try to copy files from the local drive to the mounted drive.

rclone copy git-log.txt d:\OneDrive-private\Documents\Home works fine.

What do I do wrong?

Thank you!

What is your rclone version (output from rclone version)

rclone v1.55.1

  • os/type: windows
  • os/arch: amd64
  • go/version: go1.16.3
  • go/linking: dynamic
  • go/tags: cmount

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Microsoft Windows [Version 10.0.19042.985]

winfsp-1.8.20304

(Also tried the winfsp-1.9.21096, same issue)

Which cloud storage system are you using? (eg Google Drive)

Ms OneDrive Personal

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone -vv mount "onedrive:" d:\OneDrive-private --config=%USERPROFILE%\.config\rclone\rclone.conf

The rclone config contents with secrets removed.

[onedrive]
type = onedrive
token = {"access_token":"the-token","expiry":"2021-06-07T22:44:43.5581861-04:00"}
drive_id = the-id
drive_type = personal

A log from the command with the -vv flag

For example: I try to copy git-log.txt from rclone to the mounted remote. See output in RClone crash on upload - Pastebin.com

hello and welcome to the forum,

not sure i understand what you wrote,

if d:\OneDrive-private is a rclone mount pointing to onedrive
and
rclone copy git-log.txt d:\OneDrive-private\Documents\Home works fine.
that would mean you are copying a file to onedrive without error using the mount.

using rclone copy to copy a file to a rclone mount, might not be a good idea.
why not just use rclone copy git-log.txt to onedrive:, without using the rclone mount as a middle man?

not sure why that error is happening, could be a damaged memory chip, might want to run a test using
what program are you using to copy the files, windows explorer or what?

https://www.memtest.org/

Hi,

Thank you for the answer.

I use Total Command to copy local files to the mounted onedrive. I never used rclone copy before, just wanted to try it - and it worked. Sadly, copying with TC or or Windows Explorer still crashes.

The PC cheks out, tested the memory (with Windows built-in, I can give it a try with memtest), CPU stress test with Prime95, GPU with an older 3DMark, nvme with crystaldiskmark. All is good.

I use rclone on other Windows, RPi, Ubuntu. All is good, but this one.

I also suspect that something is up either with the HW or with the SW (maybe both). This is a brand new HP Zbook G7.

Any help is highly appreciated.

Thank you!

It looks like a bug, yes.

Can you replicate this bug easily?

We've seen similar reports in the forum before.

The relevant part of the traceback is

unexpected fault address 0xffffffffffffffff
fatal error: fault
[signal 0xc0000005 code=0x0 addr=0xffffffffffffffff pc=0x40350e]
 
goroutine 17 [running, locked to thread]:
runtime.throw(0x1df5fc3, 0x5)
        runtime/panic.go:1117 +0x79 fp=0xc0007d7d08 sp=0xc0007d7cd8 pc=0x43d859
runtime.sigpanic()
        runtime/signal_windows.go:245 +0x2d6 fp=0xc0007d7d60 sp=0xc0007d7d08 pc=0x453796
indexbytebody(0x500000000000501, 0xaff, 0x470300, 0xc00006c300, 0xaff, 0x0, 0x500000000000501, 0x500000000000501, 0xaff, 0xc0007d7e08, ...)
        internal/bytealg/indexbyte_amd64.s:124 +0xce fp=0xc0007d7d68 sp=0xc0007d7d60 pc=0x40350e
runtime.findnull(0x500000000000501, 0xc0007d7e08)
        runtime/string.go:438 +0x87 fp=0xc0007d7dc0 sp=0xc0007d7d68 pc=0x458d67
runtime.gostring(0x500000000000501, 0xc0000ea8c0, 0xc00008e058)
        runtime/string.go:320 +0x36 fp=0xc0007d7e18 sp=0xc0007d7dc0 pc=0x471a56
github.com/billziss-gh/cgofuse/fuse._Cfunc_GoString(...)
        _cgo_gotypes.go:320
github.com/billziss-gh/cgofuse/fuse.c_GoString(...)
        github.com/billziss-gh/cgofuse@v1.5.0/fuse/host_cgo.go:708
github.com/billziss-gh/cgofuse/fuse.hostRelease(0x500000000000501, 0x2e86fc18, 0x0)
        github.com/billziss-gh/cgofuse@v1.5.0/fuse/host.go:284 +0x94 fp=0xc0007d7e78 sp=0xc0007d7e18 pc=0x17293b4
github.com/billziss-gh/cgofuse/fuse.go_hostRelease(...)
        github.com/billziss-gh/cgofuse@v1.5.0/fuse/host_cgo.go:926
_cgoexp_12ef5be0dd8c_go_hostRelease(0x2e86fb80)
        _cgo_gotypes.go:768 +0x3e fp=0xc0007d7ea0 sp=0xc0007d7e78 pc=0x172f8fe
runtime.cgocallbackg1(0x172f8c0, 0x2e86fb80, 0x0)
        runtime/cgocall.go:292 +0x19a fp=0xc0007d7f40 sp=0xc0007d7ea0 pc=0x40517a
runtime.cgocallbackg(0x172f8c0, 0x2e86fb80, 0x0)
        runtime/cgocall.go:228 +0xfc fp=0xc0007d7fb8 sp=0xc0007d7f40 pc=0x404edc
runtime.cgocallback(0x0, 0x0, 0x0)
        runtime/asm_amd64.s:788 +0xc0 fp=0xc0007d7fe0 sp=0xc0007d7fb8 pc=0x476180
runtime.goexit()
        runtime/asm_amd64.s:1371 +0x1 fp=0xc0007d7fe8 sp=0xc0007d7fe0 pc=0x476461
 

I reported an issue in the library rclone uses here to get some more help with fixing it @av.reg your help may be needed to track the problem down further.

Bill has come up with a fix in WinFSP for this - please can you try the WinFSP beta

And see if you can get it to go wrong again?

Thanks

Thank you for the answer!

Short: No crash :slight_smile: , but no copy either :frowning:

Long:

I installed winfsp-1.10.21164 ( WinFsp 2021.1 Beta2)

I start rclone (using the ondrive config from above) as follows:

rclone -vv --vfs-cache-mode writes mount "onedrive:" d:\OneDrive-private --config=%USERPROFILE%\.config\rclone\rclone.conf

In another cmd window I execute:

dir Code.png
 Volume in drive C is SYSTEM
 Volume Serial Number is ...

 Directory of C:\Users\myuser\Downloads

06/08/2021  04:25 PM             8,788 Code.png
               1 File(s)          8,788 bytes
               0 Dir(s)  388,029,100,032 bytes free

Then I execute:

copy Code.png d:\OneDrive-private\Documents
Incorrect function.
        0 file(s) copied.

A 0 byte file is created in the target folder:

C:\Users\myuser\Downloads>cd /d d:\OneDrive-private\Documents

d:\OneDrive-private\Documents>dir Code.png
 Volume in drive D is New Volume
 Volume Serial Number is  ...

 Directory of d:\OneDrive-private\Documents

06/14/2021  09:52 AM                 0 Code.png
               1 File(s)              0 bytes
               0 Dir(s)  689,831,272,448 bytes free

RClone output:

RClone-copy-issue - Pastebin.com

Hooray!

Boo!

There are no errors in the rclone log at all.

So either this was an error reading the file or WinFSP dealt with it.

I don't know what that error is!

Can you add --debug-fuse to the rclone command line and post another log please? That will add additional debug for the rclone -> WinFSP layer - thank you :slight_smile:

Thank you, for helping me with this issue! :slight_smile:

I started RClone with the --debug-fuse switch:

rclone -vv --vfs-cache-mode writes mount "onedrive:" d:\OneDrive-private --config=%USERPROFILE%\.config\rclone\rclone.conf --debug-fuse

Then I repeated the same steps as before:

C:\Users\myuser\Downloads>dir Code.png
 Volume in drive C is SYSTEM
 Volume Serial Number is ...

 Directory of C:\Users\myuser\Downloads

06/08/2021  04:25 PM             8,788 Code.png
               1 File(s)          8,788 bytes
               0 Dir(s)  381,439,836,160 bytes free

C:\Users\myuser\Downloads>dir d:\OneDrive-private\Documents\Code.png
 Volume in drive D is New Volume
 Volume Serial Number is ...

 Directory of d:\OneDrive-private\Documents

File Not Found

C:\Users\myuser\Downloads>copy Code.png d:\OneDrive-private\Documents
Incorrect function.
        0 file(s) copied.

C:\Users\myuser\Downloads>cd /d d:\OneDrive-private\Documents

d:\OneDrive-private\Documents>dir Code.png
 Volume in drive D is New Volume
 Volume Serial Number is ...

 Directory of d:\OneDrive-private\Documents

06/18/2021  11:10 AM                 0 Code.png
               1 File(s)              0 bytes
               0 Dir(s)  689,830,113,280 bytes free

Please see the output here:

Thanks for the log.

Not sure what exactly is happening there.

There are no writes to that file in the log.

Is it something to do with the directory not existing at the start? Does it work if you copy into an existing directory?

Is it possible, that the Microsoft Endpoint Protection is the culprit? On my previous notebook I had Tend Micro, and rclone worked just fine, this one has the Microsoft Threat Protection. Just thinking.

hi,

as a test, disable the anti-virus

as a test, mount to another backend like gdrive and copy a file