Slow Download speed using OneDrive(Sharepoint)

Help and Support
1

Hi guys

Could I possible get a little assistant / insight from you who are more pro than I am.
I am running Rclone using Sharepoint.
I am trying to keep up my Plex server with this cloud service.

I´m using newest version of Rclone V 1.60.1
This is my newest mount:
mount Crypt: R: --volname \rclone\crypt --use-mmap --cache-dir "E:\rclonecach" --vfs-cache-max-size 200G --dir-cache-time 1000h --vfs-cache-mode full --tpslimit 10 --rc --rc-web-gui --rc-user=XXX --rc-pass=XXX --rc-serve --log-level INFO --log-file=mylogfile.txt --onedrive-chunk-size 150M --ignore-checksum --disable-http2

My problem is that I can upload to OneDrive and I can see the speed from 20-60 MBPS
But when downloading I´m stuck at 4.99MBPS (sometimes slower).

That speed is enough so I can stream one movie for my self (sometimes two).
But when I try to open more movies, up to 8 movies, everything freezes and buffers.
My internet connection is 1GB, (Using speedtest 944mb download, 920 upload).

Could you help me try to solve this so other users could stream from my server using the Sharepoint space ?
When using local files, I can stream 10 streams (even transcoding) with no problems.

2

Also I was wondering, do users download through my server or straight from the mount ?
If every users gets 5mb/s in download, that should be enough bandwidth to stream my media (1080p movies - Around 10GB each)

3

hi,
onedrive has lots of rate limiting and throttling.

as per the rclone doc, make sure to create a client for onedrive.
that might make a difference

if you answer the questions in the help and support template, we can offer more detailed advice.
look into the debug log to see what is going on.

4

Thank you so much for your replay.
Do you know how I do that as it is a Sharepoint site ? (25TB storage)

5

if you answer the questions in the help and support template, we can offer more detailed advice.
look into the debug log to see what is going on.

6

What is the problem you are having with rclone?

Slow download speed from Sharepoint (OneDrive)
In this example I am downloading 1gb file from my mount.

Run the command 'rclone version' and share the full output of the command.

rclone v1.60.1

  • os/version: Microsoft Windows 10 Enterprise 22H2 (64 bit)
  • os/kernel: 10.0.19045.2364 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.19.3
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

OneDrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Paste command here

The rclone config contents with secrets removed.

[volcano]
type = onedrive
token = XXX
drive_id = XXX
drive_type = documentLibrary
chunk_size = 150M

[Crypt]
type = crypt
password = XXX
password2 = XXX
remote = volcano:crypt

A log from the command with the -vv flag

2022/12/18 16:25:59 INFO  : Starting transaction limiter: max 10 transactions/s with burst 1
2022/12/18 16:25:59 DEBUG : rclone: Version "v1.60.1" starting with parameters ["C:\\rclone\\rclone.exe" "mount" "Crypt:" "R:" "--volname" "\\\\rclone\\crypt" "--use-mmap" "--cache-dir" "E:\\rclonecach" "--vfs-cache-max-size" "200G" "--dir-cache-time" "1000h" "--vfs-cache-mode" "full" "--tpslimit" "10" "--rc" "--rc-web-gui" "--rc-user=XXX" "--rc-pass=XXX" "--rc-serve" "--log-level" "DEBUG" "--log-file=mylogfile.txt" "--onedrive-chunk-size" "150M" "--ignore-checksum" "--disable-http2"]
2022/12/18 16:25:59 DEBUG : Current tag: v2.0.5, Release tag: v2.0.5
2022/12/18 16:25:59 NOTICE: Web GUI exists. Update skipped.
2022/12/18 16:25:59 NOTICE: Serving Web GUI
2022/12/18 16:25:59 INFO  : Using --user XXX --pass XXXX as authenticated user
2022/12/18 16:25:59 NOTICE: Serving remote control on http://localhost:5572/
2022/12/18 16:25:59 DEBUG : login_token "XXX"
2022/12/18 16:25:59 DEBUG : Creating backend with remote "Crypt:"
2022/12/18 16:25:59 DEBUG : Using config file from "C:\\Users\\XXX\\AppData\\Roaming\\rclone\\rclone.conf"
2022/12/18 16:25:59 DEBUG : Creating backend with remote "volcano:crypt"
2022/12/18 16:25:59 DEBUG : volcano: detected overridden config - adding "{gtz84}" suffix to name
2022/12/18 16:26:00 DEBUG : fs cache: renaming cache item "volcano:crypt" to be canonical "volcano{gtz84}:crypt"
2022/12/18 16:26:00 DEBUG : OneDrive root 'crypt': Next delta token is: XXX
2022/12/18 16:26:00 DEBUG : vfs cache: root is "E:\\rclonecach"
2022/12/18 16:26:00 DEBUG : vfs cache: data root is "\\\\?\\E:\\rclonecach\\vfs\\Crypt"
2022/12/18 16:26:00 DEBUG : vfs cache: metadata root is "\\\\?\\E:\\rclonecach\\vfsMeta\\Crypt"
2022/12/18 16:26:00 DEBUG : Creating backend with remote "E:/rclonecach/vfs/Crypt/"
2022/12/18 16:26:00 DEBUG : fs cache: renaming cache item "E:/rclonecach/vfs/Crypt/" to be canonical "//?/E:/rclonecach/vfs/Crypt"
2022/12/18 16:26:00 DEBUG : Creating backend with remote "E:/rclonecach/vfsMeta/Crypt/"
2022/12/18 16:26:00 DEBUG : fs cache: renaming cache item "E:/rclonecach/vfsMeta/Crypt/" to be canonical "//?/E:/rclonecach/vfsMeta/Crypt"
2022/12/18 16:26:00 INFO  : Myndir/The Godfather (1972): Removing directory
2022/12/18 16:26:00 INFO  : Myndir: Removing directory
2022/12/18 16:26:00 INFO  : Myndir/The Godfather (1972): Removing directory
2022/12/18 16:26:00 INFO  : Myndir: Removing directory
2022/12/18 16:26:00 DEBUG : Forcing network mode due to network share (UNC) volume name
2022/12/18 16:26:00 DEBUG : Network mode mounting is enabled
2022/12/18 16:26:00 DEBUG : Mounting on "R:" ("\\rclone\\crypt")
2022/12/18 16:26:00 DEBUG : Encrypted drive 'Crypt:': Mounting with options: ["-o" "attr_timeout=1" "-o" "uid=-1" "-o" "gid=-1" "--FileSystemName=rclone" "--VolumePrefix=\\rclone\\crypt"]
2022/12/18 16:26:00 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item Þættir/Girls/Season 5/girls.s05e07.720p.hdtv.x264-batv.nfo not removed, freed 0 bytes
2022/12/18 16:26:00 INFO  : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 3.774Ki (was 3.774Ki)
2022/12/18 16:26:00 DEBUG : Encrypted drive 'Crypt:': Init: 
2022/12/18 16:26:00 DEBUG : Encrypted drive 'Crypt:': >Init: 
2022/12/18 16:26:00 DEBUG : /: Statfs: 
2022/12/18 16:26:01 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:6710886400 Bfree:5620155080 Bavail:5620155080 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2022/12/18 16:26:01 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:01 DEBUG : /: Readlink: 
2022/12/18 16:26:01 DEBUG : /: >Readlink: linkPath="", errc=-40
2022/12/18 16:26:01 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:01 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:01 DEBUG : /: Opendir: 
2022/12/18 16:26:01 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:01 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:01 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:01 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:01 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:01 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:01 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:01 DEBUG : /: Opendir: 
2022/12/18 16:26:01 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:01 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:01 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:01 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:01 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:01 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:01 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:01 DEBUG : /: Opendir: 
2022/12/18 16:26:01 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:01 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:01 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:01 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:01 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:01 DEBUG : /Desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /Desktop.ini: >Getattr: errc=-2
2022/12/18 16:26:01 DEBUG : /Desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /Desktop.ini: >Getattr: errc=-2
2022/12/18 16:26:01 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:01 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Opendir: 
2022/12/18 16:26:02 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:02 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:02 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:02 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:02 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Opendir: 
2022/12/18 16:26:02 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:02 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:02 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:02 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:02 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Opendir: 
2022/12/18 16:26:02 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:02 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:02 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:02 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:02 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Opendir: 
2022/12/18 16:26:02 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:02 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:02 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:02 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:02 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Opendir: 
2022/12/18 16:26:02 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:02 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:02 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:02 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:02 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:26:02 DEBUG : /: >Getattr: errc=0
2022/12/18 16:26:02 DEBUG : /: Opendir: 
2022/12/18 16:26:02 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:26:02 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:26:02 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:26:02 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:26:02 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:26:13 DEBUG : rc: "core/stats": with parameters map[]
2022/12/18 16:26:13 DEBUG : rc: "core/stats": with parameters map[]
2022/12/18 16:26:13 DEBUG : rc: "core/stats": reply map[bytes:0 checks:0 deletedDirs:4 deletes:0 elapsedTime:14.5522859 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:0 totalChecks:0 totalTransfers:0 transferTime:0 transfers:0]: <nil>
2022/12/18 16:26:13 DEBUG : rc: "core/stats": reply map[bytes:0 checks:0 deletedDirs:4 deletes:0 elapsedTime:14.5522859 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:0 totalChecks:0 totalTransfers:0 transferTime:0 transfers:0]: <nil>
2022/12/18 16:27:00 DEBUG : OneDrive root 'crypt': Checking for changes on remote
2022/12/18 16:27:00 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item Þættir/Girls/Season 5/girls.s05e07.720p.hdtv.x264-batv.nfo not removed, freed 0 bytes
2022/12/18 16:27:00 INFO  : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 3.774Ki (was 3.774Ki)
2022/12/18 16:27:13 DEBUG : rc: "core/stats": with parameters map[]
2022/12/18 16:27:13 DEBUG : rc: "core/stats": reply map[bytes:0 checks:0 deletedDirs:4 deletes:0 elapsedTime:74.2442491 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:0 totalChecks:0 totalTransfers:0 transferTime:0 transfers:0]: <nil>
2022/12/18 16:27:13 DEBUG : rc: "core/stats": with parameters map[]
2022/12/18 16:27:13 DEBUG : rc: "core/stats": reply map[bytes:0 checks:0 deletedDirs:4 deletes:0 elapsedTime:74.244777 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:0 totalChecks:0 totalTransfers:0 transferTime:0 transfers:0]: <nil>
2022/12/18 16:27:58 DEBUG : /Þættir/.grab: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:27:59 DEBUG : /Þættir/.grab: >Getattr: errc=-2
2022/12/18 16:27:59 DEBUG : /Myndir/.grab: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:27:59 DEBUG : /Myndir/.grab: >Getattr: errc=-2
2022/12/18 16:28:00 DEBUG : OneDrive root 'crypt': Checking for changes on remote
2022/12/18 16:28:00 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item Þættir/Girls/Season 5/girls.s05e07.720p.hdtv.x264-batv.nfo not removed, freed 0 bytes
2022/12/18 16:28:00 INFO  : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 3.774Ki (was 3.774Ki)
2022/12/18 16:28:13 DEBUG : rc: "core/stats": with parameters map[]
2022/12/18 16:28:13 DEBUG : rc: "core/stats": reply map[bytes:0 checks:0 deletedDirs:4 deletes:0 elapsedTime:134.2333871 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:0 totalChecks:0 totalTransfers:0 transferTime:0 transfers:0]: <nil>
2022/12/18 16:28:13 DEBUG : rc: "core/stats": with parameters map[]
2022/12/18 16:28:13 DEBUG : rc: "core/stats": reply map[bytes:0 checks:0 deletedDirs:4 deletes:0 elapsedTime:134.2333871 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:0 totalChecks:0 totalTransfers:0 transferTime:0 transfers:0]: <nil>
2022/12/18 16:28:21 DEBUG : Encrypted drive 'Crypt:': Destroy: 
2022/12/18 16:28:21 DEBUG : Encrypted drive 'Crypt:': >Destroy: 
2022/12/18 16:28:21 DEBUG : Not calling host.Unmount as mount already Destroyed
2022/12/18 16:28:21 DEBUG : Unmounted successfully
2022/12/18 16:28:21 DEBUG : vfs cache: cleaner exiting
2022/12/18 16:28:21 ERROR : R:: Unmounted rclone mount
2022/12/18 16:28:21 DEBUG : rclone: Version "v1.60.1" finishing with parameters ["C:\\rclone\\rclone.exe" "mount" "Crypt:" "R:" "--volname" "\\\\rclone\\crypt" "--use-mmap" "--cache-dir" "E:\\rclonecach" "--vfs-cache-max-size" "200G" "--dir-cache-time" "1000h" "--vfs-cache-mode" "full" "--tpslimit" "10" "--rc" "--rc-web-gui" "--rc-user=XXX" "--rc-pass=XXX" "--rc-serve" "--log-level" "DEBUG" "--log-file=mylogfile.txt" "--onedrive-chunk-size" "150M" "--ignore-checksum" "--disable-http2"]
2022/12/18 16:28:24 INFO  : Starting transaction limiter: max 10 transactions/s with burst 1
2022/12/18 16:28:24 DEBUG : rclone: Version "v1.60.1" starting with parameters ["C:\\rclone\\rclone.exe" "mount" "Crypt:" "R:" "--volname" "\\\\rclone\\crypt" "--use-mmap" "--cache-dir" "E:\\rclonecach" "--vfs-cache-max-size" "200G" "--dir-cache-time" "1000h" "--vfs-cache-mode" "full" "--tpslimit" "10" "--rc" "--rc-web-gui" "--rc-user=XXX" "--rc-pass=XXX" "--rc-serve" "--log-level" "DEBUG" "--log-file=mylogfile.txt" "--onedrive-chunk-size" "150M" "--ignore-checksum" "--disable-http2"]
2022/12/18 16:28:24 DEBUG : Current tag: v2.0.5, Release tag: v2.0.5
2022/12/18 16:28:24 NOTICE: Web GUI exists. Update skipped.
2022/12/18 16:28:24 NOTICE: Serving Web GUI
2022/12/18 16:28:24 INFO  : Using --user XXX --pass XXXX as authenticated user
2022/12/18 16:28:24 NOTICE: Serving remote control on http://localhost:5572/
2022/12/18 16:28:24 DEBUG : login_token "aXZhcjpkdWxrb2RhZA=="
2022/12/18 16:28:24 DEBUG : Creating backend with remote "Crypt:"
2022/12/18 16:28:24 DEBUG : Using config file from "C:\\Users\\XXX\\AppData\\Roaming\\rclone\\rclone.conf"
2022/12/18 16:28:24 DEBUG : Creating backend with remote "volcano:crypt"
2022/12/18 16:28:24 DEBUG : volcano: detected overridden config - adding "{gtz84}" suffix to name
2022/12/18 16:28:25 DEBUG : fs cache: renaming cache item "volcano:crypt" to be canonical "volcano{gtz84}:crypt"
2022/12/18 16:28:25 DEBUG : OneDrive root 'crypt': Next delta token is: MzslMjM0OyUyMzE7MzszY2VmZWVjOC02YzRmLTQ1NWEtYjVmNC0yYTgwZGQwZmU1MmE7NjM4MDY5Nzc3MDU0MzAwMDAwOzcxMjE4NzA2MDslMjM7JTIzOyUyMzA
2022/12/18 16:28:25 DEBUG : vfs cache: root is "E:\\rclonecach"
2022/12/18 16:28:25 DEBUG : vfs cache: data root is "\\\\?\\E:\\rclonecach\\vfs\\Crypt"
2022/12/18 16:28:25 DEBUG : vfs cache: metadata root is "\\\\?\\E:\\rclonecach\\vfsMeta\\Crypt"
2022/12/18 16:28:25 DEBUG : Creating backend with remote "E:/rclonecach/vfs/Crypt/"
2022/12/18 16:28:25 DEBUG : fs cache: renaming cache item "E:/rclonecach/vfs/Crypt/" to be canonical "//?/E:/rclonecach/vfs/Crypt"
2022/12/18 16:28:25 DEBUG : Creating backend with remote "E:/rclonecach/vfsMeta/Crypt/"
2022/12/18 16:28:25 DEBUG : fs cache: renaming cache item "E:/rclonecach/vfsMeta/Crypt/" to be canonical "//?/E:/rclonecach/vfsMeta/Crypt"
2022/12/18 16:28:25 DEBUG : Forcing network mode due to network share (UNC) volume name
2022/12/18 16:28:25 DEBUG : Network mode mounting is enabled
2022/12/18 16:28:25 DEBUG : Mounting on "R:" ("\\rclone\\crypt")
2022/12/18 16:28:25 DEBUG : Encrypted drive 'Crypt:': Mounting with options: ["-o" "attr_timeout=1" "-o" "uid=-1" "-o" "gid=-1" "--FileSystemName=rclone" "--VolumePrefix=\\rclone\\crypt"]
2022/12/18 16:28:25 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item Þættir/Girls/Season 5/girls.s05e07.720p.hdtv.x264-batv.nfo not removed, freed 0 bytes
2022/12/18 16:28:25 INFO  : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 3.774Ki (was 3.774Ki)
2022/12/18 16:28:25 DEBUG : Encrypted drive 'Crypt:': Init: 
2022/12/18 16:28:25 DEBUG : Encrypted drive 'Crypt:': >Init: 
2022/12/18 16:28:25 DEBUG : /: Statfs: 
2022/12/18 16:28:25 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:6710886400 Bfree:5620155080 Bavail:5620155080 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2022/12/18 16:28:25 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:25 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:25 DEBUG : /: Readlink: 
2022/12/18 16:28:25 DEBUG : /: >Readlink: linkPath="", errc=-40
2022/12/18 16:28:25 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:25 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:25 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:25 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:25 DEBUG : /: Opendir: 
2022/12/18 16:28:25 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:25 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:25 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:25 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:25 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:25 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:25 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:25 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:25 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:25 DEBUG : /: Opendir: 
2022/12/18 16:28:25 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:25 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:25 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:25 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:25 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:25 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:25 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:25 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:25 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:25 DEBUG : /: Opendir: 
2022/12/18 16:28:25 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:25 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:25 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:25 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:25 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:26 DEBUG : /Desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /Desktop.ini: >Getattr: errc=-2
2022/12/18 16:28:26 DEBUG : /Desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /Desktop.ini: >Getattr: errc=-2
2022/12/18 16:28:26 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Opendir: 
2022/12/18 16:28:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:26 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:26 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Opendir: 
2022/12/18 16:28:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:26 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:26 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Opendir: 
2022/12/18 16:28:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:26 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:26 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Opendir: 
2022/12/18 16:28:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:26 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:26 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Opendir: 
2022/12/18 16:28:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:26 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:26 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:26 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:26 DEBUG : /: Opendir: 
2022/12/18 16:28:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:26 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:26 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Opendir: 
2022/12/18 16:28:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:27 DEBUG : /: Statfs: 
2022/12/18 16:28:27 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:6710886400 Bfree:5620155080 Bavail:5620155080 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2022/12/18 16:28:27 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:27 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Opendir: 
2022/12/18 16:28:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:27 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:27 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Opendir: 
2022/12/18 16:28:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:27 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:27 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:27 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:27 DEBUG : /: Opendir: 
2022/12/18 16:28:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:27 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:27 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Opendir: 
2022/12/18 16:28:29 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:29 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:29 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:29 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:29 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Opendir: 
2022/12/18 16:28:29 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:29 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:29 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:29 DEBUG : /: Releasedir: fh=0x0
2022/12/18 16:28:29 DEBUG : /: >Releasedir: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /desktop.ini: >Getattr: errc=-2
2022/12/18 16:28:29 DEBUG : /: Opendir: 
2022/12/18 16:28:29 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:29 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:29 DEBUG : /: >Opendir: errc=0, fh=0x0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Opendir: 
2022/12/18 16:28:29 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2022/12/18 16:28:29 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2022/12/18 16:28:29 DEBUG : /: >Opendir: errc=0, fh=0x1
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
2022/12/18 16:28:29 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2022/12/18 16:28:29 DEBUG : /: >Getattr: errc=0
7

with onedrive/sharepoint, not sure you can expect more than that.

as per the rclone doc, make sure to create a client_id for onedrive.
that might make a difference

and might test without --tpslimit 10

i would delete the old log, re-run the mount command, and re-create the issue, then kill the mount.
then post the entire debug log.

8

Hmmm if that´s the case then I will stop right now.
I want to be able to keep up at least 10 streams.

9

i made a few suggestions
have you tried them?
did they not improve the issue?

10

Thanks, I will give it a try.
What is the best way to send log file?
Entire log was too big for both this site and also too big for Pastebin.
Even though it was only 10 min log

11

imho,
for now, create the client id, and then do some simple testing.
let's see if any combo of flags make any difference at all.

and the log gets huge. at this point, do not post it.
tho i would be sure to delete it before each run of rclone.

can search for log like

ERROR
pacer
retry
EOF
Rate limited
12

Hi hohoho,

I think you already got some good advice from Jojo, but guess you may want more concrete advice, so here is a simplified mount command that may have better performance:

mount Crypt: R: --volname \rclone\crypt --cache-dir "E:\rclonecach" --dir-cache-time 1000h --vfs-cache-mode full --vfs-cache-max-size 200G --rc-web-gui --rc-user=XXX --rc-pass=XXX --log-level INFO --log-file=mylogfile.txt

I removed some flags, that in my experience has no or negative effect on the speed of a OneDrive mount.

Here is a slightly modified variation where I added a few flags to (hopefully) give you better overall experience:

mount Crypt: R: --volname \rclone\crypt --cache-dir "E:\rclonecach" --network-mode --dir-cache-time 1000h --buffer-size=0 --vfs-cache-mode full --vfs-cache-max-size 200G --vfs-cache-max-age=720h --rc-web-gui --rc-user=XXX --rc-pass=XXX --log-level INFO --log-file=mylogfile.txt

You may want to try with and without --buffer-size=0 to see which is best with your usage pattern.

That is roughly according to my expectation for single file downloads from OneDrive. I typically allows up to 4 concurrent transfers, so total download speed is typically something like 20-30 MB/s.

I would expect so, because you exceed the above mentioned limits both with respect to number of concurrent transfers and download speed.

Sure, but using a cloud storage is something completely different. OneDrive, Google Drive, Dropbox,... has a lot of speed limits in place to make sure that everybody get what they pay for and that total costs to the server park are kept at a level where they can offer a competitive price per stored GB.

You can read more about SharePoint rate limiting /throttling here:
https://learn.microsoft.com/en-us/sharepoint/dev/general-development/how-to-avoid-getting-throttled-or-blocked-in-sharepoint-online

If you want maximum speed and is prepared to pay for it, then you should use a cloud service where you pay per request such as AWS S3 or Backblaze B2.

My experience is that it makes no difference and therefore isn't worth the effort for OneDrive, but agree, it never hurts to try if all the low hanging fruits have been tried. I think removing --tpslimit 10 will have much better effect.

13

Thank you for this replay !

Did you find any "way" so we can "fake" transfers ?
So we would be able to pull more transfers ? Making more users or something like that ?

14

No, that isn't possible and I am sure Microsoft would stop it in no time if a possibility was discovered and used. What makes you think it is possible?

Which of the above advices did you try?
Which of the proposed mount commands did you try?
Which was the best in your situation?

15

5mbps is enough for my streams.
But 4 concurrent streams are not enough :frowning:
I will try the commands tonight and report back.

16

what is the total size of the Crypt:

17

The sharepoint site is 25TB and I can create as many as I want.
Only 2TB of files there at this moment

18

This did not work well, im sorry.
It gives me 3-4 MBPS and all the way up to 11 MPBS, but throttles me down to 0 after 20-40sec

19

Since you are using Windows, have you tried using the OneDrive official client and use rclone just to decrypt?

The official Microsoft client has a lot more leeway in transfers and speed and does not get throttled by Microsoft, you would simply do the crypt part from the folder instead of the remote partition.

I use linux so can't test on my end.

20

Sure looks like you are being throttled by SharePoint, the pause is most likely rclone respecting a "Retry after" response from SharePoint.

Thanks for testing, it gave some valuable information. Sorry it didn't help.

Perhaps --bwlimit-file can help smooth out the speed and avoid pauses, I don't know.