Hello all,
so I am using SharePoint as a backend and noticed that here is a bandwidth limit when reading/downloading. I was wondering whether I could overcome this by opening two mounts and then having two streams of the same file, ultimately increasing the overall bandwidth. I've noticed I can download two separate files both with the same speed.
Is there way of doing this with rclone? I know, technically speaking, MinIO could do this but I have a large library and importing them into MinIO is not feasible (they discontinued the FS read function which makes mounting the remote into MinIO not possible anymore).
Thanks,
Daniel
ncw
(Nick Craig-Wood)
January 30, 2023, 11:08am
2
Rclone with --vfs-cache-mode full
will open as many streams as the application requests.
However I suspect you are interested in this issue
opened 08:07PM - 11 Nov 20 UTC
enhancement
VFS / mount
IMPORTANT
<!--
Welcome :-)
So you've got an idea to improve rclone? We love that! Yo… u'll be glad to hear we've incorporated hundreds of ideas from contributors already.
Here is a checklist of things to do:
1. Please search the old issues first for your idea and +1 or comment on an existing issue if possible.
2. Discuss on the forum first: https://forum.rclone.org/
3. Make a feature request issue (this is the right place!).
4. Be prepared to get involved making the feature :-)
Looking forward to your great idea!
The Rclone Developers
-->
#### What is your current rclone version (output from `rclone version`)?
rclone v1.54.0-beta.4889.45e8bea8d
- os/arch: linux/amd64
- go version: go1.15.3
#### What problem are you are trying to solve?
With rclone copy, and --multi-thread-streams set to 4, I get speeds of up to 40 MB/s whereas the same with rclone mount gives me only 10 MB/s (which is equal to the value obtained via rclone copy with the number of streams set to 1).
#### How do you think rclone should be changed to solve that?
Add support for multi-threaded downloads when downloading a file to the vfs cache. Per @ncw and this thread (https://forum.rclone.org/t/multi-threaded-downloads-comments-and-testers-needed/9721/18), this was present in the previous iteration of the full-mode cache but was removed to add support for partial downloads/streams.
#### How to use GitHub
* Please use the 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to show that you are affected by the same issue.
* Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
* Subscribe to receive notifications on status change and new comments.
system
(system)
Closed
March 1, 2023, 11:08am
3
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.