Multiple Url In Text File & Wanted To Use "rclone copyurl" For Parallel Uploads To Remote

[Rajesh_Sahoo]

@asdffdsa

@Rajesh_Sahoo

chmod +x uploader.sh

only need to do that one time.

Ohhh. Okay. My bad.

[Rajesh_Sahoo]

Just a off-topic doubt. If I may any suggestion. When I run speedtest on my linux server (ubuntu) which is hosted as virtual machine on oracle cloud. I receive below speeds.

But when I use rclone copyurl I receive somewhere between 5 MB/s - 6 MB/s.

Any suggestion how I can fix..?

[asdffdsa (jojothehumanmonkey)]

need to test speeds.
--- rclone copyurl to local
--- rclone copy from local to onedrive

[Rajesh_Sahoo]

In this situation local indicates ubuntu linux server / windows based physical pc..?

[asdffdsa (jojothehumanmonkey)]

not sure what you mean, as both tests use local

[Rajesh_Sahoo]

Low speeds happening on when running rclone copyurl on linux instance. So, that is what is local..?

[asdffdsa (jojothehumanmonkey)]

and if you wget the file, what is the speed?

[Rajesh_Sahoo]

Tried for below case :-

• Used same rclone config on both linux server hosted on oracle cloud & windows 10 based PC.

• Used same url for upload to onedrive.

https://gdriveindex.mrdeveloper.workers.dev/1:/Kapil.Sharma.Im.Not.Done.Yet.2022.1080p.NF.10bit.DDP.5.1.x265.%5BHashMiner%5D/Kapil.Sharma.Im.Not.Done.Yet.2022.1080p.NF.10bit.DDP.5.1.x265.[HashMiner].mkv

• Speeds are same between 5 - 6 MB/s.

[Rajesh_Sahoo]

@asdffdsa

and if you wget the file, what is the speed?

If I use wget I get constant of 13 MB/s.

[asdffdsa (jojothehumanmonkey)]

based on that, what do you expect from rclone copyurl.

migth try to create a http remote and use rclone copy which supports multi-thread downloads.

[Rajesh_Sahoo]

Okay. I have created http remote now on rclone config.

How do use this url to download to local & then copy to destination which is onedrive.

Please correct me if I am understanding wrong concept of rclone copy.

[Rajesh_Sahoo]

What to be entered in this..?

Storage> 43
Option url.
URL of http host to connect to.
E.g. "https://example.com", or "https://user:pass@example.com" to use a username and password.
Enter a string value. Press Enter for the default ("").
url>

[haris_semeon]

maybe try this 1st

Speed slow compared to IDM

Download managers tend to use multiple streams which copyurl does not do. You can do something like this and up the streams if you want. Here is how it works to figure out number of streams: https://rclone.org/docs/#multi-thread-cutoff-size felix@gemini:~$ rclone copy --http-url http://ipv4.download.thinkbroadband.com :http:1GB.zip /home/felix -vv --multi-thread-streams 8 --multi-thread-cutoff 128M 2021/03/13 09:06:21 DEBUG : rclone: Version "v1.54.1" starting with parameters ["rclone" "copy"…

[Rajesh_Sahoo]

I am using onedrive business as my remote in rclone. And wanted to mount it as a network drive always whenever system restarted or shutdown.

For this I have created task scheduler too on windows.

rclone mount command :-

rclone mount onedrive: E: --vfs-cache-mode full --network-mode
The service rclone has been started.

But if I close terminal or shutdown / restart system. Task scheduler is not working.

Any way to get it work.