I use rclone copyurl as below for single file upload to my remote connection. But wanted to know how to use rclone copyurl command to do with multiple url placed in text file. And upload them as parallel to remote.
rclone copyurl 'https://cdn1.jv-cdn.workers.dev/0:/Downloads/The%20Bourne%20Supremacy%20%282004%29%20%20%5B2160p%20x265%2010bit%20FS96%20Joy%5D.mkv' onedrive: -a --progress
Run the command 'rclone version' and share the full output of the command.
ubuntu@ubuntu:~$ rclone version
rclone v1.57.0
os/version: ubuntu 20.04 (64 bit)
os/kernel: 5.11.0-1028-oracle (aarch64)
os/type: linux
os/arch: arm64
go/version: go1.17.2
go/linking: static
go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Onedrive business
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone copyurl 'https://cdn1.jv-cdn.workers.dev/0:/Downloads/The%20Bourne%20Supremacy%20%282004%29%20%20%5B2160p%20x265%2010bit%20FS96%20Joy%5D.mkv' onedrive: -a --progress
The rclone config contents with secrets removed.
ubuntu@ubuntu:~$ rclone config show
[onedrive]
type = onedrive
client_id =
client_secret =
token =
drive_id =
drive_type = business
If you can set up the remote as an http backend then you can do parallel copying with rclone copy. This requires plain directory listings which your site may not have though.
Probably the best solution is just to run multiple copies of rclone copyurl since the files are big and take some time.
hi,
use a simple .sh script, and run that one single task.
on linux, there are many ways to run a task in the background, so if you close the ssh session, the task continue to run.
What I have done till now is created new notepad file on windows & pasted below rclone copyurl commands. And saved file as uploader.sh which transferred to linux server.
Step 2 & 3 I have write in terminal or they should too go inside text file..?
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-01%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-02%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-03%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-04%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-05%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-06%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-07%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-08%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
rclone copyurl 'https://pepper.devilz.workers.dev/0:/www.TamilBlasters.re%20-%20The%20Family%20Man%20(2021)%20S02%20(E01-09)%20%5BHindi%20-%201080p%20HD%20AVC%20-%20x264%20-%20UNTOUCHED%20-%20DDP5.1%20(640kbps)%20-%201.8.2GB%20-%20ESubs%5D/EP-09%20-%20www.TamilBlasters.re.mkv' onedrive: -a --progress
I have placed totally 9 url in text file named as uploader.sh. Then ran below commands in terminal. Got this error. Only 1 file which is last one out total 9 file got to onedrive.
chmod +x uploader.sh
./uploader.sh
ubuntu@ubuntu:~$ chmod +x uploader.sh
ubuntu@ubuntu:~$ ./uploader.sh
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Error: unknown flag: --progress
Usage:
rclone copyurl https://example.com dest:path [flags]
Flags:
-a, --auto-filename Get the file name from the URL and use it for destination file path
-h, --help help for copyurl
--no-clobber Prevent overwriting file with same name
-p, --print-filename Print the resulting name from --auto-filename
--stdout Write the output to stdout rather than a file
Use "rclone [command] --help" for more information about a command.
Use "rclone help flags" for to see the global flags.
Use "rclone help backends" for a list of supported services.
2022/02/03 18:44:47 Fatal error: unknown flag: --progress
Transferred: 2.859 GiB / 2.859 GiB, 100%, 2.356 MiB/s, ETA 0s
Transferred: 1 / 1, 100%
Elapsed time: 13m24.9s