Problems with http --files-from

vacuole · June 26, 2023, 7:38pm

What is the problem you are having with rclone?

It is ok when I running this

rclone copy --http-url https://content.archive.ragtag.moe :http:"gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv" "meow_test:box/30" -vvP

log

2023/06/26 20:51:59 DEBUG : rclone: Version "v1.60.1" starting with parameters ["rclone" "copy" "--http-url" "https://content.archive.ragtag.moe" ":http:gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv" "meow_test:box/30" "-vvP"]
2023/06/26 20:51:59 DEBUG : Creating backend with remote ":http:gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv"
2023/06/26 20:51:59 DEBUG : Using config file from "/home4/kirame/bin/rclone.conf"
2023/06/26 20:51:59 DEBUG : :http: detected overridden config - adding "{mnMo7}" suffix to name
2023/06/26 20:51:59 DEBUG : Assuming path is a file as HEAD response is redirect (302 Found) to a path that does not end with '/': https://the-eye.eu/archive.ragtag.moe/0APcbUqyfMhbLUk9PVA/archive2b/PyU5ADMiDx8/PyU5ADMiDx8.mkv
2023/06/26 20:51:59 DEBUG : If path is a directory you must add a trailing '/'
2023/06/26 20:51:59 DEBUG : Root: https://content.archive.ragtag.moe/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/
2023/06/26 20:51:59 DEBUG : fs cache: adding new entry for parent of ":http:gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv", ":http{mnMo7}:gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv"
2023/06/26 20:51:59 DEBUG : Creating backend with remote "meow_test:box/30"
2023-06-26 20:52:00 DEBUG : PyU5ADMiDx8.mkv: Need to transfer - File not found at Destination
2023-06-26 20:52:03 DEBUG : PyU5ADMiDx8.mkv: Sending chunk 0 length 8388608
2023-06-26 20:52:03 DEBUG : PyU5ADMiDx8.mkv: Sending chunk 8388608 length 8388608
2023-06-26 20:52:05 DEBUG : PyU5ADMiDx8.mkv: Sending chunk 16777216 length 8388608
... ...

But when I run, error occurs

rclone copy --http-url https://content.archive.ragtag.moe :http: --files-from clonelist.txt --no-traverse "meow_test:box/30" -vvP --stats 1s

The contents of clonlist.txt

gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv
gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/Hes-9Hqbexw/Hes-9Hqbexw.mkv
gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv

Run the command 'rclone version' and share the full output of the command.

rclone v1.60.1

os/version: ubuntu 18.04 (64 bit)
os/kernel: 5.4.0-105-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.19.3
go/linking: static
go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone copy --http-url https://content.archive.ragtag.moe :http: --files-from clonelist.txt --no-traverse "meow_test:box/30" -vvP --stats 1s

The rclone config contents with secrets removed.

[ragtag]
type = http
url = https://content.archive.ragtag.moe

A log from the command with the `-vv` flag

2023/06/26 21:20:45 DEBUG : rclone: Version "v1.60.1" starting with parameters ["rclone" "copy" "--http-url" "https://content.archive.ragtag.moe" ":http:" "--files-from-raw" "clonelist.txt" "--no-traverse" "meow_test:box/30" "-vvP" "--stats" "1s"]
2023/06/26 21:20:45 DEBUG : Creating backend with remote ":http:"
2023/06/26 21:20:45 DEBUG : Using config file from "/home4/kirame/bin/rclone.conf"
2023/06/26 21:20:45 DEBUG : :http: detected overridden config - adding "{mnMo7}" suffix to name
2023/06/26 21:20:45 DEBUG : Root: https://content.archive.ragtag.moe/
2023/06/26 21:20:45 DEBUG : fs cache: renaming cache item ":http:" to be canonical ":http{mnMo7}:"
2023/06/26 21:20:45 DEBUG : Creating backend with remote "meow_test:box/30"
2023-06-26 21:20:45 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-26 21:20:45 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 21:20:45 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 21:20:45 ERROR : Attempt 1/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-26 21:20:46 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-26 21:20:46 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 21:20:46 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 21:20:46 ERROR : Attempt 2/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-26 21:20:46 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv": stopped after 10 redirects
2023-06-26 21:20:46 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 21:20:46 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 21:20:46 ERROR : Attempt 3/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv": stopped after 10 redirects
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.8s
2023/06/26 21:20:46 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.8s

2023/06/26 21:20:46 DEBUG : 5 go routines active
2023/06/26 21:20:46 Failed to copy: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv": stopped after 10 redirects

kapitainsky · June 26, 2023, 8:36pm

Maybe there is some issue but first upgrade to the latest rclone version and try the same - no point to investigate old version.

vacuole · June 26, 2023, 8:47pm

updated

rclone copy --http-url https://content.archive.ragtag.moe :http: --files-from clonelist.txt --no-traverse "meow_test:box/30" -vvP --stats 1s
2023/06/26 22:46:20 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "copy" "--http-url" "https://content.archive.ragtag.moe" ":http:" "--files-from" "clonelist.txt" "--no-traverse" "meow_test:box/30" "-vvP" "--stats" "1s"]
2023/06/26 22:46:20 DEBUG : Creating backend with remote ":http:"
2023/06/26 22:46:20 DEBUG : Using config file from "/home4/kirame/bin/rclone.conf"
2023/06/26 22:46:20 DEBUG : :http: detected overridden config - adding "{mnMo7}" suffix to name
2023/06/26 22:46:20 DEBUG : Root: https://content.archive.ragtag.moe/
2023/06/26 22:46:20 DEBUG : fs cache: renaming cache item ":http:" to be canonical ":http{mnMo7}:"
2023/06/26 22:46:20 DEBUG : Creating backend with remote "meow_test:box/30"
2023/06/26 22:46:20 DEBUG : meow_test: Loaded invalid token from config file - ignoring
2023/06/26 22:46:20 DEBUG : Saving config "token" in section "meow_test" of the config file
2023/06/26 22:46:20 DEBUG : Keeping previous permissions for config file: -rw-rw-r--
2023/06/26 22:46:20 DEBUG : meow_test: Saved new token in config file
2023-06-26 22:46:21 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv": stopped after 10 redirects
2023-06-26 22:46:21 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 22:46:21 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 22:46:21 ERROR : Attempt 1/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv": stopped after 10 redirects
2023-06-26 22:46:21 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv": stopped after 10 redirects
2023-06-26 22:46:21 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 22:46:21 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 22:46:21 ERROR : Attempt 2/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/S62BbyU_lgc/S62BbyU_lgc.mkv": stopped after 10 redirects
2023-06-26 22:46:21 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-26 22:46:21 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 22:46:21 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 22:46:21 ERROR : Attempt 3/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.2s
2023/06/26 22:46:21 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.2s

2023/06/26 22:46:21 DEBUG : 7 go routines active
2023/06/26 22:46:21 Failed to copy: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects

kapitainsky · June 26, 2023, 8:48pm

Thx. Yes there is some problem.

vacuole · June 27, 2023, 2:53pm

It just occurred to me that you might need this
Log without --no-traverse

rclone copy --http-url https://content.archive.ragtag.moe :http: --files-from clonelist.txt "meow_test:box/30" -vvP --stats 1s
2023/06/26 20:53:50 DEBUG : rclone: Version "v1.60.1" starting with parameters ["rclone" "copy" "--http-url" "https://content.archive.ragtag.moe" ":http:" "--files-from" "clonelist.txt" "meow_test:box/30" "-vvP" "--stats" "1s"]
2023/06/26 20:53:50 DEBUG : Creating backend with remote ":http:"
2023/06/26 20:53:50 DEBUG : Using config file from "/home4/kirame/bin/rclone.conf"
2023/06/26 20:53:50 DEBUG : :http: detected overridden config - adding "{mnMo7}" suffix to name
2023/06/26 20:53:50 DEBUG : Root: https://content.archive.ragtag.moe/
2023/06/26 20:53:50 DEBUG : fs cache: renaming cache item ":http:" to be canonical ":http{mnMo7}:"
2023/06/26 20:53:50 DEBUG : Creating backend with remote "meow_test:box/30"
2023-06-26 20:53:51 DEBUG : 0Ibafh7x_ow.mkv: Excluded
2023-06-26 20:53:51 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: error listing "": failed to readDir: HTTP Error: 401 Unauthorized
2023-06-26 20:53:51 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 20:53:51 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 20:53:51 ERROR : Attempt 1/3 failed with 1 errors and: error listing "": failed to readDir: HTTP Error: 401 Unauthorized
2023-06-26 20:53:52 DEBUG : 0Ibafh7x_ow.mkv: Excluded
2023-06-26 20:53:52 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: error listing "": failed to readDir: HTTP Error: 401 Unauthorized
2023-06-26 20:53:52 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 20:53:52 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 20:53:52 ERROR : Attempt 2/3 failed with 1 errors and: error listing "": failed to readDir: HTTP Error: 401 Unauthorized
2023-06-26 20:53:52 DEBUG : 0Ibafh7x_ow.mkv: Excluded
2023-06-26 20:53:52 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: error listing "": failed to readDir: HTTP Error: 401 Unauthorized
2023-06-26 20:53:52 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-26 20:53:52 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-26 20:53:52 ERROR : Attempt 3/3 failed with 1 errors and: error listing "": failed to readDir: HTTP Error: 401 Unauthorized

kapitainsky · June 27, 2023, 3:03pm

please update rclone to the latest version - I am not saying that it will solve anything - but there is no point to investigate old rclone version when it is maybe already fixed.

vacuole · June 27, 2023, 3:05pm

Sorry that I copied the old(wrong) log
This is v1.62.2, same
And I can confirm this url is still can visit

rclone copy --http-url https://content.archive.ragtag.moe :http: --files-from clonelist.txt "meow_test:box/30" -vvP --stats 1s --no-traverse
2023/06/27 17:04:09 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "copy" "--http-url" "https://content.archive.ragtag.moe" ":http:" "--files-from" "clonelist.txt" "meow_test:box/30" "-vvP" "--stats" "1s" "--no-traverse"]
2023/06/27 17:04:09 DEBUG : Creating backend with remote ":http:"
2023/06/27 17:04:09 DEBUG : Using config file from "/home4/kirame/bin/rclone.conf"
2023/06/27 17:04:09 DEBUG : :http: detected overridden config - adding "{mnMo7}" suffix to name
2023/06/27 17:04:09 DEBUG : Root: https://content.archive.ragtag.moe/
2023/06/27 17:04:09 DEBUG : fs cache: renaming cache item ":http:" to be canonical ":http{mnMo7}:"
2023/06/27 17:04:09 DEBUG : Creating backend with remote "meow_test:box/30"
2023/06/27 17:04:09 DEBUG : meow_test: Loaded invalid token from config file - ignoring
2023/06/27 17:04:09 DEBUG : Saving config "token" in section "meow_test" of the config file
2023/06/27 17:04:09 DEBUG : Keeping previous permissions for config file: -rw-rw-r--
2023/06/27 17:04:09 DEBUG : meow_test: Saved new token in config file
2023-06-27 17:04:10 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-27 17:04:10 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-27 17:04:10 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-27 17:04:10 ERROR : Attempt 1/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-27 17:04:10 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/Hes-9Hqbexw/Hes-9Hqbexw.mkv": stopped after 10 redirects
2023-06-27 17:04:10 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-27 17:04:10 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-27 17:04:10 ERROR : Attempt 2/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/Hes-9Hqbexw/Hes-9Hqbexw.mkv": stopped after 10 redirects
2023-06-27 17:04:11 ERROR : https://content.archive.ragtag.moe/: error reading source root directory: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
2023-06-27 17:04:11 DEBUG : Google drive root 'box/30': Waiting for checks to finish
2023-06-27 17:04:11 DEBUG : Google drive root 'box/30': Waiting for transfers to finish
2023-06-27 17:04:11 ERROR : Attempt 3/3 failed with 1 errors and: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.3s
2023/06/27 17:04:11 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.3s

2023/06/27 17:04:11 DEBUG : 7 go routines active
2023/06/27 17:04:11 Failed to copy: failed to stat: Head "/gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv": stopped after 10 redirects

kapitainsky · June 27, 2023, 4:12pm

I think it might be a bug as indeed with --files-from rclone tries to list source directory and does not when copy parameters are explicit. This root directory at https://content.archive.ragtag.moe/ has no access.

BTW

–no-traverse
The --no-traverse flag controls whether the destination file system is traversed when using the copy or move commands.

does not make really difference as it applies to destination not source. With or without root cause issue is:

error reading source root directory

For now only option I see is explicit copy:

rclone copy --http-url https://content.archive.ragtag.moe :http:"gd:1LvMYR3gmXPLzseeMnaMCW40Z1aKT3RJi/PyU5ADMiDx8/PyU5ADMiDx8.mkv" "meow_test:box/30" -vvP

If you have many files than you could use simple bash script e.g.:

#!/bin/bash

input="/path/to/clonelist.txt"

while IFS= read -r line
do
  echo "$line"
  rclone copy --http-url https://content.archive.ragtag.moe :http:"$line" "meow_test:box/30" -vvP
done < "$input"

vacuole · June 27, 2023, 4:33pm

Oic, so there is no solution for now, only do it one by one? Actually there are 19k urls for me to transfer, and I tested the speed of 1 transfer only (20mb/s). I think this is a bit slow, that's why I'm trying to use http backend as @ncw mentioned

Is there any better way to finish this work?

kapitainsky · June 27, 2023, 4:36pm

Split your clonelist.txt into e.g. 5 files and run 5 bash scripts at once.

As mentioned it requires plain directory listings which your site does not not have.

vacuole · June 27, 2023, 4:40pm

It's a good idea for now, thanks for wasting your time help to me
Hope that one day rclone can do it without plain directory listings

kapitainsky · June 27, 2023, 4:42pm

It could be done but it is really edge case and workaround is so simple (bash script) that not sure it would be good utilization of dev time:)

Do not forget it is Open Source project - so if it is very important for you maybe you could DIY and improve rclone.

vacuole · June 27, 2023, 4:48pm

I think it is just like doing copyurl parallelly ,read the url one by one, but I know I think it too simple...
Btw, I'm using 10Gbps bandwidth, will there any problem when I run 50 bash scripts in the same time(also I need to open 50 windows)?

kapitainsky · June 27, 2023, 4:54pm

If https://content.archive.ragtag.moe has 10Gbps link or more...

You can run script in the background script.sh &

Or you can write more clever script which runs 50 rclone copy in parallel. Given that you have 19k files to transfer it is better to spend one day to prepare proper solution.

Here is one suggestion:

https://www.gnu.org/software/parallel/

vacuole · June 27, 2023, 5:01pm

Tysm, I will take a look on gnu later
Also I let chatgpt write a python script for me, how does this look?

import subprocess

with open('clonelist.txt', 'r') as file:
    ids = file.readlines()

ids = [id.strip() for id in ids]

concurrent_commands = 50

for i in range(0, len(ids), concurrent_commands):
    batch_ids = ids[i:i + concurrent_commands]
    processes = []

    for id in batch_ids:
        command = 'rclone copy --http-url https://content.archive.ragtag.moe :http:{} "meow_test:box/30"'.format(id)
        process = subprocess.call(command, shell=True)

        processes.append(process)

    for process in processes:
        process.wait()

kapitainsky · June 27, 2023, 5:03pm

Yes this is right direction

vacuole · June 27, 2023, 5:08pm

Then I try it later

kapitainsky · June 27, 2023, 5:30pm

With parallel:

cat clonelist.txt | parallel -j 50 'rclone copy --http-url https://content.archive.ragtag.moe :http:{} meow_test:box/30'

vacuole · June 27, 2023, 6:08pm

Something went wrong

cat clonelist.txt | parallel -j 10 'rclone copy --http-url https://content.archive.ragtag.moe :http:{} meow_test:box/30'

Academic tradition requires you to cite works you base your article on.
If you use programs that use GNU Parallel to process data for an article in a
scientific publication, please cite:

  Tange, O. (2023, June 22). GNU Parallel 20230622 ('Nova Kakhovka').
  Zenodo. https://doi.org/10.5281/zenodo.8051271

This helps funding further development; AND IT WON'T COST YOU A CENT.
If you pay 10000 EUR you should feel free to use GNU Parallel without citing.

More about funding GNU Parallel and the citation notice:
https://www.gnu.org/software/parallel/parallel_design.html#citation-notice

To silence this citation notice: run 'parallel --citation' once.

parallel: Warning: The first three values end in CR-NL. Consider using -d "\r\n"
2023/06/27 20:04:39 ERROR : Attempt 1/3 failed with 1 errors and: failed to stat: HTTP Error: 400 Bad Request
2023/06/27 20:04:40 ERROR : Attempt 2/3 failed with 1 errors and: failed to stat: HTTP Error: 400 Bad Request
2023/06/27 20:04:42 ERROR : Attempt 3/3 failed with 1 errors and: failed to stat: HTTP Error: 400 Bad Request
2023/06/27 20:04:42 Failed to copy: failed to stat: HTTP Error: 400 Bad Request
2023/06/27 20:04:40 ERROR : Attempt 1/3 failed with 1 errors and: failed to stat: HTTP Error: 400 Bad Request
2023/06/27 20:04:41 ERROR : Attempt 2/3 failed with 1 errors and: failed to stat: HTTP Error: 400 Bad Request
2023/06/27 20:04:42 ERROR : Attempt 3/3 failed with 1 errors and: failed to stat: HTTP Error: 400 Bad Request
2023/06/27 20:04:42 Failed to copy: failed to stat: HTTP Error: 400 Bad Request

kapitainsky · June 27, 2023, 6:13pm

Would be surprise if all works first time. You have some bug somewhere:)