Aethaeran
March 4, 2021, 10:44pm
1
What is the problem you are having with rclone?
I would like to use rclone to mount the-eye.eu for easy rclone syncs. I wasn't having any luck with the config file so I thought I'd try the simple command as someone else has here.
https://forum.rclone.org/t/http-can-use-without-config-file-but-not-with/10359
However, I keep getting a 403 error when trying to list directories from an http remote. I have no trouble accessing the site through the a web browser or curl .wget has not problem accessing and downlading the directory with:
wget -m -np -c -U "eye02" -w 2 -R "index.html*" "https://the-eye.eu/public/"
What is your rclone version (output from rclone version)
rclone v1.51.0
os/arch: linux/amd64
go version: go1.13.7
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Distributor ID: Ubuntu
Which cloud storage system are you using? (eg Google Drive)
https://rclone.org/http/
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone lsd --http-url https://the-eye.eu/public/ :http: -vv
The rclone config contents with secrets removed.
Irrelevant I believe. Correct me if I'm wrong.
A log from the command with the -vv flag
root@aethaeran:/test# rclone lsd --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 14:35:51 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 14:35:51 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/03/04 14:35:52 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2021/03/04 14:35:52 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
You need to update your version as your version is old, which causes the issue.
1 Like
Aethaeran
March 5, 2021, 2:08am
3
Thanks for the quick reply. Oh how I wish it had been so simple though.
root@aethaeran:/home/aethaeran# curl https://rclone.org/install.sh | sudo bash
...
rclone v1.54.0 has successfully installed.
Now run "rclone config" for setup. Check https://rclone.org/docs/ for more details.
root@aethaeran:/home/aethaeran# rclone lsd --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 18:05:24 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 18:05:24 DEBUG : Creating backend with remote ":http:"
2021/03/04 18:05:24 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/03/04 18:05:25 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2021/03/04 18:05:25 DEBUG : 3 go routines active
2021/03/04 18:05:25 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
root@aethaeran:/home/aethaeran# rclone version
rclone v1.54.0
- os/arch: linux/amd64
- go version: go1.15.7
Works fine for me:
felix@gemini:~$ rclone lsd --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 21:16:49 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 21:16:49 DEBUG : Creating backend with remote ":http:"
2021/03/04 21:16:49 DEBUG : Using config file from "/opt/rclone/rclone.conf"
-1 1969-12-31 19:00:00 -1 AI
-1 1969-12-31 19:00:00 -1 AppleArchive
-1 1969-12-31 19:00:00 -1 AudioBooks
-1 1969-12-31 19:00:00 -1 Books
-1 1969-12-31 19:00:00 -1 Comics
-1 1969-12-31 19:00:00 -1 Games
-1 1969-12-31 19:00:00 -1 Icons
-1 1969-12-31 19:00:00 -1 Images
-1 1969-12-31 19:00:00 -1 JFK_Files
-1 1969-12-31 19:00:00 -1 MSDN
-1 1969-12-31 19:00:00 -1 Music
-1 1969-12-31 19:00:00 -1 Operating Systems
-1 1969-12-31 19:00:00 -1 Papers
-1 1969-12-31 19:00:00 -1 Piracy
-1 1969-12-31 19:00:00 -1 Posters
-1 1969-12-31 19:00:00 -1 Psychedelics
-1 1969-12-31 19:00:00 -1 Psychoactives
-1 1969-12-31 19:00:00 -1 Radio
-1 1969-12-31 19:00:00 -1 Random
-1 1969-12-31 19:00:00 -1 Site-Dumps
-1 1969-12-31 19:00:00 -1 Software
-1 1969-12-31 19:00:00 -1 Strategic Intelligence Network
-1 1969-12-31 19:00:00 -1 WorldTracker.org
-1 1969-12-31 19:00:00 -1 concen.org
-1 1969-12-31 19:00:00 -1 freenrg.info
-1 1969-12-31 19:00:00 -1 murdercube.com
-1 1969-12-31 19:00:00 -1 parazite
-1 1969-12-31 19:00:00 -1 rom
-1 1969-12-31 19:00:00 -1 touhou
-1 1969-12-31 19:00:00 -1 vns
-1 1969-12-31 19:00:00 -1 xbins
-1 1969-12-31 19:00:00 -1 xbins.diodematrix
2021/03/04 21:16:49 DEBUG : 3 go routines active
sweh
March 5, 2021, 2:28am
5
FWIW, this fails for me
2021/03/04 21:24:39 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 21:24:39 DEBUG : Creating backend with remote ":http:"
2021/03/04 21:24:39 DEBUG : Using config file from "/home/sweh/.config/rclone/rclone.conf"
2021/03/04 21:24:39 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2021/03/04 21:24:39 DEBUG : 3 go routines active
2021/03/04 21:24:39 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 ForbiddenHowever, if I set the user-agent then it works
% rclone lsd --user-agent eye02 --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 21:28:28 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--user-agent" "eye02" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 21:28:28 DEBUG : Creating backend with remote ":http:"
2021/03/04 21:28:28 DEBUG : Using config file from "/home/sweh/.config/rclone/rclone.conf"
-1 1969-12-31 19:00:00 -1 AI
-1 1969-12-31 19:00:00 -1 AppleArchive
-1 1969-12-31 19:00:00 -1 AudioBooks
-1 1969-12-31 19:00:00 -1 Books
-1 1969-12-31 19:00:00 -1 Comics
-1 1969-12-31 19:00:00 -1 Games
-1 1969-12-31 19:00:00 -1 Icons
2 Likes
Oh, that makes sense as I have an environment variable for mine so it always applies. Solid!
system
March 8, 2021, 3:08am
8
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.