Rclone lsd :http: - 403 Forbidden

What is the problem you are having with rclone?

I would like to use rclone to mount the-eye.eu for easy rclone syncs. I wasn't having any luck with the config file so I thought I'd try the simple command as someone else has here.

https://forum.rclone.org/t/http-can-use-without-config-file-but-not-with/10359

However, I keep getting a 403 error when trying to list directories from an http remote. I have no trouble accessing the site through the a web browser or curl.
As advertised on the webpage wget has not problem accessing and downlading the directory with:

wget -m -np -c -U "eye02" -w 2 -R "index.html*" "https://the-eye.eu/public/"

What is your rclone version (output from rclone version)

rclone v1.51.0

  • os/arch: linux/amd64
  • go version: go1.13.7

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Distributor ID: Ubuntu
Description: Ubuntu 16.04.6 LTS
Release: 16.04
Codename: xenial

Which cloud storage system are you using? (eg Google Drive)

https://rclone.org/http/

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone lsd --http-url https://the-eye.eu/public/ :http: -vv

The rclone config contents with secrets removed.

Irrelevant I believe. Correct me if I'm wrong.

A log from the command with the -vv flag

root@aethaeran:/test# rclone lsd --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 14:35:51 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 14:35:51 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/03/04 14:35:52 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2021/03/04 14:35:52 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden

You need to update your version as your version is old, which causes the issue.

1 Like

Thanks for the quick reply. Oh how I wish it had been so simple though.

root@aethaeran:/home/aethaeran# curl https://rclone.org/install.sh | sudo bash
...
rclone v1.54.0 has successfully installed.
Now run "rclone config" for setup. Check https://rclone.org/docs/ for more details.

root@aethaeran:/home/aethaeran# rclone lsd --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 18:05:24 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 18:05:24 DEBUG : Creating backend with remote ":http:"
2021/03/04 18:05:24 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/03/04 18:05:25 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2021/03/04 18:05:25 DEBUG : 3 go routines active
2021/03/04 18:05:25 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
root@aethaeran:/home/aethaeran# rclone version
rclone v1.54.0
- os/arch: linux/amd64
- go version: go1.15.7

Works fine for me:

felix@gemini:~$ rclone lsd --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 21:16:49 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 21:16:49 DEBUG : Creating backend with remote ":http:"
2021/03/04 21:16:49 DEBUG : Using config file from "/opt/rclone/rclone.conf"
          -1 1969-12-31 19:00:00        -1 AI
          -1 1969-12-31 19:00:00        -1 AppleArchive
          -1 1969-12-31 19:00:00        -1 AudioBooks
          -1 1969-12-31 19:00:00        -1 Books
          -1 1969-12-31 19:00:00        -1 Comics
          -1 1969-12-31 19:00:00        -1 Games
          -1 1969-12-31 19:00:00        -1 Icons
          -1 1969-12-31 19:00:00        -1 Images
          -1 1969-12-31 19:00:00        -1 JFK_Files
          -1 1969-12-31 19:00:00        -1 MSDN
          -1 1969-12-31 19:00:00        -1 Music
          -1 1969-12-31 19:00:00        -1 Operating Systems
          -1 1969-12-31 19:00:00        -1 Papers
          -1 1969-12-31 19:00:00        -1 Piracy
          -1 1969-12-31 19:00:00        -1 Posters
          -1 1969-12-31 19:00:00        -1 Psychedelics
          -1 1969-12-31 19:00:00        -1 Psychoactives
          -1 1969-12-31 19:00:00        -1 Radio
          -1 1969-12-31 19:00:00        -1 Random
          -1 1969-12-31 19:00:00        -1 Site-Dumps
          -1 1969-12-31 19:00:00        -1 Software
          -1 1969-12-31 19:00:00        -1 Strategic Intelligence Network
          -1 1969-12-31 19:00:00        -1 WorldTracker.org
          -1 1969-12-31 19:00:00        -1 concen.org
          -1 1969-12-31 19:00:00        -1 freenrg.info
          -1 1969-12-31 19:00:00        -1 murdercube.com
          -1 1969-12-31 19:00:00        -1 parazite
          -1 1969-12-31 19:00:00        -1 rom
          -1 1969-12-31 19:00:00        -1 touhou
          -1 1969-12-31 19:00:00        -1 vns
          -1 1969-12-31 19:00:00        -1 xbins
          -1 1969-12-31 19:00:00        -1 xbins.diodematrix
2021/03/04 21:16:49 DEBUG : 3 go routines active

FWIW, this fails for me

2021/03/04 21:24:39 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 21:24:39 DEBUG : Creating backend with remote ":http:"
2021/03/04 21:24:39 DEBUG : Using config file from "/home/sweh/.config/rclone/rclone.conf"
2021/03/04 21:24:39 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2021/03/04 21:24:39 DEBUG : 3 go routines active
2021/03/04 21:24:39 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden

However, if I set the user-agent then it works

% rclone lsd --user-agent eye02 --http-url https://the-eye.eu/public/ :http: -vv
2021/03/04 21:28:28 DEBUG : rclone: Version "v1.54.0" starting with parameters ["rclone" "lsd" "--user-agent" "eye02" "--http-url" "https://the-eye.eu/public/" ":http:" "-vv"]
2021/03/04 21:28:28 DEBUG : Creating backend with remote ":http:"
2021/03/04 21:28:28 DEBUG : Using config file from "/home/sweh/.config/rclone/rclone.conf"
          -1 1969-12-31 19:00:00        -1 AI
          -1 1969-12-31 19:00:00        -1 AppleArchive
          -1 1969-12-31 19:00:00        -1 AudioBooks
          -1 1969-12-31 19:00:00        -1 Books
          -1 1969-12-31 19:00:00        -1 Comics
          -1 1969-12-31 19:00:00        -1 Games
          -1 1969-12-31 19:00:00        -1 Icons
1 Like

Oh, that makes sense as I have an environment variable for mine so it always applies. Solid!

Thanks so much!

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.