Why I can't use rclone HTTP with this website?

What is the problem you are having with rclone?

I set a rclone config of HTTP, but something wrong happened.
(The remote(named remote_pubchemqc) url is https://chibakoudai.sharepoint.com/sites/stair02/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2Fstair02%2FShared%20Documents%2Fdata%2FPubChemQC%2FB3LYP&p=true&ga=1 )

But I can not use rclone for lsd ...

Run the command 'rclone version' and share the full output of the command.

  • os/version: ubuntu 16.04 (64 bit)
  • os/kernel: 4.4.0-210-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.18.3
  • go/linking: static
  • go/tags: none

yes

Which cloud storage system are you using? (eg Google Drive)

HTTP

The command you were trying to run (eg rclone copy /tmp remote:tmp)

# This is what I want to run
rclone lsd remote_pubchemqc: -vv
# This is the result, a 403 wrong:
2022/09/04 10:27:08 DEBUG : rclone: Version "v1.59.1-DEV" starting with parameters ["rclone" "lsd" "remote_pubchemqc:" "-vv"]
2022/09/04 10:27:08 DEBUG : Creating backend with remote "remote_pubchemqc:"
2022/09/04 10:27:08 DEBUG : Using config file from "/home/why/.config/rclone/rclone.conf"
2022/09/04 10:27:08 DEBUG : Root: https://chibakoudai.sharepoint.com/sites/stair02/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2Fstair02%2FShared%20Documents%2Fdata%2FPubChemQC%2FB3LYP&p=true&ga=1/
2022/09/04 10:27:09 ERROR : : error listing: error listing "": failed to readDir: HTTP Error: 403 Forbidden
2022/09/04 10:27:09 DEBUG : 3 go routines active
2022/09/04 10:27:09 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error: 403 Forbidden
# I think mybe 403 is because I need to type the user-agent? So I type a Virtual content :
rclone lsd remote_pubchemqc: -vv --user-agent 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.11 (KHTML, like Gecko) Ubuntu/11.10 Chromium/27.0.1453.93 Chrome/27.0.1453.93 Safari/537.36'

# This is the result, nothing wrong but i still nothing display:
KHTML, like Gecko) Ubuntu/11.10 Chromium/27.0.1453.93 Chrome/27.0.1453.93 Safari/537.36'
2022/09/04 10:27:43 DEBUG : rclone: Version "v1.59.1-DEV" starting with parameters ["rclone" "lsd" "remote_pubchemqc:" "-vv" "--user-agent" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.11 (KHTML, like Gecko) Ubuntu/11.10 Chromium/27.0.1453.93 Chrome/27.0.1453.93 Safari/537.36"]
2022/09/04 10:27:43 DEBUG : Creating backend with remote "remote_pubchemqc:"
2022/09/04 10:27:43 DEBUG : Using config file from "/home/why/.config/rclone/rclone.conf"
2022/09/04 10:27:43 DEBUG : Root: https://chibakoudai.sharepoint.com/sites/stair02/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2Fstair02%2FShared%20Documents%2Fdata%2FPubChemQC%2FB3LYP&p=true&ga=1/
2022/09/04 10:27:46 DEBUG : 5 go routines active

The rclone config contents with secrets removed.

Current remotes:

Name                 Type
====                 ====
remote_pubchemqc     http

e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> e

Select remote.
Choose a number from below, or type in an existing value.
 1 > remote_pubchemqc
remote> 1

Editing existing "remote_pubchemqc" remote with options:
- type: http
- url: https://chibakoudai.sharepoint.com/sites/stair02/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2Fstair02%2FShared%20Documents%2Fdata%2FPubChemQC%2FB3LYP&p=true&ga=1

Option url.
URL of HTTP host to connect to.
E.g. "https://example.com", or "https://user:pass@example.com" to use a username and password.
Enter a string value. Press Enter for the default (https://chibakoudai.sharepoint.com/sites/stair02/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2Fstair02%2FShared%20Documents%2Fdata%2FPubChemQC%2FB3LYP&p=true&ga=1).

A log from the command with the -vv flag

# This is what I want to run
rclone lsd remote_pubchemqc: -vv
# This is the result, a 403 wrong:
2022/09/04 10:27:08 DEBUG : rclone: Version "v1.59.1-DEV" starting with parameters ["rclone" "lsd" "remote_pubchemqc:" "-vv"]
2022/09/04 10:27:08 DEBUG : Creating backend with remote "remote_pubchemqc:"
2022/09/04 10:27:08 DEBUG : Using config file from "/home/why/.config/rclone/rclone.conf"
2022/09/04 10:27:08 DEBUG : Root: https://chibakoudai.sharepoint.com/sites/stair02/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2Fstair02%2FShared%20Documents%2Fdata%2FPubChemQC%2FB3LYP&p=true&ga=1/
2022/09/04 10:27:09 ERROR : : error listing: error listing "": failed to readDir: HTTP Error: 403 Forbidden
2022/09/04 10:27:09 DEBUG : 3 go routines active
2022/09/04 10:27:09 Failed to lsd with 2 errors: last error was: error listing "": failed to readDir: HTTP Error: 403 Forbidden
# I think mybe 403 is because I need to type the user-agent? So I type a Virtual content :
rclone lsd remote_pubchemqc: -vv --user-agent 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.11 (KHTML, like Gecko) Ubuntu/11.10 Chromium/27.0.1453.93 Chrome/27.0.1453.93 Safari/537.36'

# This is the result, nothing wrong but i still nothing display:
KHTML, like Gecko) Ubuntu/11.10 Chromium/27.0.1453.93 Chrome/27.0.1453.93 Safari/537.36'
2022/09/04 10:27:43 DEBUG : rclone: Version "v1.59.1-DEV" starting with parameters ["rclone" "lsd" "remote_pubchemqc:" "-vv" "--user-agent" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.11 (KHTML, like Gecko) Ubuntu/11.10 Chromium/27.0.1453.93 Chrome/27.0.1453.93 Safari/537.36"]
2022/09/04 10:27:43 DEBUG : Creating backend with remote "remote_pubchemqc:"
2022/09/04 10:27:43 DEBUG : Using config file from "/home/why/.config/rclone/rclone.conf"
2022/09/04 10:27:43 DEBUG : Root: https://chibakoudai.sharepoint.com/sites/stair02/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2Fstair02%2FShared%20Documents%2Fdata%2FPubChemQC%2FB3LYP&p=true&ga=1/
2022/09/04 10:27:46 DEBUG : 5 go routines active

hello and welcome to the forum,

i think you need to create a webdav remote for sharepoint.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.