Rclone http remote

Help and Support
1

What is the problem you are having with rclone?

I've setup a rclone remote using http as the backend. I can list the remote and view all the files on the server. The issue is that most of the files are showing up as zero bytes when listing the directories and when trying to play the files through vlc or plex, both errors out.
When I initiate a rclone copy of a file directly it works as expected.

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 5.15.0-67-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.20.2
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

http

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone mount remote:/ data/media/ --daemon --allow-other -vv

The rclone config contents with secrets removed.

[remote]
type = http
url = https://x.x.x.x/
no_slash = false
no_head = false

A log from the command with the -vv flag

2023/03/16 22:31:06 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "mount" "remote:/" "/data/media/" "--daemon" "--allow-other" "-vv"]
2023/03/16 22:31:06 DEBUG : Creating backend with remote "test:/"
2023/03/16 22:31:06 DEBUG : Using config file from "/home/xxxx/.config/rclone/rclone.conf"
2023/03/16 22:31:06 DEBUG : Root: https://x.x.x.x/
2023/03/16 22:31:07 DEBUG : rclone: Version "v1.62.2" finishing with parameters ["/usr/bin/rclone" "mount" "remote:/" "/data/media/" "--daemon" "--allow-other" "-vv"]
2

copy, using what tool?

what is it?
did not see any errors in that very short debug log?
that rclone log is just one second in length?

3

Sorry about that I updated the notes.
Rclone copy works fine. I can't play the files when the remote is mounted through plex or vlc.

4

ok, but there the log is just one second???
if the mount command is not running, then for sure, cannot play files.

5

Correct because it mount correctly, rclone isn't giving any errors and it seems to be working correctly until I ls the files on the mounted drive. Most show up as zero bytes.

image
image1069×69 16.6 KB

trying to play these files in vlc/plex error out.
Let me see if rclone gives an error in the logs when I play the files.

6

based on the log output, that is not correct.
the command run for just one second.

7

Also, if I use sftp as the backend this does not occur, only when using http.

8

if you can post a rclone debug log, with an actual issue, we can take a look at that.....

if sftp works, then why bother with http?

imho, i would try with an older version of rclone, perhaps v1.61.1

9

Thanks for trying to help.
I output the log into a log file and you're right there is more to it. Here is the full log.

2023/03/16 23:41:37 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "mount" "test:/" "/home/xtinct101/data/media/" "--daemon" "--allow-other" "-vv" "--log-file" "/home/xtinct101/scripts/logs/rclone.log"]
2023/03/16 23:41:37 DEBUG : Creating backend with remote "test:/"
2023/03/16 23:41:37 DEBUG : Using config file from "/home/xtinct101/.config/rclone/rclone.conf"
2023/03/16 23:41:37 DEBUG : Root: https://xxxx/
2023/03/16 23:41:38 DEBUG : rclone: Version "v1.62.2" starting with parameters ["/usr/bin/rclone" "mount" "test:/" "/home/xtinct101/data/media/" "--daemon" "--allow-other" "-vv" "--log-file" "/home/xtinct101/scripts/logs/rclone.log"]
2023/03/16 23:41:38 DEBUG : Creating backend with remote "test:/"
2023/03/16 23:41:38 DEBUG : Using config file from "/home/xtinct101/.config/rclone/rclone.conf"
2023/03/16 23:41:38 DEBUG : Root: https://xxxx/
2023/03/16 23:41:38 INFO  : https://xxxx/: poll-interval is not supported by this remote
2023/03/16 23:41:38 DEBUG : https://xxxx/: Mounting on "/home/xtinct101/data/media/"
2023/03/16 23:41:38 DEBUG : : Root: 
2023/03/16 23:41:38 DEBUG : : >Root: node=/, err=<nil>
2023/03/16 23:41:38 DEBUG : rclone: Version "v1.62.2" finishing with parameters ["/usr/bin/rclone" "mount" "test:/" "/home/xtinct101/data/media/" "--daemon" "--allow-other" "-vv" "--log-file" "/home/xtinct101/scripts/logs/rclone.log"]
10

You're right, but for whatever reason I'm getting abysmal speeds using sftp
Trying http yielded far better results when copying but unfortunately when mounting I'm getting this issue.

11

Thanks for the help. I'll stick with sftp and try figure out whats happening with the speed.

12

ok, not sure what is going on, but i can tell you that everyday,
i use a rclone mount point to a sftp server, streaming works great.
as we speak, streaming a media file....

so far, every rclone debug output that you posted, is just one single second in duration???
if rclone mount command is not runing, never going to be able to stream media.

maybe might try
--- remove --daemon
--- add --vfs-cache-mode=full

13

not sure your use-case, but rclone can emulate a number of servers.
rclone serve ftp/sftp/dlna/http

14

Thanks again for the help.
Here's a little more info.
At first I thought sftp was slow but I just ran a few tests and running rclone copy on the sftp remote I get over 30MB/s.
Copying the file through windows explorer using the the sftp mount, I see around 15MB/s.
Trying to stream the file to VLC or Plex the speed drops down to around 2MB/s.

15

...............

16

adding --vfs-cache-mode=full seems to have fixed the issue.
Thanks again!

17

im using rclone http and im very happy, speed is very good, if u have to play video then do not use rclone mount, use rclone http that is much better

Good Luck

18

hi, did you mean rclone serve http, which i mentioned up above or what?

19

@asdffdsa yes that is great, can i ask u a quick qestion abo vfs cache?

20

i remember you :wink:
so sure, please ask the question...