Yamiraan
(Marc Cuadras)
February 16, 2022, 11:20pm
1
I have a second dedicated server where i pointed my web server to mounted remote, i do not have to upload any file from local to remote, but have to download from remote to local cache when someone hit that file with https request,
My below cmd is good for this purpose? any suggestion recommendations?
rclone mount Dropbox: /www/wwwroot/videos/box --daemon --allow-other --poll-interval 10s --tpslimit 12 --tpslimit-burst 12 --dir-cache-time 5000h --vfs-cache-mode full --vfs-cache-max-age 150h --vfs-cache-max-size 600G --cache-dir /www/wwwroot/cache --transfers 64 --log-file /www/wwwroot/rclone.log --dropbox-batch-mode async --dropbox-batch-size 1000 --dropbox-batch-timeout 10s --checkers 64 --fast-list --checksum
I use this cmd for move files on other server and its very fast,
Thnaks
asdffdsa
(jojothehumanmonkey)
February 16, 2022, 11:23pm
2
these do nothing on a mount --checkers 64 --fast-list
not sure that --checksum
does anything at all, or anything of use.
why not just test the command?
Yamiraan
(Marc Cuadras)
February 16, 2022, 11:27pm
3
This is live server many peoples are connected so cannot play with it, thats why needed some experts help, thanks for helping i will remove these flags
asdffdsa
(jojothehumanmonkey)
February 16, 2022, 11:32pm
4
then setup a second rclone mount command.
based on the documenation, these flags are only for uploads
--dropbox-batch-mode async --dropbox-batch-size 1000 --dropbox-batch-timeout 10s
Yamiraan
(Marc Cuadras)
February 16, 2022, 11:34pm
5
so the final cmd will be like below
rclone mount Dropbox: /www/wwwroot/videos/box --daemon --allow-other --poll-interval 10s --tpslimit 12 --tpslimit-burst 12 --dir-cache-time 5000h --vfs-cache-mode full --vfs-cache-max-age 150h --vfs-cache-max-size 600G --cache-dir /www/wwwroot/cache --transfers 64 --log-file /www/wwwroot/rclone.log
Thanks a lot
asdffdsa
(jojothehumanmonkey)
February 16, 2022, 11:36pm
6
as far as i know, when using --vfs-cache-mode full
--transfers 64
does nothing.
i could be wrong, but with any `rclone mount, that flag does nothing.
Yamiraan
(Marc Cuadras)
February 17, 2022, 12:10am
7
my mount cmd is
rclone mount Dropbox: /www/wwwroot/videos/box --daemon --allow-other --poll-interval 10s --tpslimit 12 --tpslimit-burst 12 --dir-cache-time 5000h --vfs-cache-mode full --vfs-cache-max-age 150h --vfs-cache-max-size 200G --cache-dir /www/wwwroot/cache --transfers 64 --log-file /www/wwwroot/rclone.log --allow-non-empty
and getting this error
2022/02/16 16:06:27 ERROR : /www/wwwroot/videos/box: Failed to unmount: exit status 1: fusermount: failed to unmount /www/wwwroot/videos/box: Device or resource busy
any idea
asdffdsa
(jojothehumanmonkey)
February 17, 2022, 12:13am
8
why did you add --allow-non-empty
???
Yamiraan
(Marc Cuadras)
February 17, 2022, 12:16am
9
because i saw in log file
2022/02/16 16:10:46 Fatal error: Directory already mounted, use --allow-non-empty to mount anyway: /www/wwwroot/videos/box
asdffdsa
(jojothehumanmonkey)
February 17, 2022, 12:18am
10
--- --allow-non-empty
should never be used.
--- make sure you are not running another rclone mount in the background.
Yamiraan
(Marc Cuadras)
February 17, 2022, 12:20am
11
no i checked with below cmd and there no any other mount cmd running
ps -aux | grep rclone
Yamiraan
(Marc Cuadras)
February 17, 2022, 12:21am
12
getting this error
2022/02/16 16:20:58 INFO : Starting transaction limiter: max 12 transactions/s with burst 12
2022/02/16 16:20:59 Fatal error: Directory already mounted, use --allow-non-empty to mount anyway: /www/wwwroot/videos/box
ncw
(Nick Craig-Wood)
February 17, 2022, 3:18pm
13
Yamiraan:
I have a second dedicated server where i pointed my web server to mounted remote, i do not have to upload any file from local to remote, but have to download from remote to local cache when someone hit that file with https request,
My below cmd is good for this purpose? any suggestion recommendations?
You will probably get better performance if you use rclone serve http
and proxy that with your webserver. The data is doing less looping through the kernel. It takes most of the same parameters as rclone mount
including --vfs-cache-mode
.
I'd suggest if you are staying with the mount that you add --read-only
as the webserver will never need to write to the mount.
Yamiraan
(Marc Cuadras)
February 17, 2022, 3:31pm
14
Thank you so much, so my new cmd only for server where i dont have to upload anything on remote and only have to view from remote is below, plz take a look and guide me further if necessary,
rclone serve http Dropbox: /www/wwwroot/videos/box --daemon --allow-other --dir-cache-time 5000h --vfs-cache-mode full --vfs-cache-max-age 150h --vfs-cache-max-size 300G --cache-dir /www/wwwroot/cache --log-file /www/wwwroot/rclone.log
Thanks a lot
ncw
(Nick Craig-Wood)
February 18, 2022, 12:11pm
15
That serves the files over http directly. You'd need to remove --daemon
and --allow-other
since these are mount only, but otherwise that looks fine
rclone serve http Dropbox: --dir-cache-time 5000h --vfs-cache-mode full --vfs-cache-max-age 150h --vfs-cache-max-size 300G --cache-dir /www/wwwroot/cache --log-file /www/wwwroot/rclone.log
That will serve the files on http://127.0.0.1:8080/ - proxy this with your webserver, or use it directly.
Yamiraan
(Marc Cuadras)
February 20, 2022, 12:28pm
16
using same cmd
rclone serve http Dropbox:/www/wwwroot/videos/box --dir-cache-time 5000h --vfs-cache-mode full --vfs-cache-max-age 150h --vfs-cache-max-size 300G --cache-dir /www/wwwroot/cache --log-file /www/wwwroot/rclone.log
also pointed domain at 127.0.01.:8080
but still not working,
Log file
2022/02/20 13:26:45 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "serve" "http" "Dropbox:/www/wwwroot/videos/box" "--dir-cache-time" "5000h" "--vfs-cache-mode" "full" "--vfs-cache-max-age" "150h" "--vfs-cache-max-size" "300G" "--cache-dir" "/www/wwwroot/cache" "--log-file" "/www/wwwroot/rclone.log" "-vv"]
2022/02/20 13:26:45 DEBUG : Creating backend with remote "Dropbox:/www/wwwroot/videos/box"
2022/02/20 13:26:45 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2022/02/20 13:26:46 DEBUG : Dropbox root '': Using root namespace "10117126128"
2022/02/20 13:26:47 DEBUG : fs cache: renaming cache item "Dropbox:/www/wwwroot/videos/box" to be canonical "Dropbox:www/wwwroot/videos/box"
2022/02/20 13:26:47 INFO : Dropbox root 'www/wwwroot/videos/box': Failed to get StartCursor: path/not_found/..
2022/02/20 13:26:47 DEBUG : vfs cache: root is "/www/wwwroot/cache"
2022/02/20 13:26:47 DEBUG : vfs cache: data root is "/www/wwwroot/cache/vfs/Dropbox/www/wwwroot/videos/box"
2022/02/20 13:26:47 DEBUG : vfs cache: metadata root is "/www/wwwroot/cache/vfsMeta/Dropbox/www/wwwroot/videos/box"
2022/02/20 13:26:47 DEBUG : Creating backend with remote "/www/wwwroot/cache/vfs/Dropbox/www/wwwroot/videos/box"
2022/02/20 13:26:47 DEBUG : Creating backend with remote "/www/wwwroot/cache/vfsMeta/Dropbox/www/wwwroot/videos/box"
2022/02/20 13:26:47 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
Please
Yamiraan
(Marc Cuadras)
February 20, 2022, 1:14pm
17
ops changed with root path and its working now
Thanks
Yamiraan
(Marc Cuadras)
February 20, 2022, 1:38pm
18
now facing another issue, using rclone serve http
i cannot open a php file from Dropbox, with mount cmd its working perfect, example domain.com/file.php
any clue?
Thanks
ncw
(Nick Craig-Wood)
February 20, 2022, 4:37pm
19
Are you trying to run PHP files from Dropbox?
I think you will need a mount for that as serve http will just send the PHP files not run them.
Yamiraan
(Marc Cuadras)
February 20, 2022, 10:56pm
20
that is only a player file in php extension, trying to run videos in my own player, is there any other way to play videos in my own player using serve http?
Thanks