Dropbox setup rclone komga

Help and Support
1

I’ve moved from using google drive to dropbox and the lag with komga is over a minute to move between pages, which makes it unusable.

Here is my current rclone config which does include the -vfs-cache-mode=full that was the secret sauce on google to fix this issue.

--allow-other
--async-read=true
--dir-cache-time=5000h
--buffer-size=32M
--poll-interval=15s
--rc
--rc-no-auth
--rc-addr=localhost:5729
--use-mmap
--vfs-read-ahead=128M
--vfs-read-chunk-size=32M
--vfs-read-chunk-size-limit=2G
--vfs-cache-max-age=504h
--vfs-cache-mode=full
--vfs-cache-poll-interval=30s
--vfs-cache-max-size=500G
--disable-http2
--tpslimit 12
--tpslimit-burst 0
--umask=002
--syslog
Any suggestions on what to tweak while not breaking plex streaming/uploading

2

check out this setup, as best practice
https://github.com/animosity22/homescripts/blob/master/systemd/rclone-tv.service

and make it as simple as possible, do not add too much extensions, use defaults

3

You enable rc:

--rc
--rc-no-auth
--rc-addr=localhost:5729

but are you running running:

rclone rc vfs/refresh recursive=true --url 127.0.0.1:5729 _async=true

after mounting?

After initial cache warming at least browsing should be a breeze

4

Looking at the reference version supplied above it has the same settings for rc & as well as the run string - are you saying only the run string would do? Would this have any effect if both are included?

cache size doesn’t seem to affect the page lag, it’s slow as you move ahead through the comic no matter how long you take.

Looking at other setups they use “no-seek” & “attr-timeout 20s” but I’m not sure what effect these have?

5

this is an example from the komga site, that was used for google mount that reduced lag:

rclone mount <name>:<path> <mount_point/folder> \
  --no-checksum \
  --use-server-modtime \
  --no-gzip-encoding \
  --no-update-modtime \
  --no-seek \
  --modify-window 2m \
  --allow-other \
  --allow-non-empty \
  --dir-cache-time 30m \
  --cache-read-retries 15 \
  --cache-db-purge \
  --timeout 30m \
  --vfs-cache-mode full \
  --vfs-read-chunk-size 2M \
  --vfs-read-chunk-size-limit 5M \
  --vfs-cache-max-age 30m \
  --attr-timeout 20s \
  --poll-interval 9m \
  --vfs-cache-poll-interval 10m

comparing the 2 setups, which particular one would provide the solution to reduce komga page load time but not affect streaming of media/uploads?

6

Do not use random setting hoping that something will work.

Dropbox is definitely slower than gdrive in my opinion. To compensate you need good caching (you have one) and cache warming to make things smooth.

The example @alneven provided is real good and tested by many people.

you need both:

in your mount command (it does nothing actually really - only enable rc interface):

--rc
--rc-no-auth
--rc-addr=localhost:5729

After you mount you have to run vfs/refresh command - either from systemd or manually from other terminal window.

7

I’m not sure what’s happened as I edited the rclone service file and it won’t start with error:

Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base rclone[12784]: --vfs-write-wait Duration Time to wait for in-sequence wr>
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base rclone[12784]: --volname string Set the volume name (supported >
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base rclone[12784]: --write-back-cache Makes kernel buffer writes befo>
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base rclone[12784]: Use "rclone [command] --help" for more information about a command.
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base rclone[12784]: Use "rclone help flags" for to see the global flags.
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base rclone[12784]: Use "rclone help backends" for a list of supported services.
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base rclone[12784]: Command mount needs 2 arguments minimum: you provided 0 non flag arguments: []
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base systemd[1]: rclone_vfs.service: Main process exited, code=exited, status=1/FAILURE
Jun 16 12:58:32 Ubuntu-2204-jammy-amd64-base systemd[1]: rclone_vfs.service: Failed with result 'exit-code'.

I cannot see any errors and after restoring the old working file it still errors after above.

Any idea?

8

post your service file and we will have a look:)

9

[Service]
User=xx
Group=xx
Type=notify
ExecStartPre=/bin/sleep 10
ExecStart=/usr/bin/rclone mount
--user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36'
--config=/home/xx/.config/rclone/rclone.conf
--allow-other
--async-read=true
--dir-cache-time=9999h
--buffer-size=32M
--poll-interval=15s
--rc
--rc-no-auth
--rc-addr=localhost:5572
--use-mmap
--vfs-read-ahead=128M
--vfs-read-chunk-size=32M
--vfs-read-chunk-size-limit=2G
--vfs-cache-max-age=504h
--vfs-cache-mode=full
--vfs-cache-poll-interval=30s
--vfs-cache-max-size=250G
--vfs-fast-fingerprint
--vfs-write-back 1h
--tpslimit 12
--tpslimit-burst 0
--umask=002
--syslog
-v
dropbox-crypt: /mnt/remote
ExecStartPost=/usr/bin/rclone rc vfs/refresh recursive=true --url http://localhost:5572 _async=true
ExecStop=/bin/fusermount -uz /mnt/remote
Restart=on-abort
RestartSec=5
StartLimitInterval=60s
StartLimitBurst=3

10

hello and welcome to the forum,

To the future reader reading this. For this case scenario, having plex and komga at the same time streaming from GDrive can be a little bit tricky. The best way to do it is to create a different mount for Komga

as mentioned, start with this and tweak as needed.
https://github.com/animosity22/homescripts/blob/master/systemd/rclone-tv.service

we are missing some basic info???

  • the full output of rclone version. note: latest stable is v1.62.2
  • the full redacted output of rclone config show
  • strange that komga would suggest these flags for the deprecated cache remote?
  --cache-read-retries 15 \
  --cache-db-purge \
11

here is the service part, that I changed back to what I had before:

[Service]
User=xx
Group=xx
Type=notify
ExecStartPre=/bin/sleep 10
ExecStart=/usr/bin/rclone mount
--user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36'
--config=/home/xx/.config/rclone/rclone.conf
--allow-other
--async-read=true
--dir-cache-time=9999h
--buffer-size=32M
--poll-interval=15s
--rc
--rc-no-auth
--rc-addr=localhost:5572
--use-mmap
--vfs-read-ahead=128M
--vfs-read-chunk-size=32M
--vfs-read-chunk-size-limit=2G
--vfs-cache-max-age=504h
--vfs-cache-mode=full
--vfs-cache-poll-interval=30s
--vfs-cache-max-size=250G
--vfs-fast-fingerprint
--vfs-write-back 1h
--tpslimit 12
--tpslimit-burst 0
--umask=002
--syslog
-v
dropbox-crypt: /mnt/remote
ExecStartPost=/usr/bin/rclone rc vfs/refresh recursive=true --url http://localhost:5572 _async=true
ExecStop=/bin/fusermount -uz /mnt/remote
Restart=on-abort
RestartSec=5
StartLimitInterval=60s
StartLimitBurst=3

12

what you posted is wrong... maybe just copy paste problem

It should look like that:

ExecStart=/usr/bin/rclone mount \
--user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36' \
--config=/home/xx/.config/rclone/rclone.conf \
--allow-other \
--async-read=true \
--dir-cache-time=9999h \
...
dropbox-crypt: /mnt/remote

Have you missed \ characters? Correct and post again.

13

I think paste issue as after daemon-reload the old config worked, just had a panic attack :slight_smile:

Not to run this on too long, in the listing above can you see anything that might be worth changing for the komga issue - if its only based on the cache size and bigger is better then I’m not sure why it is so slow with images when it can stream a video file no issues.

14

run:

rclone rc --url 127.0.0.1:5572 vfs/stats

It will show you if cache warming is fiished

15

and can you explain why you use these options? What is the reason?

--user-agent=
--async-read=true 
--use-mmap

if not sure just copy/paste example we sent earlier - these are battle tested options - then when things do not work we can try to tweak.

16

and if there are any problem do not forget these.

17

or just start it from scratch, download the file from github, rename it, and change the most important part of it, for example name of the remote and the local path, location of your rclone.conf, and where to put logs
enable the systemd
and enjoy

18

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.