Emby with rclone dropbox

Hello
I need help with dropbox and rclone becouse emby first scan during so long . Im waiting 2 weeks and nothing finished. My Rclone mount is :

[Unit]
Description=RClone Service
Wants=network-online.target
After=network-online.target

[Service]
Type=notify
Environment=RCLONE_CONFIG=/opt/rclone/rclone.conf
KillMode=none
RestartSec=5
ExecStart=/usr/bin/rclone mount xxxxx: /xxxxx \
# This is for allowing users other than the user running rclone access to the mount
--allow-other \
# Google Drive is a polling remote so this value can be set very high and any changes are detected via polling.
--dir-cache-time 5000h \
# Log file location
--log-file /opt/rclone/rclone.log \
# Set the log level
--log-level NOTICE \
# I reduce the poll interval down to 10 seconds as this makes changes appear fast the API quotas per day are huge
--poll-interval 10s \
# This is setting the file permission on the mount to user and group have the same access and other can read
--umask 002 \
# Please set this to your own value below
--user-agent dropy \
# The local disk used for caching
--cache-dir=/data/cache/ \
# My quota per user / per 100 seconds is 20,000 requests. This can be found in your quota section.
# This changes the sleep calls to something much lower to take advantage of the API boost.
# change the min sleep from 100ms
--drive-pacer-min-sleep 10ms \
# Changing to have the ability to burst higher
--drive-pacer-burst 200 \
# This is used for caching files to local disk for streaming
--vfs-cache-mode full \
# This limits the cache size to the value below
--vfs-cache-max-size 250G \
# This limits the age in the cache if the size is reached and it removes the oldest files first
--vfs-cache-max-age 5000h \
# The polling interval for increased based on there is enough buffer space
--vfs-cache-poll-interval 5m \
# This sets a per file bandwidth control and I limit this to a little bigger than my largest bitrate I'd want to play
--bwlimit-file 32M
ExecStop=/bin/fusermount -uz /drive
Restart=on-failure
User=emby
Group=emby

[Install]
WantedBy=multi-user.target

and emby works fine :

2023-06-21 22:18:27.425 Debug App: Running EpisodeNfoProvider for Sky High_ The Series (2023)/S01/Sky High_ The Series_S01E03_Settling Old Scores.mkv
2023-06-21 22:18:28.689 Debug App: Running TvdbEpisodeProvider for Sky High_ The Series (2023)/S01/Sky High_ The Series_S01E03_Settling Old Scores.mkv
2023-06-21 22:18:28.690 Debug App: Running TvdbEpisodeProvider for Sky High_ The Series (2023)/S01/Sky High_ The Series_S01E03_Settling Old Scores.mkv
2023-06-21 22:18:28.727 Debug App: Running FFProbeProvider for Sky High_ The Series (2023)/S01/Sky High_ The Series_S01E04_Trojan Horse.mkv
2023-06-21 22:18:28.727 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: /opt/emby-server/bin/ffprobe -i file:"Sky High_ The Series (2023)/S01/Sky High_ The Series_S01E04_Trojan Horse.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2023-06-21 22:18:28.728 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2023-06-21 22:18:28.728 Debug App: Running FFProbeProvider for Sky High_ The Series (2023)/S01/Sky High_ The Series_S01E04_Trojan Horse.mkv
2023-06-21 22:18:28.728 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: /opt/emby-server/bin/ffprobe -i file:"Sky High_ The Series (2023)/S01/Sky High_ The Series_S01E04_Trojan Horse.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2023-06-21 22:18:28.728 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2023-06-21 22:18:30.389 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0 - Succeeded
2023-06-21 22:18:30.394 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /opt/emby-server/bin/ffmpeg -i file:"xxxxxxxxxSky High_ The Series (2023)/S01/Sky High_ The Series_S01E04_Trojan Horse.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/var/lib/emby/cache/temp/xxxxxxx
2023-06-21 22:18:30.394 Debug FfmpegManager: ProcessRun 'CreateTitleFingerprint' Started.
2023-06-21 22:18:30.395 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /opt/emby-server/bin/ffmpeg -i file:"XXXXXXSky High_ The Series (2023)/S01/Sky High_ The Series_S01E04_Trojan Horse.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/var/lib/emby/cache/temp/xxxxxx"
2023-06-21 22:18:30.396 Debug FfmpegManager: ProcessRun 'CreateTitleFingerprint' Started.
2023-06-21 22:21:19.926 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0 - Succeeded
2023-06-21 22:21:19.926 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0 - Succeeded

with google i dont had this issue. I hope you can help

I have no idea what emby is - I guess some software but here you are good example of dropbox mount:

How big is your mount?

Does Emby do such file excessive checks like Plex with the create thumbnails, skip intro, or index credits, etc?
If yes, I would disable them.

Or maybe you are throttled on the provider side, where emby is looking for metadata. Like your IP or API token.

You enabled intro skip scanning judging from log u provided, of course it is slow..it has so much scanning to do and it will take a while. With all other basic scans plus intro scan plus possibly chapter images, what do you expect ?

yes, i dumb down emby as much as possible

  1. uninstall all plugins.
  2. disable scheduled task to re-scan libraries, download metadata, etc...
  3. for libraries, use Home videos and photos. not Movies, TV, etc..
  4. Generate video preview thumbnails is disabled by default.
  5. disable 'Enable real time monitoring'

still, emby will do a basic metadate ffmpeg scan.
i think approx 15MiB per 720p tv show.

make sure to use latest emby, as its scanner is much faster than older versions.

why i should select Home videos & photos ? I uninstalled the plugins and disabled scheduled task. Mow seems load much faster.
@alneven 100TB
@Burke i uninstalled plugins
@kapitainsky im using hes configs
thank you

nice!

that is not a requirement, just part of my dumb it down policy ;wink
in my experience, with that setting, emby will offer less options to download stuff from internet and deep scan media.

I am not an expert in videos hoarders business - but personally I do not see why I would disable anything which would make my life easier.

Get big enough cache size - and yes if you have 100TB data you need probably few TB, make sure that cached data stays in cache forever and is only evicted when no space.

Yes initially it will take some time to warm cache and run all scanning but later it should just work.

I think Animosity022 example is perfect setup to get most of the cloud storage but not to lose any fun from using your video library.

emby has changed lot recently, that is why i am in the middle of migrating to jellfyin.

with jellyfin, as i remember it used to be with emby, when selecting Mixed Movies and Shows
using plain folder, not overhead of metadata manager.

jellyfin is good but he has problems with audio on some tv becouse of the player that he uses. Some times no audio becouse the player doesent support it. Thank you all for the help

I'm using Plex for the same setup since 2017, and for 1,5 months ago I moved the whole server to a new hardware and new linux install. It was surprising that I had nothing to do. Just spin up Plex and Tautulli (for monitoring and stats) and claimed the server and it was done. No one recognized anything from the few users I have, and in the background I have also moved storage, and from direct install into docker. So all my Metadata got re-used. It was really good and surprised me how smooth it went.
I was thinking to get another box and check with Jellyfin or Emby how it would work. As my storage is besides 3-4TB in the cloud. But had no time until yet.

I didn't see the --tps-limit option in your mount ? Add it, set it to 11 or 12, it should help. My guess is Emby is hammering the api too much, so you get long push back from Dropbox. A constant 12 tps is much better than more tps for a while, but then you got a "try again in 300 seconds" from Dropbox...

--tpslimit 500 --tpslimit-burst 500 and its now fast with it without is slow for first scan good.

@alneven i switched to docker with privileged true and works goot without performance lose
@asdffdsa Home videos & photos you dont have intro skip

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.