Having to start my Plex server from scratch, and scanning content in is slow

[Jason_Lucas]

What is the problem you are having with rclone?

I'm looking for the best mount settings for scanning my Large 100TB library in, my database became corrupt beyond repair, so I am having to start fresh scanning everything back into a new database, however it seems painfully slow. By slow I am talking, in just under 10 hours its scanned in 41 out of 701 TV Shows. My current mount is;

rclone mount --config=/mnt/nvme/plexified/mounts/rclone/rclone.conf --allow-non-empty --allow-other --vfs-read-chunk-size 64M --vfs-cache-mode full --cache-dir /mnt/ssd/plexified/mounts/googlecache/ --vfs-cache-max-size 250G --dir-cache-time 256h --vfs-fast-fingerprint --vfs-refresh --drive-impersonate admin@googleuser.com googledecrypted: /mnt/ssd/plexified/mounts/google/

Run the command 'rclone version' and share the full output of the command.

rclone v1.70.0-beta.8513.b742705d0

• os/version: slackware 15.0+ (64 bit)
• os/kernel: 6.6.68-Unraid (x86_64)
• os/type: linux
• os/arch: amd64
• go/version: go1.23.4
• go/linking: static
• go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone mount --config=/mnt/nvme/plexified/mounts/rclone/rclone.conf --allow-other --vfs-read-chunk-size 64M --vfs-cache-mode full --cache-dir /mnt/ssd/plexified/mounts/googlecache/ --vfs-cache-max-size 250G --dir-cache-time 256h --vfs-fast-fingerprint --vfs-refresh --drive-impersonate admin@googleuser.com googledecrypted: /mnt/ssd/plexified/mounts/google/

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[google]
type = drive
scope = drive
service_account_file = /mnt/nvme/plexified/mounts/rclonekeys/humbleproject-825a726988cb.json
team_drive = XXX
root_folder_id = XXX

[googledecrypted]
type = crypt
remote = google:
filename_encryption = standard
password = XXX
password2 = XXX

A log from the command that you were trying to run with the -vv flag

N/A

[Animosity022]

I'd imagine it's your plex settings.

Have intro on? credits on? It has to read through every episode for that stuff.

[Jason_Lucas]

I made sure to turn all of those off, until at least the items are scanned in!

I think the fact it has to analyze the files on the mount for Video/Audio is what's slowing it down.

[Animosity022]

You'd want to check the rclone debug log and share that as that might offer something.

Depending on your connection though, scanning 100TB fresh would take many days.

Plex usually has backups of the database as wel under scheduled tasks. You can probably recover if you have that going:

[asdffdsa (jojothehumanmonkey)]

@Jason_Lucas

just under 10 hours its scanned in 41 out of 701 TV Shows

for the install full scan, i reduce the chunk size and chunk size doubling.
maybe something like --vfs-read-chunk-size=10M --vfs-read-chunk-size-limit=0

[Animosity022]

@asdffdsa

for the install full scan, i reduce the chunk size and chunk size doubling.
maybe something like --vfs-read-chunk-size=10M --vfs-read-chunk-size-limit=0

I tested quite a number of permutations and that netted almost no changes in any scanning performance with Plex.

[asdffdsa (jojothehumanmonkey)]

@Animosity022

I tested quite a number of permutations and that netted almost no changes in any scanning performance with Plex

thanks, good to know.