Would you mind some spoon feeding? From your scripts on github I can see the following
#ExecStart=/usr/bin/find /gmedia
#StandardOutput=file:/home/felix/logs/gmedia-find.txt
#ExecStart=/bin/sh -c "/usr/bin/find /gmedia > /home/felix/logs/gmedia-find.txt 2>&1"
So I assume that’s what you used before, however how does rClone find out about the dir list? Do I need to move the txt file somewhere or how…?
Just change:
#ExecStart=/usr/bin/find /gmedia
#StandardOutput=file:/home/felix/logs/gmedia-find.txt
#ExecStart=/bin/sh -c "/usr/bin/find /gmedia > /home/felix/logs/gmedia-find.txt 2>&1"
# This service shall be considered active after start
#
# You can also change to the rc command as well
ExecStart=/usr/bin/rclone rc vfs/refresh recursive=true
which is the default to
ExecStart=/usr/bin/find /gmedia
StandardOutput=file:/home/felix/logs/gmedia-find.txt
ExecStart=/bin/sh -c "/usr/bin/find /gmedia > /home/felix/logs/gmedia-find.txt 2>&1"
# This service shall be considered active after start
#
# You can also change to the rc command as well
#ExecStart=/usr/bin/rclone rc vfs/refresh recursive=true
and I only kept the file because I wanted to see the output. That isn’t needed so you could just do:
ExecStart=/usr/bin/find /gmedia
I guess it has been already asked, but I am just wondering… Approximately how much money you had to put into this setup until now if I may ask? And what are the monthly costs?
Right now I have a small VPS, but I am thinking about an upgrade mainly for some storage upgrade. And maybe a local machine would be a better choice. 
For me, I pay $10 a month for my GDrive and that’s it. I run everything at home.
My setup is more complex than Animosity022. I also do more than what he just does. Here’s my setup before I moved, after, and future build…
Before:
CPU: Intel Xeon E5-2650v1
RAM: 64GB DDR3 ECC Memory
SSD: 200GB Intel SSD (OS Drive)
SSDC: 400GB Intel SSD (Cache)
HDDs: 10x 6TB (42TB Usable)
CPU: Intel Dual Core
RAM: 8GB
SSD: 200GB Intel SSD (OS Drive)
SSDC: 400GB intel SSD (Cache)
HDDs: 10x 6TB (42TB Usable)
CPU: 2x Intel Xeon E5-2650v2
RAM: 128GB DDR3 ECC Memory
SSD: 2x 200GB SSD (OS Drive)
SSDC: 2x 1TB SSD (Cache)
HDDs: 36x 6TB (200TB+ Usable)
JBOD: 45x 8TB (300TB+ Usable)
That’s before I moved, here’s after.
CPU: Intel i7-8700K 4.xGhz+
RAM: 64GB DDR4
SSDs: 2x 480GB NVMe
HDD: 1x 4TB HDD
Future Build
4x
CPU: Intel i7-8700K or Better
RAM: 64GB DDR4
SSDs: 2x 400GB NVMe
SSDs: 2x 1TB SSDs (Cache Drives | RAID0)
Storage will be separate but connected via 40Gbit or 100Gbit Mellanox Connections.The goal is to have 1PB+ of local capacity in a single rack. It’s easily accomplished once you have the hardware. I have a little over half a PB now but most of those drives are 5+ years old, and starting to fail, and a majority of them are in storage right now.
@Animosity022 I’m switching to your setup this weekend. I noticed something with my plex server that’s causing problems too. The rack I’m using has been over sold. A 1Gbit pipe is now being used by 40+ people.I barely get 25Mbit’s up.
Kinda wish there wasn’t all this “run scripts” aimed at people. I don’t trust scripts others wrote, no offense. I’m old school, I manually configure everything before I start adding scripts. Allows me to understand what happens, and what gets affected. I’ll try and figure it out but I’m annoyed.
Holy. 1 Petabyte just to store your own data? 
Why do you need Drive then? And that 128 GiB RAM machine is also interesting. I have one at GCP but I just borrow it. 
Because I’m an archivist. I keep a physical copy, local copy, and a digital copy. Physical is much harder to keep these days, since blurays can only handle so much data, i’m looking at 10 disks per TB. So over 1,000 Blurays just for a PB of storage. Which isn’t really an option, so I keep physical media of whatever I can’t replace. Family photos, movies, etc… I keep a local copy, thus the massive storage, and the digital copy is the Google Cloud. The reason why I use Google Cloud is because it’s much easier to pay for a dedicated service, than it is to find an ISP that’s going to allow you to have absurd bandwidth requirements.
My former ISP I used sold Gigabit up/down unmetered for $85 / month. You won’t find that anywhere else in the United States for that price. Not to mention, the network support / backbone it was connected too. The Fiber Network ran right up the main street to the Data Centers, and that pipe constantly evolved and got bigger. Thus allowing us to have a spanking awesome Fiber Network. The entire city limits has, or is very close to being 100% FTTH (Fiber to the Home). Not to mention, we paid $0.0023 per kW of power. To put it simple, the setup above, would cost me $60 - $70 / month in the summer to cool, that’s my entire apartment @ 60 Degrees F. In the winter, I opened windows to cool the place, and it was constantly below 60, which was fine with me. I sleep better when it cold.
For future reference, do not use Intel Xeons for Plex servers. The way plex works, those processors don’t have a high enough clock speed to make it worth while. If you’re only streaming to 5 - 6 people @ 720p, and occasionally 1080p, it’ll do just fine. You want low core/thread counts and high clock speeds. So, 4c/8t - 8c/16t at 3.5Ghz or higher make epic Plex server processors.
I’ll start a thread when I get time, and I’ll break it down to why you use this setup vs the high core/thread count server processors. Anyways, I’m done hijacking Animosity’s thread. I’ve got a lot to read, and a lot to test out because of his work.
@Animosity022 Would you be willing to break it down more, with no scripts? I’m using an already deployed server, with active users. I can’t really shut it down for days. People get pissy, if you know what I mean 
I’m not sure what you are asking for to be honest in terms of scripts. I have my setup configured for my use.
For a plex server, you really want to make sure you have a chipset that’s current and have support for hardware transcoding as that gives you quite the bang for the buck.
So my issue with your “tutorial” is the lack of information on how to not use scripts. I’m looking at your GitHub, and I haven’t a fucking clue where to even start. It lacks SO much information. I want to give your stuff a shot, but I have no way of knowing how it’ll affect my current setup. The biggest is lack of explanations, it’s beyond complex, and it’s no wonder so many people are dropping in here to ask questions. I’m going to try and re-work it but it’s mind boggling… My current setup sucks, which is the ONLY reason why I’m looking at this.
Maybe that’s a challenge as it’s not a tutorial as it’s my collection of what I personally use and there is an assumption of knowledge.
I’d suggest to start a new thread, share what you have and I’m sure we can help you out.
If you want to show me your tutorial and what you’ve written up, I can look to that to help clean up and add more information to mine 
Haha. I have the knowledge, just when I’m not wiped out and lack sleep. I also started looking at it again when I woke up this morning. I’m not familiar with mergerfs, but from what it looks like, you’re using physical disks and Google Drive to mount. I’ve only got Google Drive, and no physical disks to use. Which is why things weren’t making sense to me at first. Your setup will work with my new server, if I understand it right. Instead of making a post, I’ll PM it.
If you have the knowledge, please feel free to make a pull request on my github so I can help others and items can be clarified in a better way so things are not a “lack of information on how to not use scripts” and I can get passed “lack of explanations” that you described.
My setup works flawlessly for me and I’ve been using it for a number of months now in a fully automated fashion.
Pointing out of flaws or items that need work is easy as I only have a fixed amount of time as well. If you’d like to be part of the solution, that would be superb.
I just got some good news about work, so I’ll have some extra free time but I’m limited on time. I’ll run through your tutorial and see what can be done. I’ll send you a PM.
There are some tutorials online but you’ll need to substitute some steps if they are outdated or using other apps (fusionfs vs mergerfs) I’m curious what your goal is, migrate everything from physical storage to gdrive? And doing that while live with users also? That would be a nice challenge 
I currently have anywhere from 10 to 20 plex streams going at any time of the day. From colleagues at work, to my family members. I’m wanting to migrate the service without having too much down time. If I can configure 90% of the work, and then just “flip” it over, then great.
However, I’m shutting my service down. I’m done paying $150+ per month for my servers and services. I get anywhere from 10 to 100 requests a week for TVShows, Movies, Documentaries or anything else. Hell, I just started getting requests for porn. Which I’m never adding to a Kid Friendly Plex server, which is what I run. I have just a bit over 150TB on my plex server. I’ve been adding about 1TB of data a day for the past 2-ish years. I’ll start a new thread when I start my servers back up.
Sounds great, but I’m still unclear on how rClone finds out about the dir list? What is exactly happening when we just run a find command on the system? I’m not guessing rclone intercepts all finds?
I’m not sure what you mean. I am using a rclone mount so it is a mounted disk.
The find happens on the mounted disk so it’s all rclone.
Rclone is mounted to a directory - Everything good in that regard. What I’m trying to understand is why you run the find service, and what benefit it gives? What’s does the find on the mounted drive result in…? Or the rc vfs/refresh recursive=true if one uses that
The benefit is that it builds the directory/file structure into memory when it is mounted. That saves a little bit of time later at the expense of a few API calls when it’s mounted.
It’s not needed or required, but simply a nice to have for me.
Interesting. After a month or so of flawless performance using RClone VFS - my GDrive hit a Download Quota ban again.
2018/12/30 16:03:22 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 1/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:23 ERROR : TV/Escape at Dannemora/Season 1/Escape at Dannemora - S01E07 - Part 7.mkv: ReadFileHandle.Read error: low level retry 1/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:24 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 2/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:25 ERROR : TV/Escape at Dannemora/Season 1/Escape at Dannemora - S01E07 - Part 7.mkv: ReadFileHandle.Read error: low level retry 2/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:25 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 1/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:26 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 3/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:26 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 2/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:26 ERROR : TV/Escape at Dannemora/Season 1/Escape at Dannemora - S01E07 - Part 7.mkv: ReadFileHandle.Read error: low level retry 3/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:28 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 3/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:29 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 4/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:32 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 1/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:33 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 2/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:35 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 3/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:35 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 1/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:36 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 2/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:36 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 4/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:38 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 5/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:38 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 3/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:39 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 4/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:39 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 6/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:40 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 7/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:41 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 5/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:42 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 8/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/12/30 16:03:42 ERROR : TV/Outlander/Season 4/Outlander - S04E09 - The Birds and the Bees.mkv: ReadFileHandle.Read error: low level retry 6/10: couldn't reopen file with offset and limit: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
I can see around 28-December, I saw increased get activity on the drive - this would coincide with a general apt-get upgrade that I processed around that time. Could be a million different things 
