Rclone size / insane difference between ACD and GDRIVE

Yesterday I decided to setup a cheap ( 9€/month ) server from online.net. https://www.online.net/en/dedicated-server/dedibox-sc that i will use strictly for syncing my cloud providers. ( they offer unlimited/unmetered 1Gbps bandiwth )

So i setup the simple script that is running in crontab and syncing acdcrypt with gdrivecrypt with gdrivecloud ( the latter is google account with unecrypted content Iam using for Plex Cloud )

acdcrypt and gdrivecrypt is exactly the same content. ( there are daily changes since iam adding new media or upgrading existing one )

atm I still dont have full unencrypted copy on gdrivecloud.

Iam quite satisfied with the speeds for such cheap solution.

( could not say the same for 2 core atom cpu that is basically working close to 100% just with rclone )

For testing purposes i setup a hourly cron that does rclone size remote:/movies , rclone size remote:/series and the difference between results is quite insane. Bellow is the post from last 3 tests, all of them are preformed while rclone is doing sync.

01.03.2017/15:00 COMPARECLOUDS FINISHED IN 2214 SECONDS
01.03.2017/16:00 COMPARECLOUDS START

01.03.2017/16:00 Stats for: acdcrypt:/movies
Total objects: 7515
Total size: 20299.413 GBytes (21796328393928 Bytes)
01.03.2017/16:00 Stats for: acdcrypt:/movies finished in 119 seconds
01.03.2017/16:00 Stats for: acdcrypt:/series
Total objects: 30857
Total size: 23810.727 GBytes (25566573057740 Bytes)
01.03.2017/16:00 Stats for: acdcrypt:/series finished in 46 seconds

01.03.2017/16:00 Stats for: gdrivecrypt:/movies
Total objects: 7518
Total size: 20090.430 GBytes (21571934824655 Bytes)
01.03.2017/16:00 Stats for: gdrivecrypt:/movies finished in 698 seconds
01.03.2017/16:00 Stats for: gdrivecrypt:/series
Total objects: 30850
Total size: 23805.360 GBytes (25560810508854 Bytes)
01.03.2017/16:00 Stats for: gdrivecrypt:/series finished in 182 seconds

01.03.2017/16:00 Stats for: gdrivecloud:/media/movies
Total objects: 7266
Total size: 15741.618 GBytes (16902433136688 Bytes)
01.03.2017/16:00 Stats for: gdrivecloud:/media/movies finished in 572 seconds
01.03.2017/16:00 Stats for: gdrivecloud:/media/series
Total objects: 4140
Total size: 2668.423 GBytes (2865197359087 Bytes)
01.03.2017/16:00 Stats for: gdrivecloud:/media/series finished in 59 seconds

01.03.2017/16:00 COMPARECLOUDS FINISHED IN 1676 SECONDS
01.03.2017/17:00 COMPARECLOUDS START

01.03.2017/17:00 Stats for: acdcrypt:/movies
Total objects: 7517
Total size: 20307.914 GBytes (21805456237680 Bytes)
01.03.2017/17:00 Stats for: acdcrypt:/movies finished in 119 seconds
01.03.2017/17:00 Stats for: acdcrypt:/series
Total objects: 30858
Total size: 23812.107 GBytes (25568055013141 Bytes)
01.03.2017/17:00 Stats for: acdcrypt:/series finished in 46 seconds

01.03.2017/17:00 Stats for: gdrivecrypt:/movies
Total objects: 7518
Total size: 20090.430 GBytes (21571934824655 Bytes)
01.03.2017/17:00 Stats for: gdrivecrypt:/movies finished in 382 seconds
01.03.2017/17:00 Stats for: gdrivecrypt:/series
Total objects: 30850
Total size: 23805.360 GBytes (25560810508854 Bytes)
01.03.2017/17:00 Stats for: gdrivecrypt:/series finished in 278 seconds

01.03.2017/17:00 Stats for: gdrivecloud:/media/movies
Total objects: 7285
Total size: 15920.215 GBytes (17094200517408 Bytes)
01.03.2017/17:00 Stats for: gdrivecloud:/media/movies finished in 576 seconds
01.03.2017/17:00 Stats for: gdrivecloud:/media/series
Total objects: 4140
Total size: 2668.423 GBytes (2865197359087 Bytes)
01.03.2017/17:00 Stats for: gdrivecloud:/media/series finished in 40 seconds

01.03.2017/17:00 COMPARECLOUDS FINISHED IN 1441 SECONDS
01.03.2017/18:00 COMPARECLOUDS START

01.03.2017/18:00 Stats for: acdcrypt:/movies
Total objects: 7518
Total size: 20307.914 GBytes (21805456309664 Bytes)
01.03.2017/18:00 Stats for: acdcrypt:/movies finished in 118 seconds
01.03.2017/18:00 Stats for: acdcrypt:/series
Total objects: 30862
Total size: 23812.107 GBytes (25568055199724 Bytes)
01.03.2017/18:00 Stats for: acdcrypt:/series finished in 47 seconds

01.03.2017/18:00 Stats for: gdrivecrypt:/movies
Total objects: 7518
Total size: 20090.430 GBytes (21571934824655 Bytes)
01.03.2017/18:00 Stats for: gdrivecrypt:/movies finished in 642 seconds
01.03.2017/18:00 Stats for: gdrivecrypt:/series
Total objects: 30850
Total size: 23805.360 GBytes (25560810508854 Bytes)
01.03.2017/18:00 Stats for: gdrivecrypt:/series finished in 272 seconds

01.03.2017/18:00 Stats for: gdrivecloud:/media/movies
Total objects: 7288
Total size: 15927.061 GBytes (17101551191246 Bytes)
01.03.2017/18:00 Stats for: gdrivecloud:/media/movies finished in 519 seconds
01.03.2017/18:00 Stats for: gdrivecloud:/media/series
Total objects: 4140
Total size: 2668.423 GBytes (2865197359087 Bytes)
01.03.2017/18:00 Stats for: gdrivecloud:/media/series finished in 32 seconds

01.03.2017/18:00 COMPARECLOUDS FINISHED IN 1630 SECONDS

So it looks like Gdrive is quite slow, from what I can conclude based on your tests?

For all test i did not just size googledrive was much more unresponsive HOWEVER its reliable eg if you request a file and your average download speed is 400Mbit you will always be in that range.
ACD for example will give you some file sometimes with 400Mbit and 5 minutes later with 20 or 5Mbit speed.

I bet the Gdrive API is rate limiting you when you do your size calculation, which may be the reason why it takes longer.

I use an other vps for this Quick Click Hosting. Its not as fast than yours but for my prupose its okay and they have an good support.

@Ajki I just started 2 weaks ago with my project but during reading though different post i think we have pretty similar conditions and aims.

My question to you is how do you get all your stuff online? I calculate for 14tb with ADSL50k (about 12mbit upload, there is no faster connection here for normal consumers) more than 3 Month. Is there any way to speed this up? I wanted to start a privat conversion beause its offtopic but there is no way here?

Join rclone slack and we can chat there.

1 Like

It would be much more viable to setup sonarr/radarr on one VPS and redownload everything you need on 1gb connection.as you can easily transfer between 4 to 5 TB daily so in 3 days you will get what it would take you 3 months.

Assuming you have usenet and few good indexers.

Damn this dedi server seems incredibly cheap. Is it capable for Plex usage also?

Maybe if only direct play was used but for transcoding no way