Rclone size / insane difference between ACD and GDRIVE

Help and Support
1

Yesterday I decided to setup a cheap ( 9€/month ) server from online.net. https://www.online.net/en/dedicated-server/dedibox-sc that i will use strictly for syncing my cloud providers. ( they offer unlimited/unmetered 1Gbps bandiwth )

So i setup the simple script that is running in crontab and syncing acdcrypt with gdrivecrypt with gdrivecloud ( the latter is google account with unecrypted content Iam using for Plex Cloud )

acdcrypt and gdrivecrypt is exactly the same content. ( there are daily changes since iam adding new media or upgrading existing one )

atm I still dont have full unencrypted copy on gdrivecloud.

Iam quite satisfied with the speeds for such cheap solution.

f9867adec7.png591×137 5.41 KB

( could not say the same for 2 core atom cpu that is basically working close to 100% just with rclone )

For testing purposes i setup a hourly cron that does rclone size remote:/movies , rclone size remote:/series and the difference between results is quite insane. Bellow is the post from last 3 tests, all of them are preformed while rclone is doing sync.

01.03.2017/15:00 COMPARECLOUDS FINISHED IN 2214 SECONDS
01.03.2017/16:00 COMPARECLOUDS START

01.03.2017/16:00 Stats for: acdcrypt:/movies
Total objects: 7515
Total size: 20299.413 GBytes (21796328393928 Bytes)
01.03.2017/16:00 Stats for: acdcrypt:/movies finished in 119 seconds
01.03.2017/16:00 Stats for: acdcrypt:/series
Total objects: 30857
Total size: 23810.727 GBytes (25566573057740 Bytes)
01.03.2017/16:00 Stats for: acdcrypt:/series finished in 46 seconds

01.03.2017/16:00 Stats for: gdrivecrypt:/movies
Total objects: 7518
Total size: 20090.430 GBytes (21571934824655 Bytes)
01.03.2017/16:00 Stats for: gdrivecrypt:/movies finished in 698 seconds
01.03.2017/16:00 Stats for: gdrivecrypt:/series
Total objects: 30850
Total size: 23805.360 GBytes (25560810508854 Bytes)
01.03.2017/16:00 Stats for: gdrivecrypt:/series finished in 182 seconds

01.03.2017/16:00 Stats for: gdrivecloud:/media/movies
Total objects: 7266
Total size: 15741.618 GBytes (16902433136688 Bytes)
01.03.2017/16:00 Stats for: gdrivecloud:/media/movies finished in 572 seconds
01.03.2017/16:00 Stats for: gdrivecloud:/media/series
Total objects: 4140
Total size: 2668.423 GBytes (2865197359087 Bytes)
01.03.2017/16:00 Stats for: gdrivecloud:/media/series finished in 59 seconds

01.03.2017/16:00 COMPARECLOUDS FINISHED IN 1676 SECONDS
01.03.2017/17:00 COMPARECLOUDS START

01.03.2017/17:00 Stats for: acdcrypt:/movies
Total objects: 7517
Total size: 20307.914 GBytes (21805456237680 Bytes)
01.03.2017/17:00 Stats for: acdcrypt:/movies finished in 119 seconds
01.03.2017/17:00 Stats for: acdcrypt:/series
Total objects: 30858
Total size: 23812.107 GBytes (25568055013141 Bytes)
01.03.2017/17:00 Stats for: acdcrypt:/series finished in 46 seconds

01.03.2017/17:00 Stats for: gdrivecrypt:/movies
Total objects: 7518
Total size: 20090.430 GBytes (21571934824655 Bytes)
01.03.2017/17:00 Stats for: gdrivecrypt:/movies finished in 382 seconds
01.03.2017/17:00 Stats for: gdrivecrypt:/series
Total objects: 30850
Total size: 23805.360 GBytes (25560810508854 Bytes)
01.03.2017/17:00 Stats for: gdrivecrypt:/series finished in 278 seconds

01.03.2017/17:00 Stats for: gdrivecloud:/media/movies
Total objects: 7285
Total size: 15920.215 GBytes (17094200517408 Bytes)
01.03.2017/17:00 Stats for: gdrivecloud:/media/movies finished in 576 seconds
01.03.2017/17:00 Stats for: gdrivecloud:/media/series
Total objects: 4140
Total size: 2668.423 GBytes (2865197359087 Bytes)
01.03.2017/17:00 Stats for: gdrivecloud:/media/series finished in 40 seconds

01.03.2017/17:00 COMPARECLOUDS FINISHED IN 1441 SECONDS
01.03.2017/18:00 COMPARECLOUDS START

01.03.2017/18:00 Stats for: acdcrypt:/movies
Total objects: 7518
Total size: 20307.914 GBytes (21805456309664 Bytes)
01.03.2017/18:00 Stats for: acdcrypt:/movies finished in 118 seconds
01.03.2017/18:00 Stats for: acdcrypt:/series
Total objects: 30862
Total size: 23812.107 GBytes (25568055199724 Bytes)
01.03.2017/18:00 Stats for: acdcrypt:/series finished in 47 seconds

01.03.2017/18:00 Stats for: gdrivecrypt:/movies
Total objects: 7518
Total size: 20090.430 GBytes (21571934824655 Bytes)
01.03.2017/18:00 Stats for: gdrivecrypt:/movies finished in 642 seconds
01.03.2017/18:00 Stats for: gdrivecrypt:/series
Total objects: 30850
Total size: 23805.360 GBytes (25560810508854 Bytes)
01.03.2017/18:00 Stats for: gdrivecrypt:/series finished in 272 seconds

01.03.2017/18:00 Stats for: gdrivecloud:/media/movies
Total objects: 7288
Total size: 15927.061 GBytes (17101551191246 Bytes)
01.03.2017/18:00 Stats for: gdrivecloud:/media/movies finished in 519 seconds
01.03.2017/18:00 Stats for: gdrivecloud:/media/series
Total objects: 4140
Total size: 2668.423 GBytes (2865197359087 Bytes)
01.03.2017/18:00 Stats for: gdrivecloud:/media/series finished in 32 seconds

01.03.2017/18:00 COMPARECLOUDS FINISHED IN 1630 SECONDS

2

So it looks like Gdrive is quite slow, from what I can conclude based on your tests?

3

For all test i did not just size googledrive was much more unresponsive HOWEVER its reliable eg if you request a file and your average download speed is 400Mbit you will always be in that range.
ACD for example will give you some file sometimes with 400Mbit and 5 minutes later with 20 or 5Mbit speed.

4

I bet the Gdrive API is rate limiting you when you do your size calculation, which may be the reason why it takes longer.

5

I use an other vps for this Quick Click Hosting. Its not as fast than yours but for my prupose its okay and they have an good support.

@Ajki I just started 2 weaks ago with my project but during reading though different post i think we have pretty similar conditions and aims.

My question to you is how do you get all your stuff online? I calculate for 14tb with ADSL50k (about 12mbit upload, there is no faster connection here for normal consumers) more than 3 Month. Is there any way to speed this up? I wanted to start a privat conversion beause its offtopic but there is no way here?

6

Join rclone slack and we can chat there.

1 Like
7

It would be much more viable to setup sonarr/radarr on one VPS and redownload everything you need on 1gb connection.as you can easily transfer between 4 to 5 TB daily so in 3 days you will get what it would take you 3 months.

Assuming you have usenet and few good indexers.

8

Damn this dedi server seems incredibly cheap. Is it capable for Plex usage also?

9

Maybe if only direct play was used but for transcoding no way