Rclone size results are different for shared crypt folder on Google Drive for newly added users

Help and Support
1

What is the problem you are having with rclone?

rclone size results are different for shared crypt folder on Google Drive for newly added users

Run the command 'rclone version' and share the full output of the command.

rclone v1.59.1

  • os/version: ubuntu 20.04 (64 bit)
  • os/kernel: 5.4.0-131-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.18.5
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Paste command here

rclone size crypt:1080pWEB-DL/ Total objects: 2.372k (2372)
Total size: 4.747 TiB (5219796693887 Byte)

The rclone config contents with secrets removed.

Paste config here

[gsuite]
type = drive
client_id = xxxxx>
client_secret = xxxx
scope = drive
token = {"access_token":"xxxxxr>

[crypt]
type = crypt
remote = gsuite:crypt
filename_encryption = standard
directory_name_encryption = true
password = xxxx

[becca]
type = drive
client_id = xxxx>
client_secret = xxxx
scope = drive
token = {"access_token":"xxxx>

A log from the command with the -vv flag

Paste  log here
```2022/11/14 08:32:57 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "size" "-vv" "--log-file=FILE" "terrorcrypt:1080pWEB-DL/"]
2022/11/14 08:32:57 DEBUG : Creating backend with remote "beccacrypt:1080pWEB-DL/"
2022/11/14 08:32:57 DEBUG : Using config file from "/home/tcd/.config/rclone/rclone.conf"
2022/11/14 08:32:57 DEBUG : Creating backend with remote "becca:crypt/f9ut45jfnj1bu07db4fj74ggo4"
2022/11/14 08:32:57 DEBUG : Google drive root 'crypt/f9ut45jfnj1bu07db4fj74ggo4': 'root_folder_id = 0ANoqch0jn-EGUk9PVA' - save this in the config to speed up startup
2022/11/14 08:33:06 DEBUG : Google drive root 'crypt/f9ut45jfnj1bu07db4fj74ggo4': Disabling ListR to work around bug in drive as multi listing (4) returned no entries
2022/11/14 08:33:06 DEBUG : Google drive root 'crypt/f9ut45jfnj1bu07db4fj74ggo4': Recycled 4 entries
2022/11/14 08:33:10 DEBUG : 18 go routines active
2

I'm not seeing any compare to what could be wrong as you've shared one command?

3

Sorry, here is the comparable output.

rclone size -vv --log-file=FILE crypt:1080pWEB-DL/
Total objects: 2.372k (2372)
Total size: 4.747 TiB (5219796693887 Byte)

2022/11/14 09:16:35 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "size" "-vv" "--log-file=FILE" "crypt:1080pWEB-DL/"]
2022/11/14 09:16:35 DEBUG : Creating backend with remote "crypt:1080pWEB-DL/"
2022/11/14 09:16:35 DEBUG : Using config file from "/home/tcd/.config/rclone/rclone.conf"
2022/11/14 09:16:36 DEBUG : Creating backend with remote "gsuite:crypt/f9ut45jfnj1bu07db4fj74ggo4"
2022/11/14 09:16:36 DEBUG : Google drive root 'crypt/f9ut45jfnj1bu07db4fj74ggo4': 'root_folder_id = 0AHV9IRkaLX4bUk9PVA' - save this in the config to speed up startup
2022/11/14 09:16:49 DEBUG : 18 go routines active
2022/11/14 09:16:57 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "size" "-vv" "--log-file=FILE" "crypt:1080pWEB-DL/"]
2022/11/14 09:16:57 DEBUG : Creating backend with remote "crypt:1080pWEB-DL/"
2022/11/14 09:16:57 DEBUG : Using config file from "/home/tcd/.config/rclone/rclone.conf"
2022/11/14 09:16:57 DEBUG : Creating backend with remote "gsuite:crypt/f9ut45jfnj1bu07db4fj74ggo4"
2022/11/14 09:16:58 DEBUG : Google drive root 'crypt/f9ut45jfnj1bu07db4fj74ggo4': 'root_folder_id = 0AHV9IRkaLX4bUk9PVA' - save this in the config to speed up startup
2022/11/14 09:17:09 DEBUG : 18 go routines active

4

That's the first?

That's the second?

They match and that's good or bad?

5

crap. wrong command.

rclone size -vv beccacrypt:1080pWEB-DL/
2022/11/14 09:29:56 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "size" "-vv" "beccacrypt:1080pWEB-DL/"]
2022/11/14 09:29:56 DEBUG : Creating backend with remote "beccacrypt:1080pWEB-DL/"
2022/11/14 09:29:56 DEBUG : Using config file from "/home/tcd/.config/rclone/rclone.conf"
2022/11/14 09:29:56 DEBUG : Creating backend with remote "becca:crypt/f9ut45jfnj1bu07db4fj74ggo4"
2022/11/14 09:29:56 DEBUG : Google drive root 'crypt/f9ut45jfnj1bu07db4fj74ggo4': 'root_folder_id = 0ACdUASMq5i7kUk9PVA' - save this in the config to speed up startup
Total objects: 1.647k (1647)
Total size: 3.546 TiB (3898880372393 Byte)
2022/11/14 09:30:09 DEBUG : 18 go routines active

6

Those looks like different drives.

doesn't match

Root IDs

0ACdUASMq5i7kUk9PVA
0AHV9IRkaLX4bUk9PVA
7

Good eye. Okay, that might point me in the right direction.

Back in August I set up 4 additional enterprise users, shared the folders to each user. Then added those shared folders to each users my driive shortcut. I then proceeded to run 5 rclone instances at --bwlimit=8.5M and fully encrypted my gsuite to crypt. I deleted the additional users after about a month of transferring.

Yesterday I added 2 additonal users, as I have several more files to encrypt, and since the enterprise pricing is still discounted for me (and prorated), I thought i could do it again. I wonder if I created the crypt remote incorrectly?

I also feel as though the file permissions are weirdly incorrect here.
Should my secondary crypt remote point to becca:crypt, or my main remote gsuite:crypt

Thank you @Animosity022

8

There must be something wrong with the permissions in my crypt folder. Here is the output from the same command back to back.
Main Gsuite
rclone size crypt:BHD
Total objects: 89.824k (89824)
Total size: 8.932 TiB (9820509199855 Byte)

Second User (Editor)
rclone size beccacrypt:BHD
Total objects: 85.701k (85701)
Total size: 8.903 TiB (9789077783755 Byte)

5 seconds after completing the command (took awhile)

rclone size beccacrypt:BHD
Total objects: 86.390k (86390)
Total size: 8.911 TiB (9797394015830 Byte)

9

Are they the same remotes now? Can you share the debug log?

10

They aren’t the same remote.

Everything is lining up now. The error must have been when I changed permissions on the shared folder (crypt). It is more than 100TB, so perhaps it took more than 24 hours for the permissions to propagate.

My setup is as follows.

Main google enterprise user
Gsuite:
Crypt - gsuite:crypt

crypt is shared to enterprise users becca and buddy.
Both users add the shared drive as a shortcut to my drive.

Secondary enterprise user
becca:
Beccacrypt - becca:crypt

Tertiary enterprise user
buddy:
buddycrypt - buddy:crypt

Each user has 750gb/24 hr limit. After I move 20 or TB, I will drop user 2 and user 3. As each user is deleted ownership of that users data is transferred to my main enterprise user.

Thanks !

11

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.