Only seeing a few folders on one machine

[Krandor (Brian Hartsfield)]

What is the problem you are having with rclone?

I have rclone running on a few different machines point to the same remote. On one machine it was temporarily suspended for a few days due to going over bandwith (by VPS provider not by gdrive) and since it came back on that machine and that machine only I'm only seeing a few folders and in those folders only a handful of files.

rclone v1.62.2

• os/version: ubuntu 22.04 (64 bit)
• os/kernel: 5.15.0-71-generic (x86_64)
• os/type: linux
• os/arch: amd64
• go/version: go1.20.2
• go/linking: static
• go/tags: none

Are you on the latest version of rclone? You can validate by checking the version listed here: Rclone downloads
-->

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

For current testing I'm keeping it simple

/home/krandor/rclone mount gdriveenc4: mnt/tmp1

The rclone config contents with secrets removed.

type = drive
client_id = <removed>
client_secret = <removed>
token = <removed>
root_folder_id = <removed>

[gdriveenc4]
type = crypt
remote = gdrivenoenc:/enc
filename_encryption = standard
password = <removed>
password2 = <removed>```

#### A log from the command with the `-vv` flag  

```krandor@ds108123:~$ /home/krandor/rclone mount gdriveenc4: mnt/tmp1
^C2023/05/02 00:59:38 ERROR : mnt/tmp1: Unmounted rclone mount
krandor@ds108123:~$ /home/krandor/rclone mount gdriveenc4: mnt/tmp1 -vvvvv
2023/05/02 00:59:43 DEBUG : rclone: Version "v1.62.2" starting with parameters ["/home/krandor/rclone" "mount" "gdriveenc4:" "mnt/tmp1" "-vvvvv"]
2023/05/02 00:59:43 DEBUG : Creating backend with remote "gdriveenc4:"
2023/05/02 00:59:43 DEBUG : Using config file from "/home/krandor/.config/rclone/rclone.conf"
2023/05/02 00:59:43 DEBUG : Creating backend with remote "gdrivenoenc:/enc"
2023/05/02 00:59:44 DEBUG : fs cache: renaming cache item "gdrivenoenc:/enc" to be canonical "gdrivenoenc:enc"
2023/05/02 00:59:44 DEBUG : Encrypted drive 'gdriveenc4:': Mounting on "mnt/tmp1"
2023/05/02 00:59:44 DEBUG : : Root:
2023/05/02 00:59:44 DEBUG : : >Root: node=/, err=<nil>
2023/05/02 01:00:44 DEBUG : Google drive root 'enc': Checking for changes on remote
2023/05/02 01:01:44 DEBUG : Google drive root 'enc': Checking for changes on remote
2023/05/02 01:02:44 DEBUG : Google drive root 'enc': Checking for changes on remote


2023/05/02 01:03:19 DEBUG : /: Attr:
2023/05/02 01:03:19 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/05/02 01:03:19 DEBUG : /: ReadDirAll:
2023/05/02 01:03:19 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2023/05/02 01:03:19 DEBUG : /: Lookup: name="CBT"
2023/05/02 01:03:19 DEBUG : /: >Lookup: node=CBT/, err=<nil>
2023/05/02 01:03:19 DEBUG : CBT/: Attr:
2023/05/02 01:03:19 DEBUG : CBT/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/05/02 01:03:19 DEBUG : /: Lookup: name="movies"
2023/05/02 01:03:19 DEBUG : /: >Lookup: node=movies/, err=<nil>
2023/05/02 01:03:19 DEBUG : movies/: Attr:
2023/05/02 01:03:19 DEBUG : movies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/05/02 01:03:19 DEBUG : /: Lookup: name="tv"
2023/05/02 01:03:19 DEBUG : /: >Lookup: node=tv/, err=<nil>
2023/05/02 01:03:19 DEBUG : tv/: Attr:
2023/05/02 01:03:19 DEBUG : tv/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>

I only get the 3 directores you see but in the root of this folder are about 20 directories. On another server I see all 20. I have tried deleting the .cache file and restarting and no change. I have verified encryption keys and even re-copied rclone.conf from another working server and no change. What is most odd s that the files i see seem to be filed I "rclone move" on this server which don't also show up on other. So it almost looks like encryption key mismatch but this server has been running for a while with no issues and no changes and like I said even copied a working rclone.conf from another server over which would include correct keys.

It is like something is still cached somewhere on the local server since if I do "rclone about gdriveenc4:" all the information it returns is accurate. If I do "rclone ls gdriveenc4:" I also do see stuff recently copied to the remote from another server so somehow the remote seems to only show recent updated data but not older stuff.

And yes the overall size of this remote is quite large.

Any ideas appreciated.

[asdffdsa (jojothehumanmonkey)]

so the issue is only with rclone mount on a single machine?

and a reboot did not fix the issue?

[Krandor (Brian Hartsfield)]

I did get it fixed. Originally appeared to only be one machine but it was more. Basically anything previously mounted was find but new mounts showed only "new files". So as of a certain date and time things mounted previous to that showed files up to that date and new mounts were that date forward.

Backtracked what I was doing and I had a cron job that has been running for years well and haven't touched it. It was still pointing to an old cache remote (which I think may have contributed). At the time this happened I started a second different copy but to same end remote. This appears to be the time something clashed and things "split".

Finally after having to go to the google drive web (couldn't see it on linux side even if mounting unencrypted file) by enc directory (which is the root of my crypt) had been duplicated and I actually had THREE directories called enc. So the new mounts were hitting the "new" enc directory and old one still the one that had been using.

Renamed the other two and working normal again. Have an rclone move running to move things out of the "new" directories and then will update my cron not to use cache remote anymore.

TLDR : my enc directory had gotten duplicated on google drive so I had multiple which confused rclone mount.