Missing Folders and Files in Gdrive mount

beercan · May 20, 2020, 10:27am

What is the problem you are having with rclone?

My rclone mount does not show every folder and file, but rclone ls remote:path does show the missing folders und files.

What is your rclone version (output from `rclone version`)

rclone v1.51.0

os/arch: linux/amd64
go version: go1.13.7

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Debian 10 64 bit

Which cloud storage system are you using? (eg Google Drive)

Gdrive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

cd /home/myuser/mnt/movies
ls -la
--> Will show 118 folders

rclone ls gdrive:crypted/movies
--> will show missing other 18 folders

The rclone config contents with secrets removed.

[gdrive]
type = drive
client_id = XXX.apps.googleusercontent.com
client_secret = XXX
scope = drive
token = {XXX}
root_folder_id = XXX

[crypted]
type = crypt
remote = gdrive:crypto
filename_encryption = standard
directory_name_encryption = true
password = XXX
password2 = XXX

A log from the command with the `-vv` flag

cd /home/myuser/mnt/movies
ls -la
--> Will show 118 folders

rclone ls gdrive:crypted/movies
--> will show missing other 18 folders

Animosity022 · May 20, 2020, 11:04am

You'd have to share a debug log so we can see what's going on.

beercan · May 20, 2020, 11:43am

Hi,
rclone ls gdrive:crypted/movies -vv does not output anything different than without the -vv flag.

I used your best settings for plex GitHub repo for my setup I think I saw a setting for the log in the systemd service.

I will post the output when I am home.

Thank you very much!

Animosity022 · May 20, 2020, 11:45am

You need the mount with -vv to see what's going on as that's the problem.

Thanks!

ncw · May 20, 2020, 3:36pm

It is worth trying the latest beta too as we fixed various oddities with shared files.

Also do you have any duplicate folder names? You can't have duplicate names in a mount...

beercan · May 20, 2020, 6:24pm

I installed the latest beta and confirmed the installation. It did not fix the issue. Before I posted here I deduped the folder, but a dry run didn't show any change.Thank you for helping me!

beercan · May 20, 2020, 6:26pm

Hi,
I have to thank your for the nice guide and forhelping me here!

Here is the log in DEBUG mode:

2020/05/20 20:11:13 NOTICE: Serving remote control on http://127.0.0.1:5572/
2020/05/20 20:15:57 DEBUG : rclone: Version "v1.51.0-353-g5f71d186-beta" starting with parameters ["/usr/bin/rclone" "mount" "crypted:" "/home/myuser/mnt" "--allow-other" "--buffer-size" "64M" "--dir-cache-time" "1000h" "--log-level" "DEBUG" "--log-file" "/home/myuser/logs/rclone.log" "--poll-interval" "15m0s" "--timeout" "1h" "--umask" "002" "--user-agent" "ucuzfilesapp" "--rc" "--rc-addr" "127.0.0.1:5572"]
2020/05/20 20:15:57 NOTICE: Serving remote control on http://127.0.0.1:5572/
2020/05/20 20:15:57 DEBUG : Using config file from "/home/myuser/.config/rclone/rclone.conf"
2020/05/20 20:16:01 DEBUG : Encrypted drive 'crypted:': Mounting on "/home/myuser/mnt"
2020/05/20 20:16:01 DEBUG : Adding path "vfs/forget" to remote control registry
2020/05/20 20:16:01 DEBUG : Adding path "vfs/refresh" to remote control registry
2020/05/20 20:16:01 DEBUG : Adding path "vfs/poll-interval" to remote control registry
2020/05/20 20:16:01 DEBUG : : Root: 
2020/05/20 20:16:01 DEBUG : : >Root: node=/, err=<nil>
2020/05/20 20:16:01 DEBUG : rc: "vfs/refresh": with parameters map[recursive:true]
2020/05/20 20:16:01 DEBUG : : Reading directory tree
2020/05/20 20:16:03 DEBUG : : Reading directory tree done in 1.855619129s
2020/05/20 20:16:03 DEBUG : rc: "vfs/refresh": reply map[result:map[:OK]]: <nil>
2020/05/20 20:16:04 DEBUG : /: Lookup: name="Filme"
2020/05/20 20:16:04 DEBUG : /: >Lookup: node=Filme/, err=<nil>
2020/05/20 20:16:04 DEBUG : Filme/: Attr: 
2020/05/20 20:16:04 DEBUG : Filme/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/05/20 20:16:04 DEBUG : Filme/: Lookup: name=".grab"
2020/05/20 20:16:04 DEBUG : Filme/: >Lookup: node=<nil>, err=no such file or directory
2020/05/20 20:16:04 DEBUG : /: Lookup: name="Serien"
2020/05/20 20:16:04 DEBUG : /: >Lookup: node=Serien/, err=<nil>
2020/05/20 20:16:04 DEBUG : Serien/: Attr: 
2020/05/20 20:16:04 DEBUG : Serien/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/05/20 20:16:04 DEBUG : Serien/: Lookup: name=".grab"
2020/05/20 20:16:04 DEBUG : Serien/: >Lookup: node=<nil>, err=no such file or directory
2020/05/20 20:16:12 DEBUG : : Statfs: 
2020/05/20 20:16:13 DEBUG : : >Statfs: stat={Blocks:275260942575 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2020/05/20 20:16:13 DEBUG : /: Attr: 
2020/05/20 20:16:13 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/05/20 20:16:13 DEBUG : : Statfs: 
2020/05/20 20:16:13 DEBUG : : >Statfs: stat={Blocks:275260942575 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2020/05/20 20:16:13 DEBUG : : Statfs: 
2020/05/20 20:16:13 DEBUG : : >Statfs: stat={Blocks:275260942575 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2020/05/20 20:16:13 DEBUG : : Statfs: 
2020/05/20 20:16:13 DEBUG : : >Statfs: stat={Blocks:275260942575 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2020/05/20 20:16:25 DEBUG : /: Lookup: name="Filme"
2020/05/20 20:16:25 DEBUG : /: >Lookup: node=Filme/, err=<nil>
2020/05/20 20:16:25 DEBUG : Filme/: Attr: 
2020/05/20 20:16:25 DEBUG : Filme/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/05/20 20:16:25 DEBUG : Filme/: Lookup: name=".grab"
2020/05/20 20:16:25 DEBUG : Filme/: >Lookup: node=<nil>, err=no such file or directory
2020/05/20 20:16:25 DEBUG : /: Lookup: name="Serien"
2020/05/20 20:16:25 DEBUG : /: >Lookup: node=Serien/, err=<nil>
2020/05/20 20:16:25 DEBUG : Serien/: Attr: 
2020/05/20 20:16:25 DEBUG : Serien/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/05/20 20:16:25 DEBUG : Serien/: Lookup: name=".grab"
2020/05/20 20:16:25 DEBUG : Serien/: >Lookup: node=<nil>, err=no such file or directory
2020/05/20 20:21:47 DEBUG : /: Attr: 
2020/05/20 20:21:47 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>

Animosity022 · May 20, 2020, 6:34pm

Can you share what the working ls looks like as well and put it in a code block like you did for the mount?

And if you can point out one that shows in the ls and did not show in the mount, that would be great.

Animosity022 · May 20, 2020, 6:39pm

I also don't see you listing out "movies" in the debug log. I think I'd expect to see a directory listing for movies since it's mounted to "/home/myuser/mnt". Did you run that ls command on the mount now?

beercan · May 20, 2020, 7:01pm

Hi,
the "movies" folder is the euqivalent to the folder "Filme". I changed a few thing because of privacy, but messed it up because of my lack of consistency.

I have the outputs you asked for, but it will show a part of my movie collection Can I send you the output somehow? I am not allowed to post links to pastebin and I do not see a way to write PM.

Thank you!

Animosity022 · May 20, 2020, 7:03pm

Since you appear to be a real person and not a spambot, I updated your access. You should be able to post a link or PM me if you want.

Either is fine from my side.

beercan · May 20, 2020, 7:24pm

PMed. Thank you!

calisro · May 20, 2020, 9:55pm

Did you try this and was denied? I had whitelisted that which was supposed to always allow that.

EDIT: I found the issue I think. Thanks anyway.

system · July 20, 2020, 6:09pm

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.