Rclone hidden files

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.

What is the problem you are having with rclone?

Previously when playing around with rclone and crypt I did some backup from my main server to gdrive, a lot of those files still remain, but I cannot see them in rclone \ mount, nor in the drive webui, unless I tell it to show large files

Run the command 'rclone version' and share the full output of the command.

rclone v1.69.1

  • os/version: debian trixie/sid (64 bit)
  • os/kernel: 6.12.22-amd64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.24.0
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

google drive + crypt

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone ls gdrive:
rclone ls gdrivecrypt:

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[gdrive]
type = drive
client_id = id
client_secret = secret
scope = drive
token = token

[gdrivecrypt]
type = crypt
remote = gdrive:
password = password

A log from the command that you were trying to run with the -vv flag

root@kakuzu:/home/eirikz# rclone ls gdrive:
root@kakuzu:/home/eirikz# rclone size gdrive:
Total objects: 0
Total size: 0 B (0 Byte)
root@kakuzu:/home/eirikz# rclone size gdrivecrypt:
Total objects: 0
Total size: 0 B (0 Byte)
root@kakuzu:/home/eirikz# rclone ls gdrivecrypt:
root@kakuzu:/home/eirikz# 

Interesting one...

Could you run:

rclone ls gdrive: -vv

and post output here?

Also how did you create this content? Using the same setup?

It was originally uploaded from this exact client I believe, although I have been moving my rclone config between my two hosts for a few years.

root@kakuzu:/home/eirikz# rclone ls gdrive: -vv
2025/04/28 20:41:35 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "ls" "gdrive:" "-vv"]
2025/04/28 20:41:35 DEBUG : Creating backend with remote "gdrive:"
2025/04/28 20:41:35 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2025/04/28 20:41:35 DEBUG : Google drive root '': 'root_folder_id = <stringhere>' - save this in the config to speed up startup
2025/04/28 20:41:35 DEBUG : 5 go routines active
root@kakuzu:/home/eirikz#

I did eventually go to the WEBUI, sort by large files, then delete them 32 at a time, and it appears to be cleaning up in the background SLOWLY, still a way to go.. but going down, still very strange that those files were not visible from anywhere execept there (API issue from google side?)

Pretty sure I found what the issue was, but not sure how I could have rectified it

Apparently I had a rclone copy script in crontab that did copy to gdrivecrypt:mirai i.e a bucket under the mount, which is why I couldn't see it, not sure if that is anyway supported or not.

What exactly you are not sure if is suppprted?

I did this

/usr/bin/rclone copy /backupool/miraibackup/daily.0/ gdrivecrypt:mirai --drive-chunk-size 64M --transfers 40 --fast-list --checkers 40 -P

Those are the files that don't show up, if I do like this I can't even ls them back it seems

root@kakuzu:/mnt# rclone ls gdrivecrypt:mirai
2025/04/30 15:51:23 NOTICE: Failed to ls: directory not found

can you run these commands and post the full output

  1. copy a just one single file. something like rclone copy ~/file.ext gdrive:testfolder -vv
  2. rclone lsd gdrive: -vv
  3. rclone ls gdrive:testfolder -vv
eirikz@kakuzu ~ % touch hugefile.ext                    
eirikz@kakuzu ~ % rclone copy hugefile.ext gdrive:testfolder -vv
2025/05/02 19:04:29 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "copy" "hugefile.ext" "gdrive:testfolder" "-vv"]
2025/05/02 19:04:29 DEBUG : Creating backend with remote "hugefile.ext"
2025/05/02 19:04:29 DEBUG : Using config file from "/home/eirikz/.config/rclone/rclone.conf"
2025/05/02 19:04:29 DEBUG : fs cache: renaming child cache item "hugefile.ext" to be canonical for parent "/home/eirikz"
2025/05/02 19:04:29 DEBUG : Creating backend with remote "gdrive:testfolder"
2025/05/02 19:04:29 DEBUG : Google drive root 'testfolder': 'root_folder_id = 0ABVFcai0YVdAUk9PVA' - save this in the config to speed up startup
2025/05/02 19:04:30 DEBUG : hugefile.ext: Need to transfer - File not found at Destination
2025/05/02 19:04:32 DEBUG : hugefile.ext: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2025/05/02 19:04:32 INFO  : hugefile.ext: Copied (new)
2025/05/02 19:04:32 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Transferred:            1 / 1, 100%
Elapsed time:         2.2s

2025/05/02 19:04:32 DEBUG : 6 go routines active
eirikz@kakuzu ~ % rclone lsd gdrive: -vv
2025/05/02 19:04:50 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "lsd" "gdrive:" "-vv"]
2025/05/02 19:04:50 DEBUG : Creating backend with remote "gdrive:"
2025/05/02 19:04:50 DEBUG : Using config file from "/home/eirikz/.config/rclone/rclone.conf"
2025/05/02 19:04:51 DEBUG : Google drive root '': 'root_folder_id = 0ABVFcai0YVdAUk9PVA' - save this in the config to speed up startup
           0 2025-05-02 19:03:45        -1 testfolder
2025/05/02 19:04:51 DEBUG : 5 go routines active
eirikz@kakuzu ~ % rclone lsd gdrive:testfolder -vv
2025/05/02 19:05:01 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "lsd" "gdrive:testfolder" "-vv"]
2025/05/02 19:05:01 DEBUG : Creating backend with remote "gdrive:testfolder"
2025/05/02 19:05:01 DEBUG : Using config file from "/home/eirikz/.config/rclone/rclone.conf"
2025/05/02 19:05:02 DEBUG : Google drive root 'testfolder': 'root_folder_id = 0ABVFcai0YVdAUk9PVA' - save this in the config to speed up startup
2025/05/02 19:05:02 DEBUG : 5 go routines active
eirikz@kakuzu ~ % rclone copy hugefile.ext gdrivecrypt:cryptfolder -vv
2025/05/02 19:05:18 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "copy" "hugefile.ext" "gdrivecrypt:cryptfolder" "-vv"]
2025/05/02 19:05:18 DEBUG : Creating backend with remote "hugefile.ext"
2025/05/02 19:05:18 DEBUG : Using config file from "/home/eirikz/.config/rclone/rclone.conf"
2025/05/02 19:05:18 DEBUG : fs cache: renaming child cache item "hugefile.ext" to be canonical for parent "/home/eirikz"
2025/05/02 19:05:18 DEBUG : Creating backend with remote "gdrivecrypt:cryptfolder"
2025/05/02 19:05:18 DEBUG : Creating backend with remote "gdrive:kaptnickhddj21o994svu4082g"
2025/05/02 19:05:19 DEBUG : Google drive root 'kaptnickhddj21o994svu4082g': 'root_folder_id = 0ABVFcai0YVdAUk9PVA' - save this in the config to speed up startup
2025/05/02 19:05:20 DEBUG : hugefile.ext: Need to transfer - File not found at Destination
2025/05/02 19:05:24 DEBUG : hugefile.ext: md5 = 07a52f80241791f880dc2198d12485fb OK
2025/05/02 19:05:24 INFO  : hugefile.ext: Copied (new)
2025/05/02 19:05:24 INFO  : 
Transferred:   	         32 B / 32 B, 100%, 10 B/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         3.8s

2025/05/02 19:05:24 DEBUG : 6 go routines active
eirikz@kakuzu ~ % rclone lsd gdrivecrypt: -vv                         
2025/05/02 19:05:33 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "lsd" "gdrivecrypt:" "-vv"]
2025/05/02 19:05:33 DEBUG : Creating backend with remote "gdrivecrypt:"
2025/05/02 19:05:33 DEBUG : Using config file from "/home/eirikz/.config/rclone/rclone.conf"
2025/05/02 19:05:33 DEBUG : Creating backend with remote "gdrive:"
2025/05/02 19:05:34 DEBUG : Google drive root '': 'root_folder_id = 0ABVFcai0YVdAUk9PVA' - save this in the config to speed up startup
2025/05/02 19:05:34 NOTICE: testfolder: Skipping undecryptable dir name: not a multiple of blocksize
           0 2025-05-02 19:05:21        -1 cryptfolder
2025/05/02 19:05:34 DEBUG : 5 go routines active
eirikz@kakuzu ~ % rclone lsd gdrivecrypt:cryptfolder -vv
2025/05/02 19:05:49 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "lsd" "gdrivecrypt:cryptfolder" "-vv"]
2025/05/02 19:05:49 DEBUG : Creating backend with remote "gdrivecrypt:cryptfolder"
2025/05/02 19:05:49 DEBUG : Using config file from "/home/eirikz/.config/rclone/rclone.conf"
2025/05/02 19:05:49 DEBUG : Creating backend with remote "gdrive:kaptnickhddj21o994svu4082g"
2025/05/02 19:05:49 DEBUG : Google drive root 'kaptnickhddj21o994svu4082g': 'root_folder_id = 0ABVFcai0YVdAUk9PVA' - save this in the config to speed up startup
2025/05/02 19:05:50 DEBUG : 5 go routines active
eirikz@kakuzu ~ % 

do not mix crypted and non-crypted.
should follow rclone guidelines from rclone docs and rclone config

Remote to encrypt/decrypt.
Normally should contain a ':' and a path, eg "myremote:path/to/dir",
"myremote:bucket" or maybe "myremote:" (not recommended).