jokob-sk
(Jokob Sk)
1
What is the problem you are having with rclone?
Can't get the real size of a bucket in storj. I have no folders in the bucket.
Run the command 'rclone version' and share the full output of the command.
rclone version
rclone v1.60.1
- os/version: debian 11.5 (64 bit)
- os/kernel: 4.4.180+ (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.3
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
storj (41)
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone size storj:docker-appdata
Total objects: 0 (0)
Total size: 0 B (0 Byte)
A log from the command with the -vv
flag
rclone size storj:docker-appdata -vv
2023/03/19 10:19:53 DEBUG : rclone: Version "v1.60.1" starting with parameters ["rclone" "size" "storj:docker-appdata" "-vv"]
2023/03/19 10:19:53 DEBUG : Creating backend with remote "storj:docker-appdata"
2023/03/19 10:19:53 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/03/19 10:19:53 DEBUG : FS sj://docker-appdata: connecting...
2023/03/19 10:19:53 DEBUG : FS sj://docker-appdata: connected: <nil>
2023/03/19 10:19:53 DEBUG : FS sj://docker-appdata: ls -R ./
2023/03/19 10:19:53 DEBUG : FS sj://docker-appdata: OBJ ls -R ./ ("docker-appdata", "")
Total objects: 0 (0)
Total size: 0 B (0 Byte)
2023/03/19 10:19:55 DEBUG : 5 go routines active
Same result even if I add /
rclone size storj:docker-appdata/ -vv
2023/03/19 10:30:23 DEBUG : rclone: Version "v1.60.1" starting with parameters ["rclone" "size" "storj:docker-appdata/" "-vv"]
2023/03/19 10:30:23 DEBUG : Creating backend with remote "storj:docker-appdata/"
2023/03/19 10:30:23 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/03/19 10:30:23 DEBUG : FS sj://docker-appdata: connecting...
2023/03/19 10:30:23 DEBUG : FS sj://docker-appdata: connected: <nil>
2023/03/19 10:30:23 DEBUG : fs cache: renaming cache item "storj:docker-appdata/" to be canonical "storj:docker-appdata"
2023/03/19 10:30:23 DEBUG : FS sj://docker-appdata: ls -R ./
2023/03/19 10:30:23 DEBUG : FS sj://docker-appdata: OBJ ls -R ./ ("docker-appdata", "")
Total objects: 0 (0)
Total size: 0 B (0 Byte)
2023/03/19 10:30:25 DEBUG : 5 go routines active
Thanks in advance for any help!
ncw
(Nick Craig-Wood)
2
Hmm...
Try the latest rclone see if that makes a difference.
Does rclone ls show any files?
How about rclone lsf?
Also try
rclone ls --disable ListR storj:docker-appdata
jokob-sk
(Jokob Sk)
3
Hi,
I've tried rclone ls --disable ListR storj:docker-appdata
But nothing got returned.
I've also updated to the latest version and ran the command again:
rclone size storj:docker-appdata/ -vv
2023/03/19 21:10:08 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "size" "storj:docker-appdata/" "-vv"]
2023/03/19 21:10:08 DEBUG : Creating backend with remote "storj:docker-appdata/"
2023/03/19 21:10:08 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/03/19 21:10:08 DEBUG : FS sj://docker-appdata: connecting...
2023/03/19 21:10:08 DEBUG : FS sj://docker-appdata: connected: <nil>
2023/03/19 21:10:08 DEBUG : fs cache: renaming cache item "storj:docker-appdata/" to be canonical "storj:docker-appdata"
2023/03/19 21:10:08 DEBUG : FS sj://docker-appdata: ls -R ./
2023/03/19 21:10:08 DEBUG : FS sj://docker-appdata: OBJ ls -R ./ ("docker-appdata", "")
Total objects: 0 (0)
Total size: 0 B (0 Byte)
2023/03/19 21:10:09 DEBUG : 5 go routines active
ncw
(Nick Craig-Wood)
4
Can you list a different bucket? Try creating one, uploading something and listing it.
Just trying to work out if your storj:
config is wrong or if this is a bug.
What do you get if you do
rclone size storj:docker-appdata -vv --dump bodies
That will print more stuff, but I don't think it is very useful on storj.
Have you tried the S3 gateway?
jokob-sk
(Jokob Sk)
5
Hi,
Here is teh result of the query you asked me to execute:
rclone size storj:docker-appdata -vv --dump bodies
2023/03/22 18:53:33 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "size" "storj:docker-appdata" "-vv" "--dump" "bodies"]
2023/03/22 18:53:33 DEBUG : Creating backend with remote "storj:docker-appdata"
2023/03/22 18:53:33 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/03/22 18:53:33 DEBUG : FS sj://docker-appdata: connecting...
2023/03/22 18:53:33 DEBUG : FS sj://docker-appdata: connected: <nil>
2023/03/22 18:53:33 DEBUG : FS sj://docker-appdata: ls -R ./
2023/03/22 18:53:33 DEBUG : FS sj://docker-appdata: OBJ ls -R ./ ("docker-appdata", "")
Total objects: 0 (0)
Total size: 0 B (0 Byte)
2023/03/22 18:53:34 DEBUG : 5 go routines active
Created a test bucket with a folder, same result:
rclone size storjtest:test/folder-name/ -vv
2023/03/22 18:59:54 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "size" "storjtest:test/folder-name/" "-vv"]
2023/03/22 18:59:54 DEBUG : Creating backend with remote "storjtest:test/folder-name/"
2023/03/22 18:59:54 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/03/22 18:59:54 DEBUG : FS sj://test/folder-name: connecting...
2023/03/22 18:59:54 DEBUG : FS sj://test/folder-name: connected: <nil>
2023/03/22 18:59:55 DEBUG : fs cache: renaming cache item "storjtest:test/folder-name/" to be canonical "storjtest:test/folder-name"
2023/03/22 18:59:55 DEBUG : FS sj://test/folder-name: ls -R ./
2023/03/22 18:59:55 DEBUG : FS sj://test/folder-name: OBJ ls -R ./ ("test", "folder-name")
Total objects: 0 (0)
Total size: 0 B (0 Byte)
2023/03/22 18:59:55 DEBUG : 5 go routines active
Let me know if you need something more,
thanks,
j
ncw
(Nick Craig-Wood)
6
Can you post your config with secrets redacted please?
jokob-sk
(Jokob Sk)
7
Hi,
Is this sufficient?
[storjtest]
type = storj
access_grant = 1cAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA