Unable to List Files / Directories for Memstore

Hi,

When we try and 'ls' or 'lsd' on a Remote in Memstore, it says "Failed to lsd: directory not found", this is on the latest version (v1.47), however if you run the same command on v1.40 with the same config, it works.

Below is my config (password removed);

[Memstore]
type = swift
env_auth = false
user = admin
key = REMOVED
auth = https://auth.storage.memset.com/v2.0
endpoint_type = public
tenant = msmemsebq1
storage_url = https://auth.storage.memset.com/v2.0
region = dunsfold
service_name = memstore
auth_version = 0

When run on v1.40 it returns the directories (without any names)
rclone.exe lsd "Memstore:backups"
0 2019-05-23 16:16:39 -1 2019-04-07
0 2019-05-23 16:16:39 -1 2019-04-08
0 2019-05-23 16:16:39 -1 2019-04-09
0 2019-05-23 16:16:39 -1 2019-04-10
0 2019-05-23 16:16:39 -1 2019-04-11

and the ls works fine;

  804 2019-04-07/accounts/.master.meta
 12393177 2019-04-07/accounts/demo.tar.gz
 12375947 2019-04-07/accounts/newdemo.tar.gz
 59535360 2019-04-07/system/system_files.tar
 59688960 2019-04-09/system/system_files.tar
      804 2019-04-09/accounts/.master.meta

When running with -vvv and --dump bodies for v1.47 it does show the final result as being a 404, but on v1.40 it shows a 200.

On the v1.40 one I can see it does the following request which returns the Files/Directories.

2019/05/23 16:18:51 DEBUG : GET /v1/AUTH_msmemsebq1_d9cc38REDACTED039515/backups?delimiter=%2F&format=json&limit=1000 HTTP/1.1
Host: csproxydu2.memset.com
User-Agent: rclone/v1.40
X-Auth-Token: XXXX
Accept-Encoding: gzip

However on v1.47 it does the below;

2019/05/23 16:20:07 DEBUG : GET /v2.0/backups?delimiter=%2F&format=json&limit=1000 HTTP/1.1
Host: auth.storage.memset.com
User-Agent: rclone/v1.47.0
X-Auth-Token: XXXX
Accept-Encoding: gzip

It looks like it is using a different version, and that the AUTH information may be missing (I am not sure if this is required in newer versions or not).

If you need the full dumps of the bodies, please let me know and I will email them to you.

I am not sure if this is my config that needs updating or something more.

Any help would be greatly appreciated.

Regards,
Seamus

I think you need to change the auth version from 2.0 to 1.0 for 1.47 maybe?

https://rclone.org/swift/#swift-auth-version

It is clear that something has changed from 1.40 to 1.47 but I'm not clear on what

You have a v2 auth_url (with the /v2.0) on the end so I think v1.47 is correct in trying to use v2 auth. So I would say the fact that it worked in v1.40 was a bug which is now fixed :wink:

I have a very minimal memstore remote which works fine

[memstore-v2]
type = swift
user = XXX
key = XXX
auth = https://auth.storage.memset.com/v2.0
tenant = XXX

Can you try cutting down your config to that?

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.