Alias on Crypt on S3, Can't See the .bin Files

What is the problem you are having with rclone?

alias built on top of crypt built on top of unencrypted s3 provider is not behaving as I would expect. Am I confused, or is it an rclone defect, or is the s3 provider defective?

  • I defined and tested an s3 remote named "idrivecloud".
  • I defined and tested a crypt remote named "xidrivecloud" encrypting idrivecloud. This remote is defined with no file name or directory name encryption -- just content encryption.
  • I defined an alias named "cloudbackup" as an alias for xidrivecloud.
  • I created a small text file named "jello".

When I "rclone copy jello idrivecloud:" I can "rclone ls idrivecloud:" and see the file. I see nothing via "rclone ls xidrivecloud:" or "rclone ls cloudbackup:" as expected. I deleted the file before proceeding to the next test.

When I "rclone copy jello xidrivecloud:" I can "rclone ls xidrivecloud:" and see the file, as expected. However, when I "rclone ls idrivecloud:" I see nothing. I would expect to see "jello.bin". I deleted the file before proceeding to the next test.

When I "rclone copy jello cloudbackup:" I can "rclone ls cloudbackup:" and see the file, as expected. However, when I "rclone ls idrivecloud:" or I "rclone ls xidrivecloud:" I see nothing. I would expect to see "jello.bin" or "jello".

What is your rclone version (output from rclone version)

rclone v1.55.1

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Ubuntu Linux 20.04.02, 64-bit

Which cloud storage system are you using? (eg Google Drive)

cloud.idrive.com

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy jello cloudbackup:
rclone ls cloudbackup:
rclone ls xidrivecloud:
rclone ls idrivecloud:

The rclone config contents with secrets removed.

[idrivecloud]
type = s3
provider = Other
env_auth = false
access_key_id = xxxx
secret_access_key = xxxx
endpoint = s3.us-west-1.idrivecloud.io
acl = private

[xidrivecloud]
type = crypt
remote = idrivecloud
filename_encryption = off
directory_name_encryption = false
password = xxxx
password2 = xxxx

[cloudbackup]
type = alias
remote = xidrivecloud

A log from the command with the -vv flag

Each of these examples is AFTER uploading jello to cloudbackup.

$ rclone -vv ls cloudbackup:
2021/05/24 17:32:11 DEBUG : Using config file from "/home/kevin/.config/rclone/rclone.conf"
2021/05/24 17:32:11 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "-vv" "ls" "cloudbackup:"]
2021/05/24 17:32:11 DEBUG : Creating backend with remote "cloudbackup:"
2021/05/24 17:32:11 DEBUG : Creating backend with remote "xidrivecloud"
2021/05/24 17:32:11 DEBUG : fs cache: renaming cache item "xidrivecloud" to be canonical "/home/kevin/xidrivecloud"
2021/05/24 17:32:11 DEBUG : fs cache: renaming cache item "cloudbackup:" to be canonical "/home/kevin/xidrivecloud"
        6 jello/jello
2021/05/24 17:32:11 DEBUG : 2 go routines active

and

$ rclone -vv ls xidrivecloud::
2021/05/24 17:32:47 DEBUG : Using config file from "/home/kevin/.config/rclone/rclone.conf"
2021/05/24 17:32:47 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "-vv" "ls" "xidrivecloud::"]
2021/05/24 17:32:47 DEBUG : Creating backend with remote "xidrivecloud::"
2021/05/24 17:32:47 DEBUG : Creating backend with remote "idrivecloud/:.bin"
2021/05/24 17:32:47 DEBUG : fs cache: renaming cache item "idrivecloud/:.bin" to be canonical "/home/kevin/idrivecloud/:.bin"
2021/05/24 17:32:47 DEBUG : Creating backend with remote "idrivecloud/:"
2021/05/24 17:32:47 DEBUG : fs cache: renaming cache item "idrivecloud/:" to be canonical "/home/kevin/idrivecloud/:"
2021/05/24 17:32:47 ERROR : : error listing: directory not found
2021/05/24 17:32:47 DEBUG : 2 go routines active
2021/05/24 17:32:47 Failed to ls with 2 errors: last error was: directory not found

and

$ rclone -vv ls idrivecloud:
2021/05/24 17:33:27 DEBUG : Using config file from "/home/kevin/.config/rclone/rclone.conf"
2021/05/24 17:33:27 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "-vv" "ls" "idrivecloud:"]
2021/05/24 17:33:27 DEBUG : Creating backend with remote "idrivecloud:"
2021/05/24 17:33:28 DEBUG : 4 go routines active

this shows that rclone thinks the remote is a local folder relative to curent working directory

perhaps change
remote = idrivecloud to remote = idrivecloud:
remote = xidrivecloud to remote = xidrivecloud:

Perfect! Thank you. That fixed it. I was simply unaware I needed to supply the training colon when supplying the remote name in "rclone config".

yeah, we all make that mistake, once but never twice :wink:

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.