Problem in copying or listing the files in s3 compatible storage

Help and Support
1

What is the problem you are having with rclone?

I am trying to copy the content within our s3 compatible storage from one bucket to another bucket. It worked earlier. I wanted to copy the leftovers but running the same command is having a problem. After troubleshooting , i did trace out i am not able to list the files itself. It is excluding the virtual folders while listing the content. Not sure why

What is your rclone version (output from rclone version)

1.53.

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 64Bit

Which cloud storage system are you using? (eg Google Drive)

S3 compatible storage

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy s3bucket1:bucket/Folder7/ s3bucket2:bucket/Folder7/

and also

rclone ls s3bucket1:bucket/Folder7/

The rclone config contents with secrets removed.

[s3bucket1]
type = s3
provider = Other
env_auth = false
access_key_id = 
secret_access_key = 
region = other-v2-signature
endpoint = http://endpoint
acl = private
bucket_acl = private
v2_auth = true

A log from the command with the -vv flag

Log for listing
------------------
Folder1 : Excluded
Folder2 : Excluded
Folder3 : Excluded
Folder4 : Excluded
Folder5 : Excluded
Folder6 : Excluded
Folder7 : Excluded
0 Folder7

Log for copying the content
-----------------------------------
Failed to create file system for "Folder7": Folder7 is a file not a directory.
2

hi,
can you post the debug log?

3

Here is the debug log.

./rclone ls s3bucket1:bucket/Folder7 -vv
2020/10/06 02:11:53 DEBUG : rclone: Version "v1.53.1" starting with parameters ["./rclone" "ls" "s3bucket1:bucket/Folder7" "-vv"]
2020/10/06 02:11:53 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2020/10/06 02:11:53 DEBUG : Creating backend with remote "s3bucket1:bucket/Folder7"
2020/10/06 02:11:53 DEBUG : Using v2 auth
2020/10/06 02:11:53 DEBUG : fs cache: adding new entry for parent of "s3bucket1:bucket/Folder7", "s3bucket1:bucket"
2020/10/06 02:11:53 DEBUG : Folder1: Excluded
2020/10/06 02:11:53 DEBUG : Folder2: Excluded
2020/10/06 02:11:53 DEBUG : Folder3: Excluded
2020/10/06 02:11:53 DEBUG : Folder4: Excluded
2020/10/06 02:11:53 DEBUG : Folder5: Excluded
2020/10/06 02:11:53 DEBUG : Folder6: Excluded
2020/10/06 02:11:53 DEBUG : yFolder3: Excluded
2020/10/06 02:11:53 DEBUG : Folder7: Excluded
2020/10/06 02:11:53 DEBUG : Folder1: Excluded
2020/10/06 02:11:53 DEBUG : Folder2: Excluded
2020/10/06 02:11:53 DEBUG : Folder3: Excluded
2020/10/06 02:11:53 DEBUG : Folder4: Excluded
2020/10/06 02:11:53 DEBUG : Folder5: Excluded
2020/10/06 02:11:53 DEBUG : Folder6: Excluded
2020/10/06 02:11:53 DEBUG : yFolder3: Excluded
        0 Folder7
2020/10/06 02:11:53 DEBUG : 4 go routines active

COPY ERROR

 ./rclone copy s3bucket2:bucket/Folder7/ s3bucket1:bucket/Folder7/ -vvv
2020/10/06 02:42:06 DEBUG : rclone: Version "v1.53.1" starting with parameters ["./rclone" "copy" "s3bucket2:bucket/Folder7/" "s3bucket1:bucket/Folder7/" "-vvv"]
2020/10/06 02:42:06 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2020/10/06 02:42:06 DEBUG : Creating backend with remote "s3bucket2:bucket/Folder7/"
2020/10/06 02:42:06 DEBUG : Using v2 auth
2020/10/06 02:42:06 DEBUG : fs cache: adding new entry for parent of "s3bucket2:bucket/Folder7/", "s3bucket2:bucket"
2020/10/06 02:42:06 DEBUG : Creating backend with remote "s3bucket1:bucket/Folder7/"
2020/10/06 02:42:06 DEBUG : Using v2 auth
2020/10/06 02:42:06 DEBUG : fs cache: adding new entry for parent of "s3bucket1:bucket/Folder7/", "s3bucket1:bucket"
2020/10/06 02:42:06 Failed to create file system for "s3bucket1:bucket/Folder7/": is a file not a directory
4

you have a file named Folder7 of size 0 bytes
perhaps delete it.

5

i don't see that file that all in the storage side..

6

image
how did you create that?

7

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.