STOP and READUSE THIS TEMPLATENO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.
What is the problem you are having with rclone?
...
I can list all bucket , but when I try to list a specific bucket I am getting
" Failed to ls: directory not found"
...
Run the command 'rclone version' and share the full output of the command.
...
./rclone version
rclone v1.67.0
os/version: Microsoft Windows Server 2019 Datacenter 1809 (64 bit)
os/kernel: 10.0.17763.2565 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.22.4
go/linking: static
go/tags: cmount
...
yes 167.0
Which cloud storage system are you using? (eg Google Drive)
AWS S3
The command you were trying to run (eg rclone copy /tmp remote:tmp)
A log from the command that you were trying to run with the -vv flag
.\rclone.exe ls mobisoft-prd-arch:tempmobi --no-check-certificate -vv
2024/07/24 11:55:48 DEBUG : rclone: Version "v1.67.0" starting with parameters ["C:\\rclone\\rclone.exe" "ls" "mobisoft-prd-arch:tempmobi" "--no-check-certificate" "-vv"]
2024/07/24 11:55:48 DEBUG : Creating backend with remote "mobisoft-prd-arch:tempmobi"
2024/07/24 11:55:48 DEBUG : Using config file from "C:\\Users\\t108_admin\\AppData\\Roaming\\rclone\\rclone.conf"
2024/07/24 11:55:48 DEBUG : Resolving service "s3" region "eu-west-1"
2024/07/24 11:55:48 DEBUG : 4 go routines active
2024/07/24 11:55:48 Failed to ls: directory not found
Can you list this bucket using other tools? E.g. aws cli?
I suspect that there is no problem with rclone but your buckets have some restrictive policies in place and credentials you use are not allowed to list anything below "root" level.
here is an aws s3 command that shows my the tempmobi bucket files
...
aws s3 ls s3://tempmobi --region eu-west-1 --endpoint-url https://vpce-0a28a80535397ed8a-q6v00xma.s3.eu-west-1.vpce.amazonaws.com --no-verify-ssl
...
and i can see the files in it .
When I run the rclon command
...
.\rclone.exe lsd mobisoft-prd-arch:tempmobi --no-check-certificate -vv
...
I am getting
...
2024/07/24 15:38:20 DEBUG : Creating backend with remote "mobisoft-prd-arch:tempmobi"
2024/07/24 15:38:20 DEBUG : Using config file from "C:\Users\t108_admin\AppData\Roaming\rclone\rclone.conf"
2024/07/24 15:38:20 DEBUG : Resolving service "s3" region "eu-west-1"
2024/07/24 15:38:20 ERROR : : error listing: directory not found
2024/07/24 15:38:20 DEBUG : 4 go routines active
2024/07/24 15:38:20 Failed to lsd with 2 errors: last error was: directory not found
...
B.R
Amit
fwiw, i never use location_constraint on s3 provider and i know it has caused issues in the forum.
and as a small side note, using acl = is not recommended by AWS.
so as a test, i would remove both flags and try again.
tho it should not matter, i would also try testing without endpoint =
... C:\rclone>.\rclone.exe lsd mobi:mobisoft-prd1 --no-check-certificate -vv --dump=headers
2024/07/24 17:29:29 DEBUG : rclone: Version "v1.67.0" starting with parameters [".\rclone.exe" "lsd" "mobi:mobisoft-prd1" "--no-check-certificate" "-vv" "--dump=headers"]
2024/07/24 17:29:29 DEBUG : Creating backend with remote "mobi:mobisoft-prd1"
2024/07/24 17:29:29 DEBUG : Using config file from "C:\Users\t108_admin\AppData\Roaming\rclone\rclone.conf"
2024/07/24 17:29:29 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2024/07/24 17:29:29 DEBUG : Resolving service "s3" region "eu-west-1"
2024/07/24 17:29:29 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2024/07/24 17:29:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/07/24 17:29:29 DEBUG : HTTP REQUEST (req 0xc00047aa20)
2024/07/24 17:29:29 DEBUG : GET /?delimiter=%2F&encoding-type=url&list-type=2&max-keys=1000&prefix= HTTP/1.1
Host: mobisoft-prd1.vpce-0a28a80535397ed8a-q6v00xma.s3.eu-west-1.vpce.amazonaws.com
User-Agent: rclone/v1.67.0
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20240724T142929Z
Accept-Encoding: gzip
2024/07/24 17:29:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/07/24 17:29:29 ERROR : : error listing: directory not found
2024/07/24 17:29:29 DEBUG : 4 go routines active
2024/07/24 17:29:29 Failed to lsd with 2 errors: last error was: directory not found
...