What is the problem you are having with rclone?
I'm probably have configuration issues with rclone (or permissions issues maybe). I'm trying to setup a bucket with multiples folders with their own permissions on Amazon S3. The bucket should be accessible by multiples IAM user but each user should only have access to one folder (prefix). Everything seems to be ok with awscli but I always have access denied when using rclone.
The bucket have been created with this configuration (extract from cloudformation):
AccessControl: Private
PublicAccessBlockConfiguration:
BlockPublicAcls: True
BlockPublicPolicy: True
IgnorePublicAcls: True
RestrictPublicBuckets: True
Here are the policies I have setup for the specific IAM User (extract from cloudforamtion):
Type: AWS::IAM::User
Properties:
Policies:
- PolicyName: bucket-access
PolicyDocument:
Version: '2012-10-17'
Statement:
- Effect: Allow
Action:
- s3:PutObject
- s3:GetObject*
- s3:HeadObject*
- s3:ListObject*
Resource:
- !Sub arn:aws:s3:::${BucketTransfer}/client/*
- PolicyName: bucket-ls
PolicyDocument:
Version: '2012-10-17'
Statement:
- Effect: Allow
Action:
- s3:ListBucket
Resource:
- !Sub arn:aws:s3:::${BucketTransfer}
Condition:
StringEquals:
s3:prefix:
- ""
- "client/"
s3:delimiter:
- "/"
Thoses commands are working:
aws s3 ls s3://mybucket/client/
aws s3 ls s3://mybucket/
But with rclone, I have access denied:
rclone ls configname:mybucket/client
rclone ls configname:mybucket
I have a status code 403: Failed to ls: AccessDenied: Access Denied
Run the command 'rclone version' and share the full output of the command.
I'm using version 1.66.0:
rclone v1.66.0
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 6.5.0-26-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.22.1
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Amazon S3
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
My rclone configuration is:
[configname]
type = s3
provider = AWS
env_auth = false
region = eu-west-3
#endpoint = s3.eu-west-3.amazonaws.com
access_key_id = REDACTED
secret_access_key = REDACTED
#location_constraint = eu-west-3
acl = private
A log from the command that you were trying to run with the -vv flag
2024/03/20 09:40:45 Failed to ls: AccessDenied: Access Denied
status code: 403, request id: REDACTED, host id: REDACTED
Thanks for your help