What is the problem you are having with rclone?
I am trying to use the copy command from my file-system to AWS S3. The ls command works fine.
What is your rclone version (output from rclone version)
rclone v1.53.0
- os/arch: linux/amd64
- go version: go1.15
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Ubunutu 18.04
Which cloud storage system are you using? (eg Google Drive)
Amazon S3
The bucket policy is as follows
{
"Version": "2012-10-17",
"Id": "Policy1594727706373",
"Statement": [
{
"Effect": "Allow",
"Principal": {
"AWS": "arn:aws:iam::98xxxxxxxxxx:user/recordings"
},
"Action": [
"s3:ListBucket",
"s3:GetBucketLocation"
],
"Resource": "arn:aws:s3:::BUCKET_NAME"
},
{
"Effect": "Allow",
"Principal": {
"AWS": "arn:aws:iam::98xxxxxxxxxx:user/recordings"
},
"Action": [
"s3:ListBucket",
"s3:DeleteObject",
"s3:GetObject",
"s3:PutObject",
"s3:PutObjectAcl"
],
"Resource": [
"arn:aws:s3:::BUCKET_NAME/*",
"arn:aws:s3:::BUCKET_NAME"
]
}
]
}
The command you were trying to run (eg rclone copy /tmp remote:tmp)
/usr/bin/rclone copy -P le-renew.log my_config:/BUCKET_NAME/logging --config=/home/devops/.config/rclone/rclone.conf
The rclone config contents with secrets removed.
[my_config]
type = s3
provider = AWS
env_auth = false
access_key_id = xxxxxxxxxxxx
secret_access_key = xxxxxxxxxxxxxxxx
region = eu-central-1
A log from the command with the -vv flag
2020/09/22 07:13:39 DEBUG : Creating backend with remote "le-renew.log"
2020/09/22 07:13:39 DEBUG : Using config file from "/home/devops/.config/rclone/rclone.conf"
2020/09/22 07:13:39 DEBUG : fs cache: adding new entry for parent of "le-renew.log", "/home/devops"
2020/09/22 07:13:39 DEBUG : Creating backend with remote "my_config://BUCKET_NAME/logging"
2020/09/22 07:13:39 DEBUG : fs cache: renaming cache item "my_config://BUCKET_NAME/logging" to be canonical "my_config:BUCKET_NAME/logging"
2020-09-22 07:13:39 DEBUG : le-renew.log: Need to transfer - File not found at Destination
2020-09-22 07:13:39 ERROR : le-renew.log: Failed to copy: AccessDenied: Access Denied
status code: 403, request id: 7JBKFQ4M0MAG5R5T, host id: /Q1hHE6sft1oVMPFB6d0dawm7QmSJRsfqD/Md1Cy/xYwi0+ogyHhkXmLNkRl27FP/ZpC/Uo5fSw=
2020-09-22 07:13:39 ERROR : Attempt 1/3 failed with 1 errors and: AccessDenied: Access Denied
status code: 403, request id: 7JBKFQ4M0MAG5R5T, host id: /Q1hHE6sft1oVMPFB6d0dawm7QmSJRsfqD/Md1Cy/xYwi0+ogyHhkXmLNkRl27FP/ZpC/Uo5fSw=
2020-09-22 07:13:39 DEBUG : le-renew.log: Need to transfer - File not found at Destination
2020-09-22 07:13:39 ERROR : le-renew.log: Failed to copy: AccessDenied: Access Denied
status code: 403, request id: D0820C9F9776E82A, host id: bz62aqfIzDOkSMMaP/EYmLBvjrviRhXynHOtZJKot8QzvJ5dP70h+JnK/Oz8FSnqnXwh0NPzatw=
2020-09-22 07:13:39 ERROR : Attempt 2/3 failed with 1 errors and: AccessDenied: Access Denied
status code: 403, request id: D0820C9F9776E82A, host id: bz62aqfIzDOkSMMaP/EYmLBvjrviRhXynHOtZJKot8QzvJ5dP70h+JnK/Oz8FSnqnXwh0NPzatw=
2020-09-22 07:13:39 DEBUG : le-renew.log: Need to transfer - File not found at Destination
2020-09-22 07:13:39 ERROR : le-renew.log: Failed to copy: AccessDenied: Access Denied
status code: 403, request id: ECE92A8773FFB4D0, host id: odWMEZ1i76YAVGG5g+ujZgTkSS5IYcsL9WupQXCTgAygWD4kGNd/ayxeMjgyHEMwMWzRB2gohQk=
2020-09-22 07:13:39 ERROR : Attempt 3/3 failed with 1 errors and: AccessDenied: Access Denied
status code: 403, request id: ECE92A8773FFB4D0, host id: odWMEZ1i76YAVGG5g+ujZgTkSS5IYcsL9WupQXCTgAygWD4kGNd/ayxeMjgyHEMwMWzRB2gohQk=
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.3s
2020/09/22 07:13:39 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.3s
2020/09/22 07:13:39 DEBUG : 5 go routines active
2020/09/22 07:13:39 Failed to copy: AccessDenied: Access Denied
status code: 403, request id: ECE92A8773FFB4D0, host id: odWMEZ1i76YAVGG5g+ujZgTkSS5IYcsL9WupQXCTgAygWD4kGNd/ayxeMjgyHEMwMWzRB2gohQk=