iDrive S3 - upload fails with keys without deletion access permission

What is the problem you are having with rclone?

iDrive S3 and access keys with the following access permissions (screenshot from iDrive S3 web admin console):

can not upload anything.

Run the command 'rclone version' and share the full output of the command.

rclone v1.64.2

  • os/version: darwin 14.1.1 (64 bit)
  • os/kernel: 23.1.0 (x86_64)
  • os/type: darwin
  • os/arch: amd64
  • go/version: go1.21.3
  • go/linking: dynamic
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

iDrive S3

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy test.txt iDrive-london:london -vv

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[iDrive-london]
type = s3
provider = IDrive
access_key_id = XXX
secret_access_key = XXX
endpoint = p7v1.ldn.idrivee2-40.com
region = gb-ldn

A log from the command that you were trying to run with the -vv flag

$ rclone copy test.txt iDrive-london:london -vv
2023/11/16 16:03:13 DEBUG : rclone: Version "v1.64.2" starting with parameters ["rclone" "copy" "test.txt" "iDrive-london:london" "-vv"]
2023/11/16 16:03:13 DEBUG : Creating backend with remote "test.txt"
2023/11/16 16:03:13 DEBUG : Using config file from "/Users/kptsky/.config/rclone/rclone.conf"
2023/11/16 16:03:13 DEBUG : fs cache: adding new entry for parent of "test.txt", "/Users/kptsky/Temp/test"
2023/11/16 16:03:13 DEBUG : Creating backend with remote "iDrive-london:london"
2023/11/16 16:03:13 DEBUG : Resolving service "s3" region "gb-ldn"
2023/11/16 16:03:14 DEBUG : test.txt: Need to transfer - File not found at Destination
2023/11/16 16:03:14 ERROR : test.txt: Failed to copy: failed to prepare upload: AccessDenied: Access Denied.
	status code: 403, request id: 179825F5260E9B06, host id:
2023/11/16 16:03:14 ERROR : Attempt 1/3 failed with 1 errors and: failed to prepare upload: AccessDenied: Access Denied.
	status code: 403, request id: 179825F5260E9B06, host id:
2023/11/16 16:03:14 DEBUG : test.txt: Need to transfer - File not found at Destination
2023/11/16 16:03:14 ERROR : test.txt: Failed to copy: failed to prepare upload: AccessDenied: Access Denied.
	status code: 403, request id: 179825F53821899D, host id:
2023/11/16 16:03:14 ERROR : Attempt 2/3 failed with 1 errors and: failed to prepare upload: AccessDenied: Access Denied.
	status code: 403, request id: 179825F53821899D, host id:
2023/11/16 16:03:14 DEBUG : test.txt: Need to transfer - File not found at Destination
2023/11/16 16:03:14 ERROR : test.txt: Failed to copy: failed to prepare upload: AccessDenied: Access Denied.
	status code: 403, request id: 179825F53F969BA9, host id:
2023/11/16 16:03:14 ERROR : Attempt 3/3 failed with 1 errors and: failed to prepare upload: AccessDenied: Access Denied.
	status code: 403, request id: 179825F53F969BA9, host id:
2023/11/16 16:03:14 INFO  :
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.7s

2023/11/16 16:03:14 DEBUG : 8 go routines active
2023/11/16 16:03:14 Failed to copy: failed to prepare upload: AccessDenied: Access Denied.
	status code: 403, request id: 179825F53F969BA9, host id:

The same copy operation works when using aws cli and the same keys.

$ rclone ls iDrive-london:london

$ aws --endpoint-url https://p7v1.ldn.idrivee2-40.com s3 cp test.txt s3://london
upload: ./test.txt to s3://london/test.txt

$ rclone ls iDrive-london:london
        7 test.txt

Initially I thought it is some obvious mistake on my end but after google and testing I am not able to figure out what is wrong.

in that case, idrive is using a policy that has been locked down.
rclone copy test.txt iDrive-london,no_check_bucket:london -vv

Thank you very much. It works indeed.

Now need more google to understand - but at least know what to look for:)

And thinking loudly - why rclone is not as smart here as aws cli?

legacy issue, that is how rclone works.

Before v1.52.0 this would have passed silently due to a bug.

1 Like

I made some improvements in this area in the beta but I don't think it fixes this issue.

We should probably do something on AccessDenied errors. We could ignore them...

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.