S3 Compatible - Delete object + versions + delete markers

What is the problem you are having with rclone?

rclone is not deleting the versions and delete markers. The backend is using IDrive E2 which is S3 compliant storage.
It has server side encryption enabled and also versioning enabled. The issue that I am facing is that when I delete files using
delete/purge command, it shows files are deleted, however their versions and delete markets are present.
When I delete the folder manually from the IDRive UI, they delete objects, versions and delete markets. How can I instruct rclone to
delete all the object, versions and markers within a folder when removing a folder? I also tried "cleanup" command and it doesn't work as expected

Run the command 'rclone version' and share the full output of the command.

rclone v1.59.2

  • os/version: centos 7.9.2009 (64 bit)
  • os/kernel: 3.10.0-1062.9.1.el7.x86_64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.18.6
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Idrive E2

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone --rmdirs --progress --config=rclone.conf delete bucketname:/files/Projects/

The rclone config contents with secrets removed.

[idrive]
type = s3
provider = IDrive
env_auth = false
access_key_id = 
secret_access_key = 
endpoint = e4v6.da.idrivee2-36.com
server_side_encryption = aws:kms

[bucketname]
type = crypt
remote = idrive:bucketname
filename_encryption = off
directory_name_encryption = false
password = 

A log from the command with the -vv flag

Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:              3313 / 3313, 100%
Deleted:             3313 (files), 0 (dirs)
Elapsed time:        57.8s

Note: with the -vv enabled, it shows a lot of files being deleted.

See:

s3: Make rclone purge delete directory markers · Issue #4779 · rclone/rclone (github.com)

I think this is fixed in the latest beta which understands s3 versions now. Give it a go and tell me what you think.

You can use --s3-versions to see old versions and --s3-version-at to see versions at a particular time.

See the beta docs for s3 versions

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.