How to remove versioned files (s3/scaleway)?

What is the problem you are having with rclone?

rclone cleanup does not remove old versions of a file using the s3 backend

Run the command 'rclone version' and share the full output of the command.

rclone v1.58.1

  • os/version: debian 10.5 (64 bit)
  • os/kernel: 5.10.0-0.bpo.5-amd64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.17.9
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

scaleway

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone cleanup --progress --s3-provider Scaleway -v sw:XXXX

The rclone config contents with secrets removed.

[sw]
type = s3
provider = Other
env_auth = false
access_key_id = XXXX
secret_access_key = XXXX
region = fr-par
endpoint = https://s3.fr-par.scw.cloud
location_constraint = fr-par
acl = private

A log from the command with the -vv flag

2022/07/02 20:16:03 DEBUG : rclone: Version "v1.58.1" starting with parameters ["./rclone" "cleanup" "--progress" "--s3-provider" "Scaleway" "-vv" "sw:XXXX"]
2022/07/02 20:16:03 DEBUG : Creating backend with remote "sw:XXXX"
Enter configuration password:
password:
2022/07/02 20:16:12 DEBUG : Using config file from "/home/guybrush/.config/rclone/rclone.conf"
2022/07/02 20:16:12 DEBUG : sw: detected overridden config - adding "{LVA46}" suffix to name
2022/07/02 20:16:12 DEBUG : fs cache: renaming cache item "sw:XXXX" to be canonical "sw{LVA46}:XXXX"
2022-07-02 20:16:13 INFO  : S3 bucket XXXX: cleaning bucket "XXXX" of pending multipart uploads older than 24h0m0s
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:        10.4s

The command works successfully, but doesn't clean up old unversioned files like it does for other backends (e.g. backblaze). I couldn't find any way to list old versions using rclone or s3cmd, so I'm a bit stuck. Scaleway do not have a lifecycle rule to delete versions.

This issue would be what you want to follow:

Add support for S3 versions · Issue #1776 · rclone/rclone (github.com)

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.