Rclone can't retain user metadata when syncing or copying from minio

Help and Support
1

What is the problem you are having with rclone?

I can't make rclone retain user metadata embedded in s3 user metadata, with the prefix X-Amz-Meta-.
for example if i do a minio object stat minio/bucket-name/cat.png this comes up

Metadata  :
  X-Amz-Meta-Creator: Me! 
  Content-Type      : image/jpeg

I first ran rclone sync to download the files to a nas shared folder. Then I use rclone sync again to upload from shared folder to a new bucket in minio. When I check the stat after these steps, the X-Amz-Meta-Creator is gone.

The same thing happens when i repeat above with rclone copy

What is your rclone version (output from rclone version)

1.55.1 (from the dockerized version of rclone)

Which OS you are using and how many bits (eg Windows 7, 64 bit)

ubuntu 20.04

Which cloud storage system are you using? (eg Google Drive)

i'm copying from a dockerized minio to a nas shared folder (shared via cifs)

The rclone config contents with secrets removed.

rclone sync minio:source-bucket /mnt/path-to-dest/bucket-name
2

hello and welcome to the forum,

rclone sync will delete the file in the dest and copy the newer file from local.

you should be able to add metadata using header

3

Where would rclone store the extra s3 data on the nas? One potential idea is storing it in extended attributes, but this isn't implemented yet.

So if you transfer S3 -> local -> S3 you will lose all the S3 metadata.

4

Right. That was the intuition I had as well.

5

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.