Overcoming remote maximum object name length

Help and Support
1

What is the problem you are having with rclone?

https://cloud.google.com/storage/docs/naming#objectnames

I've got encrypted files (including filenames) and hence long file paths. Google Cloud Storage (and I believe other remotes) have 1024 character limits for object names.

Does rclone currently have a solution for this?
If not, does anyone with familiarity of the codebase think it would be something feasible to address (e.g. some kind of path mapping for long file paths)?

What is your rclone version (output from rclone version)

v1.49.5

Which OS you are using and how many bits (eg Windows 7, 64 bit)

linux/amd64

Which cloud storage system are you using? (eg Google Drive)

Google Cloud Storage

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync

2

The actual limits vary by provider. I think google drive's limits are 8k per filename so you could back up there.

No... It is a hard problem! It really needs to be a metadata abstraction.

It is possible we could add it to the chunker backend which will be released in v1.50.

3

Chunker backend? What does that do?
Care to link me something to read up on? Sounds very interesting.

4

See: https://tip.rclone.org/chunker/ :slight_smile:

1 Like
5

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.