Rclone --max-age flag s3/gcloud transactions

[schmitch (Schmitt Christian)]

Hello, I'm looking at the --max-age flag when using rclone copy against gcloud.
Currently our bucket (gcloud) has "folders" like that:

year/month/day/hour

and all files inside are immutable, so what "traversing" happens when we now do a copy from gcloud to s3 with --max-age=1d, does it actually filter also the folders based on max-age so it would do a list command for year than for month, but since max-age flag it would only find the current month?
or would rclone still need to traverse everything?

Edit:
the question would be if it would be preferable to do:
a. rclone copy --max-age=1d gcloud:bucket s3:bucket
b. rclone copy gcloud:bucket/year/month/day s3:bucket

and if the output would be the same

[asdffdsa (jojothehumanmonkey)]

hello and welcome to the forum,

--max-age filters files, not folders.
rclone will traverse all the subfolders of the remote:path.

you could write a script to reduce the amount of traversing based on the current date.

[ncw (Nick Craig-Wood)]

@schmitch

Edit:
the question would be if it would be preferable to do:
a. rclone copy --max-age=1d gcloud:bucket s3:bucket
b. rclone copy gcloud:bucket/year/month/day s3:bucket

Option b) would be preferable. Option a) will still traverse all the files.