How do I find recently transferred files in folders that have an old date?

What is the problem you are having with rclone?

Hello Everyone. Believe it or not, I've been studying the RCloud Forum for over a week now and have learned a lot. I still need more time. :slight_smile:

In my script, I want to perform a full SYNC when the computer starts, and then every e.g. 15 minutes use the COPY function to add only the most recent files to the cloud. For this I use, among others, --max-age 15m. COPY gives me the option to use --no-traverse.
Everything I've done so far is working very well. If I create a new file in the source folder or update an existing one, everything is copied to the cloud correctly. But when I move files that have an older date to the source folder, the COPY function does not see them. Is there any way to make RCLone also check files with older dates that appeared in the source folder? The ones that I move e.g. drag & drop from a folder to the RClone source folder?

When do I need it? For example, I move photos I took a week ago to the source folder, and my COPY loop only checks the last 15 minutes.
I only want to check for example the last 15 minutes, because I already have about 2TB of data today and it's hundreds of thousands of files. Without --max-age RClone checks for all files.

Thanks for any suggestions. :slight_smile:

Run the command 'rclone version' and share the full output of the command.

rclone v1.69.0

  • os/version: Microsoft Windows 10 Home 22H2 22H2 (64 bit)
  • os/kernel: 10.0.19045.5371 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.23.4
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

pCloud

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync -P -v "D:\MYFOLDER" ENCRYPTED-PCloud-FOLDER: --checkers 12 --transfers 36 --multi-thread-streams=1
:Copy-Start
rclone copy -P -v "D:\MYFOLDER" ENCRYPTED-PCloud-FOLDER: --checkers 12 --transfers 36 --multi-thread-streams=1 --max-age 15m --no-traverse
timeout /t 300 /nobreak
goto Copy-Start

welcome to the forum,

that is a well known issue of using rclone copy --max-age
could modify the script, to run rclone sync, every x hour

Thanks for the answer and suggestion.

Yes, that's one solution, although I'd like to avoid calling SYNC more than once a day, because the check itself takes a long time, like a dozen or so minutes. COPY in the --no-traverse version would be better.

But I have another idea after Your entry... and I'm already checking it...

For example, when I set --max-age to 30 days or even 60 days, COPY still works very fast. The last month or two will have a maximum of several or a dozen thousand files to check, not several hundred thousand or a million.
The older files than today's, that I most often move to the rclone source folder, are usually a few days old, maybe a week old. This solution should handle 99.9% of near-online synchronization. The rest will be completed once a day.

As you can see, your comment gave me the idea above. It's always good to ask the practitioners. Thanks! :slight_smile:

keep in mind,
if you move a file from one location to another location, inside the source, and they are older than --max-age,
then rclone copy will ignore that file.

Yes. I know. I have tested and observed that this is exactly how it works.
Thanks :slight_smile: