What is the problem you are having with rclone?
After running rclone sync, I want to run rclone check on only the new and changed files.
Unchanged and deleted files should not be checked.
How to take the output of rclone sync and feed it to rclone check
Please advise, Thanks
Run the command 'rclone version' and share the full output of the command.
rclone v1.74.2
- os/version: Microsoft Windows 11 Pro 24H2 24H2 (64 bit)
- os/kernel: 10.0.26100.8039 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.26.3
- go/linking: static
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
local
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone sync /path/to/src /path/to/dst
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
No config
A log from the command that you were trying to run with the -vv flag
No log file
You can get data you need using logger-flags:
then do a bit of scripting and run rclone check with filters limiting scope to only files you want.
Hello, Thanks for the reply.
What I asking for, seems like an obvious feature to me?
I searched the forum but could not find anything about
I did see the logger flags, but cannot figure out to get the list of files.
If rclone copies a new file, output that to a text file.
If rclone copies a modified file, output that to the text file.
I can do some simple scripting to massage that the text, but how to feed it back to rclone check
Not that I have done it myself but having list of files I would try to apply something like --files-fromflag:
Filter flags determine which files rclone sync, move, ls, lsl, md5sum, sha1sum, size, delete, check and similar commands apply to. | Rclone filtering, includes and excludes
to rclone check
This way I would limit checks to specific list of files.
Thanks but I am asking how to create that list in the first place.
Something like:
rclone sync src/ dst/ --differ sync.log--missing-on-dst sync.log
This will print to sync.log all new and changed files at source.
For testing might be easier to print everything to stdout:
rclone sync src/ dst/ --differ - --missing-on-dst -
rOne small addition: if you send the changed/new names to a file with and , you can usually feed that same file to with . I would test it first with stdout/dry-run, because the paths in the list need to be relative to the source/dest root, e.g. then . If the command is run from PowerShell/CMD on Windows, also watch the quoting/path separators.
For this specific case I would use --combined rather than the separate --differ/--missing-on-dst files. The first character tells you the state, so you can keep only + and *, strip that prefix, then pass the resulting relative path list to rclone check --files-from list.txt src/ dst/.
That also avoids depending on the exact wording of normal sync logs. Do a --dry-run first and check that the paths in list.txt are relative to the same root you give to check.
@LucasSyncNL , Sorry no idea what you mean?
Why all that extra work, is there some edge case that --differ/--missing-on-dst will not catch?
@kapitainsky approach seems to be working well, so far.
I have been sick the last two weeks, not much time for additional testing.