Issue with rclone Excluding Specific File Types with --filter

Help and Support
1

What is the problem you are having with rclone?

even with the --exclude "*.temp.mp4" flag, files with the .temp.mp4 extension are still being listed.

Run the command 'rclone version' and share the full output of the command.

rclone version
rclone v1.69.0

  • os/version: debian 11.3 (64 bit)
  • os/kernel: 5.10.0-13-amd64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.23.4
  • go/linking: static
  • go/tags: none
yes

Which cloud storage system are you using? (eg Google Drive)

backblaze

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Paste command here

rclone ls -vv --include ".mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:39:46 DEBUG : rclone: Version "v1.69.0" starting with parameters ["rclone" "ls" "-vv" "--include" ".mp4" "/home/ytdlp/yt/JPCAMERAMAN"]
2025/01/19 09:39:46 DEBUG : Creating backend with remote "/home/ytdlp/yt/JPCAMERAMAN"
2025/01/19 09:39:46 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
494403628 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].temp.mp4
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4
2025/01/19 09:39:46 DEBUG : 3 go routines active

rclone ls -vv --exclude ".temp.mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:40:16 DEBUG : rclone: Version "v1.69.0" starting with parameters ["rclone" "ls" "-vv" "--exclude" ".temp.mp4" "/home/ytdlp/yt/JPCAMERAMAN"]
2025/01/19 09:40:16 DEBUG : Creating backend with remote "/home/ytdlp/yt/JPCAMERAMAN"
2025/01/19 09:40:16 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
34043228 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f251.webm
3634753798 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f308.webm
64162 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].jpg
72708 散歩モンスター - Videos [UCUlK2Pz_Y-pHd0xYRTzHwMg].jpg
72708 散歩モンスター [@JPCAMERAMAN].jpg
63526 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].jpg
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4
2025/01/19 09:40:16 DEBUG : 3 go routines active

rclone ls --include ".mp4" --exclude ".temp.mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:41:44 ERROR : Using --filter is recommended instead of both --include and --exclude as the order they are parsed in is indeterminate
494403628 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].temp.mp4
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4

rclone ls -vv --filter "+ *.mp4" --filter "- *.temp.mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:42:28 DEBUG : rclone: Version "v1.69.0" starting with parameters ["rclone" "ls" "-vv" "--filter" "+ *.mp4" "--filter" "- *.temp.mp4" "/home/ytdlp/yt/JPCAMERAMAN"]
2025/01/19 09:42:28 DEBUG : Creating backend with remote "/home/ytdlp/yt/JPCAMERAMAN"
2025/01/19 09:42:28 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
34043228 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f251.webm
3634753798 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f308.webm
64162 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].jpg
494403628 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].temp.mp4
72708 散歩モンスター - Videos [UCUlK2Pz_Y-pHd0xYRTzHwMg].jpg
72708 散歩モンスター [@JPCAMERAMAN].jpg
63526 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].jpg
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4
2025/01/19 09:42:28 DEBUG : 3 go routines active

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

Paste config here

A log from the command that you were trying to run with the -vv flag

rclone ls -vv --include ".mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:39:46 DEBUG : rclone: Version "v1.69.0" starting with parameters ["rclone" "ls" "-vv" "--include" ".mp4" "/home/ytdlp/yt/JPCAMERAMAN"]
2025/01/19 09:39:46 DEBUG : Creating backend with remote "/home/ytdlp/yt/JPCAMERAMAN"
2025/01/19 09:39:46 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
494403628 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].temp.mp4
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4
2025/01/19 09:39:46 DEBUG : 3 go routines active

rclone ls -vv --exclude ".temp.mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:40:16 DEBUG : rclone: Version "v1.69.0" starting with parameters ["rclone" "ls" "-vv" "--exclude" ".temp.mp4" "/home/ytdlp/yt/JPCAMERAMAN"]
2025/01/19 09:40:16 DEBUG : Creating backend with remote "/home/ytdlp/yt/JPCAMERAMAN"
2025/01/19 09:40:16 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
34043228 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f251.webm
3634753798 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f308.webm
64162 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].jpg
72708 散歩モンスター - Videos [UCUlK2Pz_Y-pHd0xYRTzHwMg].jpg
72708 散歩モンスター [@JPCAMERAMAN].jpg
63526 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].jpg
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4
2025/01/19 09:40:16 DEBUG : 3 go routines active

rclone ls --include ".mp4" --exclude ".temp.mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:41:44 ERROR : Using --filter is recommended instead of both --include and --exclude as the order they are parsed in is indeterminate
494403628 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].temp.mp4
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4

rclone ls -vv --filter "+ *.mp4" --filter "- *.temp.mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:42:28 DEBUG : rclone: Version "v1.69.0" starting with parameters ["rclone" "ls" "-vv" "--filter" "+ *.mp4" "--filter" "- *.temp.mp4" "/home/ytdlp/yt/JPCAMERAMAN"]
2025/01/19 09:42:28 DEBUG : Creating backend with remote "/home/ytdlp/yt/JPCAMERAMAN"
2025/01/19 09:42:28 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
34043228 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f251.webm
3634753798 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f308.webm
64162 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].jpg
494403628 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].temp.mp4
72708 散歩モンスター - Videos [UCUlK2Pz_Y-pHd0xYRTzHwMg].jpg
72708 散歩モンスター [@JPCAMERAMAN].jpg
63526 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].jpg
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4
2025/01/19 09:42:28 DEBUG : 3 go routines active
2

It's giving you the error in the output. Use --filter instead.

3

I have also tried using --filter like this:

rclone ls -vv --filter "+ *.mp4" --filter "- *.temp.mp4" /home/ytdlp/yt/JPCAMERAMAN
2025/01/19 09:51:37 DEBUG : rclone: Version "v1.69.0" starting with parameters ["rclone" "ls" "-vv" "--filter" "+ *.mp4" "--filter" "- *.temp.mp4" "/home/ytdlp/yt/JPCAMERAMAN"]
2025/01/19 09:51:37 DEBUG : Creating backend with remote "/home/ytdlp/yt/JPCAMERAMAN"
2025/01/19 09:51:37 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
34043228 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f251.webm
3634753798 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].f308.webm
64162 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].jpg
494403628 夜の大久保公園・新宿歌舞伎町をお散歩！話題の人気立ち女子に遭遇Night Walk in Tokyo Relaxing Walk Japan Shinjuku Kabukich [ynFmfa3folU].temp.mp4
72708 散歩モンスター - Videos [UCUlK2Pz_Y-pHd0xYRTzHwMg].jpg
72708 散歩モンスター [@JPCAMERAMAN].jpg
63526 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].jpg
4192428921 雨の大久保公園・夜の新宿歌舞伎町をお散歩！超可愛い立ち女子の実態！Relaxing Night Walk in Japan Tokyo, Shinjuku Kabuki [_IYVyEYY0IU].mp4
2025/01/19 09:51:37 DEBUG : 3 go routines active

But the .temp.mp4 files are still included in the output.

4

Order is backwards. You want the most exclusive first and than the less later.

1 Like
5

--filter "- *.temp.mp4" --filter "+ *.mp4"

will exclude *.temp.mp4 but will include everything else.

Unlike when using --include when --filter is used you have to remember to always exclude everything else:

- *.temp.mp4
+ *.mp4
- *

It is also much cleaner to use --filter-from and put all rules inside some file.

1 Like
6

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.