Sync tries to delete excluded files

What is the problem you are having with rclone?

Sync tries to delete a lot of excluded files.

Run the command 'rclone version' and share the full output of the command.

rclone v1.69.1

  • os/version: fedora 41 (64 bit)
  • os/kernel: 6.12.12-207.bazzite.fc41.x86_64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.24.0
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

OneDrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

./rclone sync backend:Apps/Steam /home/deck/ --filter-from /tmp/test.filter --copy-links --transfers 8 --checkers 16 --log-file /tmp/rclone.log --log-format none -vv --onedrive-av-override --dry-run

The rclone config contents with secrets removed.

[backend]
type = onedrive
drive_type = personal

A log from the command with the -vv flag

In the logs you can find rclone wants to delete files like .steam/steam/steamapps/common/TGAAC/nativeDX11x64/system/texture which is never included in the filter.

Filters I used

- *.cache
- cache/**
- Cache/**
- *.shader
- shader/**
- Shader/**
- *.log
- log/**
- Log/**
- logs/**
- Logs/**
- *.lock
- *.lck
- STORE
- temp/**
- Temp/**
- temporary/**
- Temporary/**
- CacheStorageKey.dat
+ /.steam/steam/steamapps/common/TGAAC/TGAAC.exe
+ /.steam/steam/steamapps/common/TGAAC/data/**
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/**/*_jpn.*
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/go_anime_1a_MUSIC.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/op_title.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/staffroll_part2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/09_tsuisou_1.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/10_asougi_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/12_naruhodo_igiari.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/13_naruhodo_igiari_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/14_tsuikyuu.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/15_tsuikyuu_no_intro.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/16_jingle.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/16_jingle_bb.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/17_hanyou_comical.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/18_hanyou_mysterious.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/19_hanyou_yuuga.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/20_holmes_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/21_susato_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/21_susato_theme_no_intro.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/22_gina.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/23_souseki_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/24_watson_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/25_rivalkenji_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/30_kyuukei.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/31_kaitei.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/32_suspense.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/33_logic.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/34_jinmon_1.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/35_jinmon_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/36_shinjitsu.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/37_syouso.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/38_taiketsu.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/39_syounin_kanmon.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/40_baishin_battle.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/41_tsuisou_3.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/42_tsuisou_4.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/43_tsuisou_5.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/44_sousa_joban.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/45_sousa_kakushin.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/46_ryuuchijo.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/47_jimusyo.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/48_place_london.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/49_scotland_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/53_ending.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_no_intro.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_shitagamen.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_title.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/asougi_arr.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/asougi_kaisou.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/baskervilles.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/bgm_op_ep1.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/ending_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/ending_2_bb.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/epilogue_1.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/epilogue_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/hikaesitsu_final.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/holmes_suiri.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/iris_tsuisou.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kaitei_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kaitei_final.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kenjippoi.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoudousuiri_1.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoudousuiri_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoutou.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoutou_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_shita.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_ue.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_ue_no_intro.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_2_ue.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_3_shita.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_3_ue.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_jingle.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/mamemomi_break.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/miterumon_last.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/opening.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/op_title_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/orgoal_ed.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_break.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_break_organ.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_theme.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/place_rouningyou.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/preussen.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/preussen_nico.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/record_german.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/science_demo.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/shitsumu.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/shouso_final.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/sith_murderer.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/staffroll_1.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/susato_igiari.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/susato_igiari_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/suspense_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_aibou.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_asougi_kenji.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_asougi_kenji_no_intro.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_dobinbo.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_drebber.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_mamemomi.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_petenshi.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_professor.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_professor_last.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_rouzaiku.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_sith.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuikyuu_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuikyu_yochou.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_6.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_bangieks.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_dobinbo.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_jigoku.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_mitelmon.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_viridian.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/13_naruhodo_igiari_2.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/47_jimusyo.sngw
+ /.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/aibou_title.sngw
- **

If it is not included than it is excluded, isn't it? Have a look at the last line of your filter.

Yes it's excluded, why would rclone want to delete an excluded folder though?

I'm aware of the flag --delete-excluded but it's not used in my command yet somehow it still wants to do that.

Need another coffee to start thinking clearly. I suggest you post full log where we can see what is going on.

1 Like

Ah sorry, shouldn't have used tmpfs for this log, here's the full one:

I had to change the remote to Dropbox because I cannot risk messing with my production drive again, but the issue is still present.

First I did a sync run to upload some totally unrelated files, the filter is here:

- *.cache
- cache/**
- Cache/**
- *.shader
- shader/**
- Shader/**
- *.log
- log/**
- Log/**
- logs/**
- Logs/**
- *.lock
- *.lck
- STORE
- temp/**
- Temp/**
- temporary/**
- Temporary/**
- CacheStorageKey.dat
+ /.steam/steam/userdata/*/760/screenshots.vdf
+ /.steam/steam/userdata/*/config/shortcuts.vdf
+ /.steam/steam/userdata/*/config/grid/**
+ /homebrew/plugins/**
+ /homebrew/settings/**
+ /homebrew/themes/**
- **

Then I sync again with the filter in OP to upload all files. Then I run the command from the OP to try to "pull remote changes down to local" and get the issue.

From the log, seems like only DEBUG : .steam/steam/steamapps/common/TGAAC/Tool: Excluded is actually excluded while all other folders in .steam/steam/steamapps/common/TGAAC are missing for some reason? That's the last path being excluded.

1 Like

could you also post rclone sync with extra --dump filters flag?

All log is not needed (it will be the same) but only the beginning where rclone will show how it uses filters.

Are these directories rclone attempts to delete empty?

--- start filters ---
--- File filter rules ---
- (^|/)[^/]*\.cache$
- (^|/)cache/.*$
- (^|/)Cache/.*$
- (^|/)[^/]*\.shader$
- (^|/)shader/.*$
- (^|/)Shader/.*$
- (^|/)[^/]*\.log$
- (^|/)log/.*$
- (^|/)Log/.*$
- (^|/)logs/.*$
- (^|/)Logs/.*$
- (^|/)[^/]*\.lock$
- (^|/)[^/]*\.lck$
- (^|/)STORE$
- (^|/)temp/.*$
- (^|/)Temp/.*$
- (^|/)temporary/.*$
- (^|/)Temporary/.*$
- (^|/)CacheStorageKey\.dat$
+ ^\.steam/steam/steamapps/common/TGAAC/TGAAC\.exe$
+ ^\.steam/steam/steamapps/common/TGAAC/data/.*$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/.*/[^/]*_jpn\.[^/]*$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/go_anime_1a_MUSIC\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/op_title\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/staffroll_part2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/09_tsuisou_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/10_asougi_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/12_naruhodo_igiari\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/13_naruhodo_igiari_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/14_tsuikyuu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/15_tsuikyuu_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/16_jingle\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/16_jingle_bb\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/17_hanyou_comical\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/18_hanyou_mysterious\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/19_hanyou_yuuga\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/20_holmes_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/21_susato_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/21_susato_theme_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/22_gina\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/23_souseki_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/24_watson_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/25_rivalkenji_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/30_kyuukei\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/31_kaitei\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/32_suspense\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/33_logic\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/34_jinmon_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/35_jinmon_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/36_shinjitsu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/37_syouso\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/38_taiketsu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/39_syounin_kanmon\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/40_baishin_battle\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/41_tsuisou_3\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/42_tsuisou_4\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/43_tsuisou_5\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/44_sousa_joban\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/45_sousa_kakushin\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/46_ryuuchijo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/47_jimusyo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/48_place_london\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/49_scotland_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/53_ending\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_shitagamen\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_title\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/asougi_arr\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/asougi_kaisou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/baskervilles\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/bgm_op_ep1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/ending_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/ending_2_bb\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/epilogue_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/epilogue_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/hikaesitsu_final\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/holmes_suiri\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/iris_tsuisou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kaitei_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kaitei_final\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kenjippoi\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoudousuiri_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoudousuiri_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoutou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoutou_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_shita\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_ue\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_ue_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_2_ue\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_3_shita\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_3_ue\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_jingle\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/mamemomi_break\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/miterumon_last\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/opening\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/op_title_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/orgoal_ed\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_break\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_break_organ\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/place_rouningyou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/preussen\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/preussen_nico\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/record_german\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/science_demo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/shitsumu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/shouso_final\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/sith_murderer\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/staffroll_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/susato_igiari\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/susato_igiari_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/suspense_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_aibou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_asougi_kenji\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_asougi_kenji_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_dobinbo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_drebber\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_mamemomi\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_petenshi\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_professor\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_professor_last\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_rouzaiku\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_sith\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuikyuu_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuikyu_yochou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_6\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_bangieks\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_dobinbo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_jigoku\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_mitelmon\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_viridian\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/13_naruhodo_igiari_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/47_jimusyo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/aibou_title\.sngw$
- (^|/).*$
--- Directory filter rules ---
- (^|/)cache/.*$
- (^|/)Cache/.*$
- (^|/)shader/.*$
- (^|/)Shader/.*$
- (^|/)log/.*$
- (^|/)Log/.*$
- (^|/)logs/.*$
- (^|/)Logs/.*$
- (^|/)temp/.*$
- (^|/)Temp/.*$
- (^|/)temporary/.*$
- (^|/)Temporary/.*$
+ ^\.steam/steam/steamapps/common/TGAAC/$
+ ^\.steam/steam/steamapps/common/$
+ ^\.steam/steam/steamapps/$
+ ^\.steam/steam/$
+ ^\.steam/$
+ ^\.steam/steam/steamapps/common/TGAAC/data/.*/$
+ ^\.steam/steam/steamapps/common/TGAAC/data/$
+ ^\.steam/steam/steamapps/common/TGAAC/data/.*$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/.*/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/.*/[^/]*_jpn\.[^/]*$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/$
- (^|/).*$
--- end filters ---

As for the folders, they don't exist in Dropbox (source), and is not empty locally (destination):

$ ls ~/.steam/steam/steamapps/common/TGAAC/Tool
InstallerMessage.exe  InstallerMessage.vdf

This might be a culprit.

As a result real folders include rules are (as seen with --dump filters:

+ ^\.steam/steam/steamapps/common/TGAAC/$
+ ^\.steam/steam/steamapps/common/$
+ ^\.steam/steam/steamapps/$
+ ^\.steam/steam/$
+ ^\.steam/$

which catches /.steam/steam/steamapps/common/TGAAC/Tool for example

I think what you need is:

+ /.steam/steam/steamapps/common/TGAAC/data/**/
or
+ /.steam/steam/steamapps/common/TGAAC/data/**/*

Sorry I was looking at the wrong path. Changing to + /.steam/steam/steamapps/common/TGAAC/data/**/ doesn't seem to help, here's the new log and new output:

--- start filters ---
--- File filter rules ---
- (^|/)[^/]*\.cache$
- (^|/)cache/.*$
- (^|/)Cache/.*$
- (^|/)[^/]*\.shader$
- (^|/)shader/.*$
- (^|/)Shader/.*$
- (^|/)[^/]*\.log$
- (^|/)log/.*$
- (^|/)Log/.*$
- (^|/)logs/.*$
- (^|/)Logs/.*$
- (^|/)[^/]*\.lock$
- (^|/)[^/]*\.lck$
- (^|/)STORE$
- (^|/)temp/.*$
- (^|/)Temp/.*$
- (^|/)temporary/.*$
- (^|/)Temporary/.*$
- (^|/)CacheStorageKey\.dat$
+ ^\.steam/steam/steamapps/common/TGAAC/TGAAC\.exe$
+ ^\.steam/steam/steamapps/common/TGAAC/data/.*/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/.*/[^/]*_jpn\.[^/]*$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/go_anime_1a_MUSIC\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/op_title\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/staffroll_part2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/09_tsuisou_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/10_asougi_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/12_naruhodo_igiari\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/13_naruhodo_igiari_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/14_tsuikyuu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/15_tsuikyuu_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/16_jingle\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/16_jingle_bb\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/17_hanyou_comical\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/18_hanyou_mysterious\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/19_hanyou_yuuga\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/20_holmes_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/21_susato_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/21_susato_theme_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/22_gina\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/23_souseki_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/24_watson_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/25_rivalkenji_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/30_kyuukei\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/31_kaitei\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/32_suspense\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/33_logic\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/34_jinmon_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/35_jinmon_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/36_shinjitsu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/37_syouso\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/38_taiketsu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/39_syounin_kanmon\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/40_baishin_battle\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/41_tsuisou_3\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/42_tsuisou_4\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/43_tsuisou_5\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/44_sousa_joban\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/45_sousa_kakushin\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/46_ryuuchijo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/47_jimusyo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/48_place_london\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/49_scotland_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/53_ending\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_shitagamen\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/aibou_title\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/asougi_arr\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/asougi_kaisou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/baskervilles\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/bgm_op_ep1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/ending_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/ending_2_bb\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/epilogue_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/epilogue_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/hikaesitsu_final\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/holmes_suiri\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/iris_tsuisou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kaitei_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kaitei_final\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kenjippoi\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoudousuiri_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoudousuiri_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoutou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/kyoutou_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_shita\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_ue\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_1_ue_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_2_ue\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_3_shita\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_3_ue\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/k_suiri_jingle\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/mamemomi_break\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/miterumon_last\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/opening\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/op_title_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/orgoal_ed\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_break\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_break_organ\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/petenshi_theme\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/place_rouningyou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/preussen\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/preussen_nico\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/record_german\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/science_demo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/shitsumu\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/shouso_final\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/sith_murderer\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/staffroll_1\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/susato_igiari\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/susato_igiari_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/suspense_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_aibou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_asougi_kenji\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_asougi_kenji_no_intro\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_dobinbo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_drebber\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_mamemomi\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_petenshi\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_professor\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_professor_last\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_rouzaiku\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/theme_of_sith\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuikyuu_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuikyu_yochou\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_6\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_bangieks\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_dobinbo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_jigoku\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_mitelmon\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/tsuisou_viridian\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/13_naruhodo_igiari_2\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/47_jimusyo\.sngw$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/aibou_title\.sngw$
- (^|/).*$
--- Directory filter rules ---
- (^|/)cache/.*$
- (^|/)Cache/.*$
- (^|/)shader/.*$
- (^|/)Shader/.*$
- (^|/)log/.*$
- (^|/)Log/.*$
- (^|/)logs/.*$
- (^|/)Logs/.*$
- (^|/)temp/.*$
- (^|/)Temp/.*$
- (^|/)temporary/.*$
- (^|/)Temporary/.*$
+ ^\.steam/steam/steamapps/common/TGAAC/$
+ ^\.steam/steam/steamapps/common/$
+ ^\.steam/steam/steamapps/$
+ ^\.steam/steam/$
+ ^\.steam/$
+ ^\.steam/steam/steamapps/common/TGAAC/data/.*/$
+ ^\.steam/steam/steamapps/common/TGAAC/data/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/.*/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/.*/[^/]*_jpn\.[^/]*$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/wav/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/anime/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/wav/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/bgm/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/wav/$
+ ^\.steam/steam/steamapps/common/TGAAC/nativeDX11x64/sound/stream/mp/$
- (^|/).*$
--- end filters ---

The number of files being removed remains the same (292), they are all in .steam/steam/steamapps/common/TGAAC/nativeDX11x64

I really do not like:) as I have to admit I struggle to grasp how exactly it works here. I will try to run few tests.

@asdffdsa, @Animosity022 - any chance you understand this situation here?

1 Like

Possibly related to this oddity?

Is .steam/steam/steamapps/common/TGAAC/nativeDX11x64/system/texture an empty directory?

If you add leading slashes to your filter rules, does that change this?

Thank you for looking into it. Help definitely is needed here.

Filtering rules are in the first post. It has leading slash

+ /.steam/steam/steamapps/common/TGAAC/data/**

And it was confirmed that directories are not empty.

This frankly all together behaves contrary to my filters understanding:)

One more thing. Could you run rclone ls instead? Does it include what you intended or also content of directories which are attempted to be deleted by sync?

./rclone ls backend:Apps/Steam --filter-from /tmp/test.filter --log-file /tmp/rclone.log --log-format none -vv 

here's the full output of the ls command, it doesn't include the folders rclone wants to delete (example .steam/steam/steamapps/common/TGAAC/nativeDX11x64/system/texture). And it is indeed not empty:

$ ls ~/.steam/steam/steamapps/common/TGAAC/nativeDX11x64/system/texture
compare_NUKI_NOMIP.tex  DefaultCube_CM.tex  detail_sysfont_AM_NOMIP.tex  sysfont_AM_NOMIP.tex

Shall I create an issue on GitHub?

Yes. But what would help is simplified reproducible case.

Sure I'll try to make a simpler case

1 Like

I think I see the issue (the test zip was helpful, thank you)

Because of the ** wildcard in + /TGAAC/nativeDX11x64/**/*_jpn.* rclone has to recurse all subdirectories of /TGAAC/nativeDX11x64, because they might have files that match *_jpn.*. Rclone can't know this without listing them. When it does not find any such files in system or texture, it therefore sees these directories as "empty" (because all contents were filtered out). Because rclone thinks these dirs are "empty", it tries to remove them.

For example, note the difference in rclone tree output between this:

+ /TGAAC/TGAAC.exe
+ /TGAAC/data/**
+ /TGAAC/nativeDX11x64/**/*_jpn.*
- **
/
└── TGAAC
    ├── TGAAC.exe
    ├── data
    │   ├── DINPUT8.dll
    │   └── dgs.ini
    └── nativeDX11x64
        ├── archive
        │   └── font_jpn.arc
        └── system
            └── texture

and this:

+ /TGAAC/TGAAC.exe
+ /TGAAC/data/**
+ /TGAAC/nativeDX11x64/archive/*_jpn.*
- **
/
└── TGAAC
    ├── TGAAC.exe
    ├── data
    │   ├── DINPUT8.dll
    │   └── dgs.ini
    └── nativeDX11x64
        └── archive
            └── font_jpn.arc

The difference is because, in the second example, rclone does not have to recurse into /TGAAC/nativeDX11x64/system to look for matching files.

Is this a bug? I would say yes, but others might disagree. I think more accurately it is a holdover from the days when rclone did not care about directories and thus filters were only concerned with finding files. (While there have always been directory filters, these were thought of as rules about where to look for matching files -- not rules about matching directories themselves.) Now that rclone does properly care about directories, I would say it is probably time to change this behavior, as the first exmple above is pretty counterintuitive. Just because we searched a directory in vain doesn't mean the directory (without its contents) should be deemed "included".

Note also that ls is not showing you the problem because it only shows objects, not directories. If you instead use rclone lsf -R or rclone tree you should see it.

2 Likes

Thanks a lot for the analyze! I'm wondering if this bisync trying to delete unrelated files is caused by the same reason, since I read somewhere that bisync has switched from copy to sync at some point. These files should not be traversed at they are not mentioned in the filter at all?

$ rclone bisync $PWD backend:Test --log-file test.log --log-format none --dry-run --conflict-resolve path1 --conflict-loser delete -vv
$ rclone bisync $PWD backend:Test --filter-from test.filter --log-file test.log --log-format none --dry-run --conflict-resolve path1 --conflict-loser delete -vv
DEBUG : rclone: Version "v1.69.1" starting with parameters ["/home/steam/homebrew/plugins/decky-cloud-save/bin/rclone" "--config" "/var/home/steam/homebrew/settings/decky-cloud-save/rclone.conf" "bisync" "/home/steam/Projects/test/testgh" "backend:Test" "--filter-from" "test.filter" "--log-file" "test.log" "--log-format" "none" "--dry-run" "--conflict-resolve" "path1" "--conflict-loser" "delete" "-vv"]
DEBUG : Creating backend with remote "/home/steam/Projects/test/testgh"
DEBUG : Using config file from "/var/home/steam/homebrew/settings/decky-cloud-save/rclone.conf"
DEBUG : Creating backend with remote "backend:Test"
NOTICE: bisync is IN BETA. Don't use in production!
INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
INFO  : Synching Path1 "/home/steam/Projects/test/testgh/" with Path2 "backend:Test/"
DEBUG : : updated backup-dir for Path1
DEBUG : : updated backup-dir for Path2
INFO  : Building Path1 and Path2 listings
DEBUG : &{0xc0009a4000 0xc0005ac280 false false false /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test /home/steam/.cache/rclone/bisync /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path1.lst-dry /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path2.lst-dry /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path1.lst-dry-new /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path2.lst-dry-new map[] 0xc0004bb0e0 {{}} {{}} false false <nil> <nil>   map[] false}: starting to march!
DEBUG : test1: Excluded
DEBUG : test1: Excluded
DEBUG : TGAAC: both path1 and path2
DEBUG : TGAAC: is Dir
DEBUG : TGAAC/data: both path1 and path2
DEBUG : TGAAC/data: is Dir
DEBUG : TGAAC/nativeDX11x64: both path1 and path2
DEBUG : TGAAC/nativeDX11x64: is Dir
DEBUG : TGAAC/TGAAC.exe: both path1 and path2
DEBUG : TGAAC/TGAAC.exe: is Object
DEBUG : TGAAC/nativeDX11x64/system: path1 only
DEBUG : TGAAC/nativeDX11x64/system: is Dir
DEBUG : TGAAC/nativeDX11x64/archive: both path1 and path2
DEBUG : TGAAC/nativeDX11x64/archive: is Dir
DEBUG : TGAAC/nativeDX11x64/system/texture: path1 only
DEBUG : TGAAC/nativeDX11x64/system/texture: is Dir
DEBUG : TGAAC/data/dgs.ini: both path1 and path2
DEBUG : TGAAC/data/dgs.ini: is Object
DEBUG : TGAAC/data/DINPUT8.dll: both path1 and path2
DEBUG : TGAAC/data/DINPUT8.dll: is Object
DEBUG : TGAAC/nativeDX11x64/archive/font_jpn.arc: both path1 and path2
DEBUG : TGAAC/nativeDX11x64/archive/font_jpn.arc: is Object
DEBUG : &{0xc0009a4000 0xc0005ac280 false false false /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test /home/steam/.cache/rclone/bisync /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path1.lst-dry /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path2.lst-dry /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path1.lst-dry-new /home/steam/.cache/rclone/bisync/home_steam_Projects_test_testgh..backend_Test.path2.lst-dry-new map[] 0xc0004bb0e0 {{}} {{}} false false <nil> <nil>   map[] false}: march completed. err: <nil>
INFO  : Path1 checking for diffs
DEBUG : 2025-02-19 13:31:29.653001568 +0000 UTC: modification time the same (differ by 0s, within tolerance 1ns)
DEBUG : 2025-02-19 13:31:29.653001568 +0000 UTC: modification time the same (differ by 0s, within tolerance 1ns)
DEBUG : 2025-02-19 13:31:29.653001568 +0000 UTC: modification time the same (differ by 0s, within tolerance 1ns)
NOTICE: - Path1             File was deleted                            - TGAAC/nativeDX11x64/archive/font_eng.arc
DEBUG : 2025-02-19 13:31:29.52200133 +0000 UTC: modification time the same (differ by 0s, within tolerance 1ns)
NOTICE: - Path1             File was deleted                            - TGAAC/nativeDX11x64/archive/logo.arc
NOTICE: - Path1             File was deleted                            - TGAAC/nativeDX11x64/system/texture/compare_NUKI_NOMIP.tex
NOTICE: - Path1             File was deleted                            - filter.dump
NOTICE: - Path1             File was deleted                            - ls.output
NOTICE: - Path1             File was deleted                            - test.filter
NOTICE: - Path1             File was deleted                            - test.log
NOTICE: - Path1             File was deleted                            - test.output
NOTICE: - Path1             File was deleted                            - test.zip
NOTICE: - Path1             File was deleted                            - test1/ls.log
NOTICE: - Path1             File was deleted                            - test1/test.filter
NOTICE: - Path1             File was deleted                            - test1/test.log
NOTICE: - Path1             File was deleted                            - test1/test.output
INFO  : Path1:   13 changes:    0 new,    0 modified,   13 deleted
INFO  : Path2 checking for diffs
DEBUG : 2025-02-19 13:31:30 +0000 UTC: modification time the same (differ by 0s, within tolerance 1s)
DEBUG : 2025-02-19 13:31:30 +0000 UTC: modification time the same (differ by 0s, within tolerance 1s)
DEBUG : 2025-02-19 13:31:30 +0000 UTC: modification time the same (differ by 0s, within tolerance 1s)
DEBUG : 2025-02-19 13:31:30 +0000 UTC: modification time the same (differ by 0s, within tolerance 1s)
NOTICE: - Path2             File was deleted                            - test1/ls.log
NOTICE: - Path2             File was deleted                            - test1/test.filter
NOTICE: - Path2             File was deleted                            - test1/test.log
NOTICE: - Path2             File was deleted                            - test1/test.output
INFO  : Path2:    4 changes:    0 new,    0 modified,    4 deleted
ERROR : Safety abort: too many deletes (>50%, 13 of 17) on Path1 "/home/steam/Projects/test/testgh/". Run with --force if desired.
NOTICE: Bisync aborted. Please try again.
NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Checks:                 8 / 8, 100%
Elapsed time:         0.4s

DEBUG : 7 go routines active
INFO  : Dropbox root 'Test': Committing uploads - please wait...
NOTICE: Failed to bisync: too many deletes
$ rclone tree backend:Test
/
├── TGAAC
│   ├── TGAAC.exe
│   ├── data
│   │   ├── DINPUT8.dll
│   │   └── dgs.ini
│   └── nativeDX11x64
│       └── archive
│           └── font_jpn.arc
└── test1
    ├── ls.log
    ├── test.filter
    ├── test.log
    └── test.output

5 directories, 8 files
$ tree
.
├── bisync.zip
├── test1
│   ├── ls.log
│   ├── test.filter
│   ├── test.log
│   └── test.output
├── test.filter
├── test.log
└── TGAAC
    ├── data
    │   ├── dgs.ini
    │   └── DINPUT8.dll
    ├── nativeDX11x64
    │   ├── archive
    │   │   ├── font_eng.arc
    │   │   ├── font_jpn.arc
    │   │   └── logo.arc
    │   └── system
    │       └── texture
    │           └── compare_NUKI_NOMIP.tex
    └── TGAAC.exe

8 directories, 14 files
+ /TGAAC/TGAAC.exe
+ /TGAAC/data/**
+ /TGAAC/nativeDX11x64/**/*_jpn.*
- **