Copy/sync Multiple Directories from same drive with 1 rclone command. Filters not applying

if the path has a space in it, you need to quote it.

its already in quotes.

instead of "/Program Files (x86)"**
try "/Program Files (x86)**"

alright, and well that still didn't work for it. still only doing the non quote'd lines.

try '/Program Files (x86)**'
or use
/PROGRA~2

so itd be /PROGRA~2 for program files and /PROGRA~1 for program files x86?

could it be because of: Can't follow symlink without -L/--copy-links

please try '/Program Files (x86)/**'

I can try that. but did not seem to change it at all.

i re looked in the log file and its showing them as excluded:

2020/09/17 18:43:53 DEBUG : Program Files: Excluded
2020/09/17 18:43:53 DEBUG : Program Files (x86): Excluded

but then when i go back to my mounted drive and it shows that i can move files as long as the main directory doesnt have any spaces in it: given it copied: c:/games but then it successfully coppied this directory: Z:\test\Games\SquareEnix\FINAL FANTASY XIV - Tools let me go see if i can find that / though.

good, your filter was missing a / before **

what mounted drive?

still had the

'/Program Files/Rockstar Games/**'
'/Program Files (x86)/Black Desert Online/**'
/Games** 

but refuses to copy it still.

i mounted my media drive (its encrypted.) so i can check to see what gets copied from a short non dry run.

can you specific?

i could be wrong but i think it should be /Games/**

could be but it shows that it transferred the test properly. only problem is the ones with spaces. im looked at the code block on what i just posted and it shows red.

yea these still dont copy no mater if it has a "-" or '-'

/Program Files/ 
/Program Files (x86)/

but now they show up as green. in the text block so let me try something real quick.

omg. so apparently it doesn't need quotes. i have no idea how it can read a proper directory from that. when it doesnt read it properly from the main rclone bat file.

2020/09/17 18:52:35 DEBUG : rclone: Version "v1.52.2-207-g1fdcc195-vfs-beta" starting with parameters ["rclone" "copy" "c:\\" "Media:\\test" "--include-from" "X:\\.rclone\\Directories\\C-Drive.txt" "-L" "-P" "--ignore-case" "--log-file" "X:\\.rclone\\backup\\log.txt" "--cache-tmp-wait-time" "7s" "--drive-chunk-size" "64m" "--buffer-size" "512m" "--dry-run" "-vv"]
2020/09/17 18:52:35 DEBUG : Using config file from "C:\\Users\\UwU\\.config\\rclone\\rclone.conf"
2020/09/17 18:52:35 DEBUG : fs cache: renaming cache item "c:\\" to be canonical "//?/c:/"
2020/09/17 18:52:37 DEBUG : fs cache: renaming cache item "Media:\\test" to be canonical "Media:/test"
2020/09/17 18:52:37 DEBUG : $Recycle.Bin: Excluded
2020/09/17 18:52:37 DEBUG : $WinREAgent: Excluded
2020/09/17 18:52:37 DEBUG : .Move To Desktop: Excluded
2020/09/17 18:52:37 DEBUG : Config.Msi: Excluded
2020/09/17 18:52:37 DEBUG : Documents and Settings: Excluded
2020/09/17 18:52:37 DEBUG : DumpStack.log.tmp: Excluded
2020/09/17 18:52:37 DEBUG : ffmpeg-4.2.1-win64-static: Excluded
2020/09/17 18:52:37 DEBUG : hiberfil.sys: Excluded
2020/09/17 18:52:37 DEBUG : KeyLock: Excluded
2020/09/17 18:52:37 DEBUG : nvflash_5.620.0: Excluded
2020/09/17 18:52:37 DEBUG : pagefile.sys: Excluded
2020/09/17 18:52:37 DEBUG : PerfLogs: Excluded
2020/09/17 18:52:37 DEBUG : ProgramData: Excluded
2020/09/17 18:52:37 DEBUG : RealBench_v2.43: Excluded
2020/09/17 18:52:37 DEBUG : Recovery: Excluded
2020/09/17 18:52:37 DEBUG : swapfile.sys: Excluded
2020/09/17 18:52:37 DEBUG : System Volume Information: Excluded
2020/09/17 18:52:37 DEBUG : Users: Excluded
2020/09/17 18:52:37 DEBUG : Windows: Excluded
2020/09/17 18:52:37 DEBUG : $Recycle.Bin: Excluded
2020/09/17 18:52:37 DEBUG : RealBench_v2.43: Excluded
2020/09/17 18:52:37 DEBUG : ffmpeg-4.2.1-win64-static: Excluded
2020/09/17 18:52:37 DEBUG : .Move To Desktop: Excluded
2020/09/17 18:52:37 DEBUG : desktop.ini: Excluded
2020/09/17 18:52:37 DEBUG : Billie Eilish, Khalid Lovely (8D AUDIO).mp3: Excluded
2020/09/17 18:52:37 DEBUG : nightcore_girl_named_stacy_fabian_secon_lyrics_320kbps.mp3: Excluded
2020/09/17 18:52:37 DEBUG : IMG_1592573586253092.jpg: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Adobe: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/7-Zip: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/AIMP3: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Adobe: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Audacity: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Attribute Changer: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Bdrive: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/AutoHotkey: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/BleachBit: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Blender Foundation: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Common Files: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Common Files: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Corsair: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/CrystalDiskMark7: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Cursor Lock: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/desktop.ini: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/desktop.ini: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/DIFX: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Google: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/FileZilla Pro: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Gyazo: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Google: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/InstallShield Installation Information: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/GShade: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Internet Explorer: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Internet Explorer: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Java: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Java: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/KeyLock: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Microsoft Silverlight: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Microsoft Silverlight: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/ModifiableWindowsApps: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Microsoft.NET: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/MSBuild: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/MSBuild: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/NordVPN: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/MSI Afterburner: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/NordVPN network TUN: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/NordVPN network TAP: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/NVIDIA Corporation: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Notepad++: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/OpenBoxLab: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/NVIDIA Corporation: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Oracle: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Reference Assemblies: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Prio: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Rockstar Games: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/qBittorrent: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Steam: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/QuickCPU: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Ubisoft: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Realtek: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Unigine: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Reference Assemblies: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows Defender: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Samsung: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows Mail: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/ShareX: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows Media Player: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Uninstall Information: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows Multimedia Platform: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/VideoLAN: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows NT: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Defender: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows Photo Viewer: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows Portable Devices: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Defender Advanced Threat Protection: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/Windows Sidebar: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Mail: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/WindowsPowerShell: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Media Player: Excluded
2020/09/17 18:52:37 DEBUG : Program Files (x86)/WinFsp: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Multimedia Platform: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows NT: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Photo Viewer: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Portable Devices: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Security: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/Windows Sidebar: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/WindowsApps: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/WindowsPowerShell: Excluded
2020/09/17 18:52:37 DEBUG : Program Files/WinMerge: Excluded
2020/09/17 18:52:37 NOTICE: Program Files (x86)/Black Desert Online/Black Desert Online Launcher.exe: Skipped copy as --dry-run is set
2020/09/17 18:52:37 NOTICE: Program Files (x86)/Black Desert Online/BlackDesert.ico: Skipped copy as --dry-run is set
2020/09/17 18:52:37 NOTICE: Program Files (x86)/Black Desert Online/Resource.ini: Skipped copy as --dry-run is set

as for the mount question im using what you suggested a while ago with nssm: so it auto mounts when i start windows. https://forum.rclone.org/t/rclone-mount-as-nssm-service-and-permissions/16200

nope, I had the issue with the include-from text file erroring out or throwing in a 360k line log file that would crash. I guess i should of been clearer, my mistake.

yea it helped me, only question I did have on that is i tried using winfsp launcher but nothing came up in the registry to make the service threw there so i had to use nssm for it. but its not that bad as i saved the registry keys to reapply them when I reinstall windows.

now for the continuance of this: i have 4 disks that need to be synced to google drive one needs to be moved.

C-Drive.txt
D-Drive.txt
E-Drive.txt
X-Drive.txt (media) 
X-Drive-Videos.txt (only one that moves videos to media drive.) 

so for that would I just make 4 separate scripts and have them autorun one after each other? threw task scheduler or could i schedule one and have it auto call the next one.

cant make new replys.

oh okay! I thought it was limited to one line/command only. i sent you a message so the edit doesn't take up a full page of "new replies"

i guess for for the videos one it would be:

rclone move X:\Videos\TV\Shows\.Library-Temp Media:\Videos\TV --include-from "X:\.rclone\Directories\X-Drive-Videos.txt" -L -P --ignore-case --log-file "X:\.rclone\backup\x-Videos-log.txt" --cache-tmp-wait-time 7s --drive-chunk-size 64m --buffer-size 512m -v

yes, when using a --include-from, there is no neeed for quotes.

i thought you were having an issue with the command line.

good to know that post helped you.

you can use just one script.

rclone copy c:\ ...
rclone copy d:\ ...
rclone copy e:\ ...

yup! works like a charm. Added in a few breaks and got around the exclude as i just didn't want to copy desktop.ini & *.log files so i made a batch file to hunt for them on all drives and delete the ones (excluding system 32 and major folders.) to run before the backup script to give it time i added in a 2 breaks before it would start the backup process threw rclone.

@echo off
if _%1_==_payload_  goto :payload

:getadmin
    echo %~nx0: elevating self
    set vbs=%temp%\getadmin.vbs
    echo Set UAC = CreateObject^("Shell.Application"^)                >> "%vbs%"
    echo UAC.ShellExecute "%~s0", "payload %~sdp0 %*", "", "runas", 1 >> "%vbs%"
    "%temp%\getadmin.vbs"
    del "%temp%\getadmin.vbs"
goto :eof

:payload

:==========================================================================CODE==========================================================================:   
Pushd "C:\Users\UwU\.rclone"
ECHO Cleaning Drives Please Wait... 
Start "" "C:\Users\UwU\.rclone\Scripts\Clean Drives\desktop_ini.exe" -i silent
Start "" "C:\Users\UwU\.rclone\Scripts\Clean Drives\log.exe" -i silent
TIMEOUT /T 35 /NOBREAK
test&cls
ECHO Cleaning Drives Successful... Calling Backup Scripts...
TIMEOUT /T 5 /NOBREAK
test&cls
Pushd "C:\Users\UwU\.rclone"
test&cls
ECHO Syncing C Drive...
rclone sync c:\ Backup:\Windows-10\C --include-from "C:\Users\UwU\.rclone\Directories\C-Drive.txt" -L -P -q  --copy-links --ignore-case-sync --log-file "C:\Users\UwU\.rclone\Log Files\C-Drive-Backup_Log.txt" --cache-tmp-wait-time 7s --drive-chunk-size 128m --buffer-size 256m
ECHO Syncing Done...
TIMEOUT /T 5 /NOBREAK
ECHO Syncing C Drive to local Storage...
rclone copy c:\ "E:\Backup\C Drive" --include-from "C:\Users\UwU\.rclone\Directories\C-Drive.txt" -L -P -q --copy-links --ignore-case-sync --log-file "C:\Users\UwU\.rclone\Log Files\C-Drive-Backup_Log.txt" --cache-tmp-wait-time 7s --drive-chunk-size 128m --buffer-size 256m
ECHO Syncing Done...
TIMEOUT /T 15
test&cls
ECHO Syncing x Drive...
rclone copy x:\ Media: --include-from "C:\Users\UwU\.rclone\Directories\x-Drive.txt" -L -P -q --copy-links --ignore-case --log-file "C:\Users\UwU\.rclone\Log Files\x-Drive-Backup_Log.txt" --cache-tmp-wait-time 7s --drive-chunk-size 128m --buffer-size 256m --dry-run
ECHO Syncing Done...
TIMEOUT /T 15
test&cls
ECHO Moving Media to Media Drive...
rclone move x:\ Media: --include-from "C:\Users\UwU\.rclone\Directories\x-Drive_Media.txt" -L -P -q --copy-links --ignore-case --log-file "C:\Users\UwU\.rclone\Log Files\x-Drive-Media_Log.txt" --cache-tmp-wait-time 5s --drive-chunk-size 64m --buffer-size 128m
ECHO Moving DONE...
TIMEOUT /T 15
test&cls
ECHO Syncing E Drive...
rclone sync e:\ GDrive:\Software --include-from "C:\Users\UwU\.rclone\Directories\e-Drive.txt" -L -P -q --copy-links --ignore-case-sync --log-file "C:\Users\UwU\.rclone\Log Files\E-Drive-Backup_Log.txt" --cache-tmp-wait-time 5s --cache-tmp-wait-time 7s --drive-chunk-size 128m --buffer-size 256m --dry-run
test&cls
ECHO Syncing DONE, Check Logs...
ECHO Exiting Script...
TIMEOUT /T 15 /NOBREAK
pause
exit

I know the # shouldnt be there but i'm keeping it there while i organize files in that directory, did a dry run of it all and it seemed fine.
just wanted to give an update and a thanks for helping me with it! :smiley: