What is the problem you are having with rclone?
I am having problems getting my filtering correct.
I am using Rclone from my Synology NAS (synology_apollolake_918+) with pictures and media and want to make a clone to Pcloud.
I have configured the script and this part is working!
However I want to split the folder "pictures and media" from the NAS to al folder "Pictures" and a folder "Media"
For this I used a --filter-from in a text file, accessible / readable from the Rclone running on the NAS. However, the filters don't seem to work.
This is the content of the filter (first characters are - or + but the :
ash-4.3# cat /volume1/tools/Backup/rclone-JPG.txt
- @eaDir/**
- #recycle/**
+ (?i) *.jpg
+ (?i) *.bmp
+ (?i) *.psd
+ (?i) *.pdf
+ (?i) *.jpeg
+ (?i) *.gif
+ (?i) *.png
+ (?i) *.heic
My simple thought is to exclude the @eaDir (tumbnails) and #recycle (trash).
I want to include all the picture sort of files and nothing else and added the (?i) to make it case insensitive (jpg and JPG and Jpg all included).
If I run the script however I see that other files are picked up as well (.Mov)
ash-4.3# rclone sync /volume1/photo/Iphone/Joost remote:/Rclone_Photo/JPG/ --progress --checksum --filter-from /volume1/tools/Backup/rclone-JPG.txt --log-file=/volume1/tools/Backup/syncJPG_log.txt --log-level=DEBUG
Transferred: 31.226 MiB / 1.198 GiB, 3%, 3.657 MiB/s, ETA 5m26s
Transferred: 15 / 191, 8%
Elapsed time: 8.5s
Transferring:
* IMG_7715.MOV: 22% /42.799Mi, 1.152Mi/s, 28s
* IMG_8484.MOV: 13% /24.988Mi, 1.748Mi/s, 12s
* IMG_8485.MOV: 6% /34.256Mi, 0/s, -
I even tried to add an extra line to the clone-JPG.txt (last line) with "- *" to state explicit that if the picture lines are not met nothing else should be transfered.
However if I add this, nothing gets transferred anymore.
If this folder workings, I want to use it on a bigger scale with all my pictures over the years taken. And another script with contents like + *.avi + *.mov + *.mp4 etc for the "movie" folder. But expect if I have the above working, everything will be working
Run the command 'rclone version' and share the full output of the command.
rclone version
rclone v1.69.1
- os/version: unknown
- os/kernel: 4.4.59+ (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.0
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Pcloud
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone sync /volume1/photo/Iphone/Joost remote:/Rclone_Photo/JPG/ --progress --checksum --filter-from /volume1/tools/Backup/rclone-JPG.txt --log-file=/volume1/tools/Backup/syncJPG_log.txt --log-level=DEBUG
debug log content:
2025/03/08 14:25:19 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "sync" "/volume1/photo/Iphone/Joost" "remote:/Rclone_Photo/JPG/" "--progress" "--checksum" "--filter-from" "/volume1/tools/Backup/rclone-JPG.txt" "--log-file=/volume1/tools/Backup/syncJPG_log.txt" "--log-level=DEBUG"]
2025/03/08 14:25:19 DEBUG : Creating backend with remote "/volume1/photo/Iphone/Joost"
2025/03/08 14:25:19 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2025/03/08 14:25:19 DEBUG : Creating backend with remote "remote:/Rclone_Photo/JPG/"
2025/03/08 14:25:19 DEBUG : fs cache: renaming cache item "remote:/Rclone_Photo/JPG/" to be canonical "remote:Rclone_Photo/JPG"
2025/03/08 14:25:19 DEBUG : @eaDir: Excluded
2025/03/08 14:25:19 DEBUG : .DS_Store: Excluded (Path Filter)
2025/03/08 14:25:19 DEBUG : .DS_Store: Excluded
2025/03/08 14:25:19 DEBUG : pcloud root 'Rclone_Photo/JPG': Waiting for checks to finish
2025/03/08 14:25:19 DEBUG : pcloud root 'Rclone_Photo/JPG': Waiting for transfers to finish
2025/03/08 14:25:19 DEBUG : Waiting for deletions to finish
2025/03/08 14:25:19 INFO : There was nothing to transfer
2025/03/08 14:25:19 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Elapsed time: 0.0s
2025/03/08 14:25:19 DEBUG : 5 go routines active
2025/03/08 14:25:50 DEBUG : rclone: Version "v1.69.1" starting with parameters ["rclone" "sync" "/volume1/photo/Iphone/Joost" "remote:/Rclone_Photo/JPG/" "--progress" "--checksum" "--filter-from" "/volume1/tools/Backup/rclone-JPG.txt" "--log-file=/volume1/tools/Backup/syncJPG_log.txt" "--log-level=DEBUG"]
2025/03/08 14:25:50 DEBUG : Creating backend with remote "/volume1/photo/Iphone/Joost"
2025/03/08 14:25:50 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2025/03/08 14:25:50 DEBUG : Creating backend with remote "remote:/Rclone_Photo/JPG/"
2025/03/08 14:25:51 DEBUG : fs cache: renaming cache item "remote:/Rclone_Photo/JPG/" to be canonical "remote:Rclone_Photo/JPG"
2025/03/08 14:25:51 DEBUG : @eaDir: Excluded
2025/03/08 14:25:51 DEBUG : IMG_6341.JPG: Need to transfer - File not found at Destination
2025/03/08 14:25:51 DEBUG : IMG_6342.JPG: Need to transfer - File not found at Destination
2025/03/08 14:25:51 DEBUG : IMG_7715.MOV: Need to transfer - File not found at Destination
2025/03/08 14:25:51 DEBUG : Thumbs.db: Need to transfer - File not found at Destination
2025/03/08 14:25:51 DEBUG : pcloud root 'Rclone_Photo/JPG': Waiting for checks to finish
2025/03/08 14:25:51 DEBUG : pcloud root 'Rclone_Photo/JPG': Waiting for transfers to finish
2025/03/08 14:25:51 DEBUG : IMG_6341.JPG: sha1 = bc0edc777a0def8f905fff3cd977eeb7b9a601c5 OK
2025/03/08 14:25:51 DEBUG : IMG_6342.JPG: sha1 = 28a1662053ad1d7256841d898403835e97ae821f OK
2025/03/08 14:25:51 DEBUG : IMG_6341.JPG.244fe84b.partial: renamed to: IMG_6341.JPG
2025/03/08 14:25:51 INFO : IMG_6341.JPG: Copied (new)
2025/03/08 14:25:51 DEBUG : IMG_6342.JPG.dcdf3beb.partial: renamed to: IMG_6342.JPG
2025/03/08 14:25:51 INFO : IMG_6342.JPG: Copied (new)
2025/03/08 14:25:52 DEBUG : IMG_8074.JPG: sha1 = 081ca09cb70b36cbe7a65cdabc4315a352736fe6 OK
2025/03/08 14:25:52 DEBUG : IMG_8074.JPG.8281d013.partial: renamed to: IMG_8074.JPG
2025/03/08 14:25:52 INFO : IMG_8074.JPG: Copied (new)
2025/03/08 14:25:52 DEBUG : IMG_8006.mp4: sha1 = f20979238807d8c382b4f57e493727b0ad059004 OK
2025/03/08 14:25:52 DEBUG : IMG_8006.mp4.ef300c41.partial: renamed to: IMG_8006.mp4
2025/03/08 14:25:52 INFO : IMG_8006.mp4: Copied (new)
2025/03/08 14:25:52 DEBUG : IMG_8075.JPG: sha1 = 27e364f7c35c56ae3c99da7a05f5df94c84d3c59 OK
2025/03/08 14:25:53 DEBUG : IMG_8075.JPG.555c6698.partial: renamed to: IMG_8075.JPG
2025/03/08 14:25:53 INFO : IMG_8075.JPG: Copied (new)
2025/03/08 14:25:54 DEBUG : IMG_8261.JPG: sha1 = f6cb4d2e70288c2bd15f6db8e9c2c647ab889f7f OK
2025/03/08 14:25:54 DEBUG : IMG_8262.JPG: sha1 = 385973d2a8d97a29a71cd2162096d3cc71b98a62 OK
2025/03/08 14:25:55 DEBUG : IMG_8261.JPG.c7434adf.partial: renamed to: IMG_8261.JPG
2025/03/08 14:25:55 INFO : IMG_8261.JPG: Copied (new)
2025/03/08 14:25:55 DEBUG : IMG_8262.JPG.706e7e46.partial: renamed to: IMG_8262.JPG
2025/03/08 14:25:55 INFO : IMG_8262.JPG: Copied (new)
2025/03/08 14:25:55 DEBUG : IMG_8314.JPG: sha1 = c7678c838ad99bf78412353c9d1fd2075cd3b06a OK
2025/03/08 14:25:55 DEBUG : IMG_8314.JPG.355b7cea.partial: renamed to: IMG_8314.JPG
2025/03/08 14:25:55 INFO : IMG_8314.JPG: Copied (new)
2025/03/08 14:25:55 DEBUG : IMG_8375.JPG: sha1 = d2e813192e8682c8a5c849d90efe32352a12fc4b OK
2025/03/08 14:25:55 DEBUG : IMG_8382.JPG: sha1 = a8cf805b544433cd89ac8528854b75eea6ebd8e3 OK
2025/03/08 14:25:55 DEBUG : IMG_8375.JPG.39e8702b.partial: renamed to: IMG_8375.JPG
2025/03/08 14:25:55 INFO : IMG_8375.JPG: Copied (new)
2025/03/08 14:25:55 DEBUG : IMG_8382.JPG.4cfa3efa.partial: renamed to: IMG_8382.JPG
2025/03/08 14:25:55 INFO : IMG_8382.JPG: Copied (new)
2025/03/08 14:25:56 DEBUG : IMG_8390.JPG: sha1 = 9eee0f5e3583870589609f8eb186d807156d7d78 OK
2025/03/08 14:25:56 DEBUG : IMG_8390.JPG.74007ea.partial: renamed to: IMG_8390.JPG
2025/03/08 14:25:56 INFO : IMG_8390.JPG: Copied (new)
2025/03/08 14:25:57 DEBUG : IMG_8403.JPG: sha1 = 6f5d7cefd12f50fa2f6839d2765989db42175ee9 OK
2025/03/08 14:25:57 DEBUG : IMG_8403.JPG.d08d0c09.partial: renamed to: IMG_8403.JPG
2025/03/08 14:25:57 INFO : IMG_8403.JPG: Copied (new)
2025/03/08 14:25:57 DEBUG : IMG_8479.JPG: sha1 = 144c4422ebd94622de20c4bca45b9ca37c03a63f OK
2025/03/08 14:25:57 DEBUG : IMG_8479.JPG.420ec59e.partial: renamed to: IMG_8479.JPG
2025/03/08 14:25:57 INFO : IMG_8479.JPG: Copied (new)
2025/03/08 14:25:58 DEBUG : IMG_8466.JPG: sha1 = a992c089f7c64a3d729536056db2b0e8ee636f2c OK
2025/03/08 14:25:58 DEBUG : IMG_8466.JPG.141f35e2.partial: renamed to: IMG_8466.JPG
2025/03/08 14:25:58 INFO : IMG_8466.JPG: Copied (new)
2025/03/08 14:25:59 DEBUG : IMG_8481.JPG: sha1 = c287e5c29f9d0b37cb22dbae2e650d981300a59d OK
2025/03/08 14:25:59 DEBUG : IMG_8481.JPG.353ba0e7.partial: renamed to: IMG_8481.JPG
2025/03/08 14:25:59 INFO : IMG_8481.JPG: Copied (new)
2025/03/08 14:25:59 INFO : Signal received: interrupt
2025/03/08 14:26:00 DEBUG : IMG_8488.JPG: sha1 = c711e5c795e61ee0584b414d423b4d145e313fea OK
2025/03/08 14:26:00 INFO : Exiting...