--files-from not including folder in list

Help and Support
1

What is the problem you are having with rclone?

I want to transfer a list of files with rclone and the folder is being excluded even though the folder is in the list of the filenames

Run the command 'rclone version' and share the full output of the command.

rclone v1.69.1

  • os/version: Microsoft Windows Server 2019 Standard 1809 (64 bit)
  • os/kernel: 10.0.17763.7009 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.24.0
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Amazon S3

The command you were trying to run (eg rclone copy /tmp remote:tmp)

.\rclone.exe copy --files-from "C:\Users\sirixadmin\Downloads\filename-part2.csv" E: Amazon:agi-dl-ingest-p218019611/full/rsync -vv --s3-no-check-bucket

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[Amazon]
type = s3
provider = AWS
access_key_id = XXX
secret_access_key = XXX
region = us-east-1
acl =
storage_class =

A log from the command that you were trying to run with the -vv flag

2025/04/10 16:11:36 DEBUG : rclone: Version "v1.69.1" starting with parameters ["C:\\Users\\sirixadmin\\Downloads\\rclone-v1.69.1-windows-amd64\\rclone.exe" "copy" "--files-from" "C:\\Users\\sirixadmin\\Downloads\\filename-par
t2.csv" "E:" "Amazon:agi-dl-ingest-p218019611/full/rsync" "-vv" "--s3-no-check-bucket"]
2025/04/10 16:11:36 DEBUG : Creating backend with remote "E:"
2025/04/10 16:11:36 DEBUG : Using config file from "C:\\Users\\sirixadmin\\AppData\\Roaming\\rclone\\rclone.conf"
2025/04/10 16:11:36 DEBUG : fs cache: renaming cache item "E:" to be canonical "//?/E:/"
2025/04/10 16:11:36 DEBUG : Creating backend with remote "Amazon:agi-dl-ingest-p218019611/full/rsync"
2025/04/10 16:11:36 DEBUG : Amazon: detected overridden config - adding "{Dn7qA}" suffix to name
2025/04/10 16:11:36 DEBUG : fs cache: renaming cache item "Amazon:agi-dl-ingest-p218019611/full/rsync" to be canonical "Amazon{Dn7qA}:agi-dl-ingest-p218019611/full/rsync"
2025/04/10 16:11:36 DEBUG : $RECYCLE.BIN: Excluded
**2025/04/10 16:11:36 DEBUG : Filestore: Excluded**
2025/04/10 16:11:36 DEBUG : System Volume Information: Excluded
2025/04/10 16:11:36 DEBUG : S3 bucket agi-dl-ingest-p218019611 path full/rsync: Waiting for checks to finish
2025/04/10 16:11:36 DEBUG : S3 bucket agi-dl-ingest-p218019611 path full/rsync: Waiting for transfers to finish
2025/04/10 16:11:36 INFO  : There was nothing to transfer
2025/04/10 16:11:36 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:         0.0s

2025/04/10 16:11:36 DEBUG : 3 go routines active

Here is an example of what's in the files-from file:

\Filestore\G1034\E2973760\R29309725\29309725.18410.20240111.01024165.POST.mp4
\Filestore\G1034\E2973760\R29309742\29309742.18410.20240111.01030099.POST.mp4
\Filestore\G1034\E2973760\R29309743\29309743.18643.20240111.01030170.POST.mp4
\Filestore\G1034\E2973760\R29309762\29309762.18643.20240111.01033553.mp4
\Filestore\G1034\E3113370\R31238186\31238186..20240216.01005807.P.mp4
\Filestore\G1034\E3113370\R31238186\31238186.18408.20240216.01005814.POST.mp4
\Filestore\G1034\E3113370\R31238189\31238189.18408.20240216.01010615.mp4
\Filestore\G1034\E3113375\R31238217\31238217..20240216.01013961.P.mp4

Here is the list of files in the source directory:

    Directory: E:\


Mode                LastWriteTime         Length Name
----                -------------         ------ ----
d-----        4/10/2025   4:14 PM                Filestore
2

Try

Filestore/G1034/E2973760/R29309725/29309725.18410.20240111.01024165.POST.mp4

instead.

3

Still no luck. Tried changing the backslashes to slashes, add and remove the slash from the first character of every lines. No luck :frowning:

4

welcome to the forum,

that should be "E:\"
not saying this is the source of your issue, but can lead to major unintended consequences.
has happened in the forum and i pointed each time i see that mistake.

filters work only on the source, a good, safe test is rclone ls, not rclone sync

make sure the full path is valid, what is the output of
rclone ls e:\Filestore\G1034\E2973760\R29309725\29309725.18410.20240111.01024165.POST.mp4 -vv

5

Here is the output:

PS E:\rclone-v1.69.1-windows-amd64> .\rclone.exe ls E:\Filestore\G1034\E2973760\R29309725\29309725.18410.20240111.01024165.POST.mp4 -vv
2025/04/10 17:27:56 DEBUG : rclone: Version "v1.69.1" starting with parameters ["E:\\rclone-v1.69.1-windows-amd64\\rclone.exe" "ls" "E:\\Filestore\\G1034\\E2973760\\R29309725\\29309725.18410.20240111.01024165.POST.mp4" "-vv"]
2025/04/10 17:27:56 DEBUG : Creating backend with remote "E:\\Filestore\\G1034\\E2973760\\R29309725\\29309725.18410.20240111.01024165.POST.mp4"
2025/04/10 17:27:56 DEBUG : Using config file from "C:\\Users\\sirixadmin\\AppData\\Roaming\\rclone\\rclone.conf"
2025/04/10 17:27:56 DEBUG : fs cache: renaming child cache item "E:\\Filestore\\G1034\\E2973760\\R29309725\\29309725.18410.20240111.01024165.POST.mp4" to be canonical for parent "//?/E:/Filestore/G1034/E2973760/R29309725"
   609905 29309725.18410.20240111.01024165.POST.mp4
2025/04/10 17:27:56 DEBUG : 1 go routines active
6

I also tried to use the filename only in the list in the E:\ directory to try if it catches any files, and it fails.

7 
:: print the filter
rclone cat filename-part2.csv 
/filestore/g1034/e2973760/r29309725/29309725.18410.20240111.01024165.post.mp4

:: create the file
rclone touch  e:/filestore/g1034/e2973760/r29309725/29309725.18410.20240111.01024165.post.mp4 

:: list the file using fullpath
rclone ls     e:/filestore/g1034/e2973760/r29309725/29309725.18410.20240111.01024165.post.mp4 
        0 29309725.18410.20240111.01024165.post.mp4

:: list the file using filter
rclone ls     e:/ --files-from=filename-part2.csv 
        0 filestore/g1034/e2973760/r29309725/29309725.18410.20240111.01024165.post.mp4