You need to set up a :http: as the source directory and in your files it should be just the file names relative to the directory in the --http-url.
So
rclone copy --http-url https://example.com :http: /path/to/dest --files-from files.txt
Where files.txt looks like this
file.zip
dir/file2.zip
dir/subdir/file3.zip