Speed up --include with cache or similar?

Appreciate the help Animosity022. I tried reducing the cache to just a subfolder now (should be faster). But it is still too slow for my use case. I was hoping cache would be more or less instant. Takes several minutes, as can be seen in the log (I did not let rclone copy finish, but this was after having run a successful rclone ls)
https://drive.google.com/open?id=1DrHfTo3ZrFLJFICLB44oUFCrmxPqET6D

This is the rclone config I am using. I am testing this all on the same computer now (no copying of cache database):
[DriveCache]
type = cache
remote = Drive:Viz Mosart/Viz Mosart Project & Support/Installers/Dropbox
chunk_size = 64M
info_age = 99y
chunk_total_size = 6400M

This is the command I use to create the cache (I have tried this without --fast-list also):
rclone.exe ls DriveCache: --fast-list --cache-chunk-path "rclone cache" --cache-db-path "rclone cache" --cache-db-purge --config rclone.conf

This is the command I use to download a certain installer build number:
rclone.exe copy DriveCache: Test --include {*3.6.0.14446*} --ignore-case -vv --progress --stats-one-line --cache-chunk-path "rclone cache" --cache-db-path "rclone cache" --config rclone.conf --log-file log.txt

I don’t understand why it’s reading so much from Google Drive when using cache. I tried turning off my network adapter (internet) and it does not work at all then. Maybe I have an incorrect understanding of what rclone cache is.

I tested running rclone ls multiple times to see if cache creation speed improves:
Was unable to create log with rclone ls but speed seemed very slow on second try: