How do I improve this mount config? what am i doing wrong?

you can pre-cache the mount. and re-cache it on the fly, as needed.
Google Drive, Plex, Windows 10 - #5 by VBB

these flags require cache remote, which based on your config file, you are not using, so remove them
--cache-chunk-path "E:\rclone\cachechunkpath"
--cache-db-path "E:\rclone\dbcache"

--vfs-cache-max-age=24h