Any particular reason you're using --network-mode? In my experience, this does not make a (positive) difference.
I would add --rc to your mount, and then follow that up with another command for priming the dir cache:
rclone rc vfs/refresh recursive=true
In Windows Explorer, I've made this change, and that seems to have helped a lot with listing files/folders"
Hope that helps 
EDIT: You might also want to add something like --dir-cache-time 5000h to your mount.