I think this is the problem...
It is probably best to treat a shared_with_me
drive as read only, othewise when you create folders they'll get created in the non-shared-with-me part of your drive which can't be seen from the shared-with-me part, and you'll get exactly this behaviour.