So is there any way to "clean up" those empty, left-behind directories?

Looks still missing.

Here is is! (3rd time lucky): http://beta.rclone.org/v1.34-36-g539853d/