On google drive that is what it does. On other backends (which can't remove a folder and subcontents) it will iterate it and remove all the files individually.
Yes that is what rclone delete does. You can use filters with it (unlike rclone purge) which is probably the main practical difference.