It seems the web interface just glitched, but files are being deleted, and then restored lol.
However I made a mount like this:
rclone mount gdrive: trash --drive-use-trash=false --drive-trashed-only
So I could see what stuff I could safely delete to clean the web ui... but rclone purge doesn't seem to work, delete only delete the files, and rmdir doesn't delete folders too.
Would be nice to have a way to do such things on the trash with trashed age, or just run purge on trashed folders