Thanks! The issue was that I was running on a crypt remote.
It fails with a weird message tho! It says "failed to backend: command cleanup failed: command not found" as if it is not a valid command at all. Perhaps it should fail with a "this is a crypt remote" or something?