You can do either. Some people prefer the unified approach offered by docker containers with a standard way of install, upgrade etc. It makes sense for running the rclone servers or mount.
However installing rclone on the server directly is fine too and that is what I would do in this case.