I keep failing to connect to a specific sftp

That is not the most helpful error message ever, but I think it means that the remote end just shut the TCP connection. This is usually caused by some kind of firewall I think.

Is that possible?

This thread may be useful

Rclone will make multiple connections to the backend which might be a problem though I don't see that in your log.