I think it is probably a rate limit problem but I'm not sure...
If you run with -vv --dump responses rclone will print the body of the 500 error which may have some more info in it.
You could try slowing it down even more with --tpslimit 1 --checkers 1 --transfers 1 also.