And it is "too slow" compared to what? Depending on number of files and directories it can take anything from 1s to many hours before transfers start.
Then there is network speed/latency and server performance to add to the equation.
This is good example to illustrate possible differences: