Rclone with rcd mode autoscaling and async setup


I have already set up an instance of rclone which running at rcd mode with docker.
Running copy commands is working perfectly.

I'm trying to use rclone with flag --async and poll job_id for getting status and it's working fine.

My concern is that if I scaling to 2 containers of docker, the job_id can be duplicated between instances. Is there any option to config this kind of issue, or I need to add a layer for routing between rclone instances?


Hello @xgenvn we recently started using a docker rclone volume plugin for this purpose exactly. This seems promising for our replicated docker (in swarm mode) containers.

Very likely

You'll need to make sure you query the same rclone that you started the job on. Not sure how you'll achieve this in your setup - rclone doesn't have a shared DB mode.

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.