Rclone running multiple times in ps aux

What is the problem you are having with rclone?

when I run "ps aux" I am seeing rclone appearing 10 times as processes. I am guessing that this is because one backup is not completed and it is already running another.

ps aux | grep rclone
root      319690 13.6  2.5 2321856 835428 ?      Sl   Oct27 430:14 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
root      842601 43.7  2.7 2020996 885464 ?      Sl   02:00 121:03 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
usermat+ 1008153  0.0  0.0   6556  2004 pts/1    S+   06:36   0:00 grep --color=auto rclone
root     1126243 24.3  2.7 4296240 897132 ?      Sl   Oct20 3220:48 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
root     1500657 28.5  2.8 4512700 945064 ?      Sl   Oct22 2954:18 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
usermat+ 2200136  0.0  0.0 433648 17600 ?        Sl   Oct22   0:00 /usr/bin/rclone-browser
root     2285287  5.7  2.5 2256444 842204 ?      Sl   Oct24 431:36 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
root     2320084 19.6  2.6 2671636 857316 ?      Sl   Oct25 1187:32 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
root     2869955 24.5  2.7 4296368 898416 ?      Sl   Oct21 2891:10 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
root     3208871 13.5  2.6 2458888 862008 ?      Sl   Oct26 621:43 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
root     3902259  8.7  2.7 2462920 884448 ?      Sl   Oct23 776:29 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/
root     4104854 32.8  2.6 2391236 861392 ?      Sl   Oct28 564:24 rclone sync --log-file=/SM_DATA/sm_logs/sm_server_backup_external.log --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from /SM_DATA/client_configs/backups_external/rclone.excludes --config=/SM_DATA/client_configs/backups_external/rclone.conf /SM_DATA data-drive-crypt:compumatter-biz-svr/

I am only running the cron backup script job once per day with:

0 2 * * * root /SM_DATA/sm_scripts/backups/sm_server_backup_external.sh &

The script itself looks like this:
rclone sync --log-file=${RCLONE_LOG} --log-level DEBUG --low-level-retries 20 --tpslimit 10 --exclude-from ${RCLONE_EXCLUDES} --config=${RCLONE_CONFIG} ${RCLONE_SOURCE_DIR} ${RCLONE_DEST}

Can anyone think of a reason ps aux would show rclone running so many times ? I can hear my raided platter drives running regularly as a result and it's concerning.

What sayeth the group?

Run the command 'rclone version' and share the full output of the command.

Which cloud storage system are you using? (eg Google Drive)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Paste command here

The rclone config contents with secrets removed.

Paste config here

A log from the command with the -vv flag

Paste  log here

hi,

--- i would look into the rclone debug log

  • if that many rclone sync are running at the same time, check the timestamps for each start of rclone.
    2022/08/26 18:15:50 DEBUG : rclone: Version "v1.58.1" starting with parameters
  • and did each rclone instance complete and exit or what?

--- that entire script, is just a single line?

--- perhaps post all the answers to the help and support template.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.