Rclone Move Command - Slow to AWS

I have a rclone encrypted mount to AWS and the transfers seem extremely slow. My cloud server has guaranteed upload/download of 300mbit. I’ve probably got something setup wrong, but wanted some advice on what I may need to change to make these automated transfers perform better.

I verified my speed with the speedtest cli script and the provider is meeting their SLA for bandwidth, both incoming and outgoing.

Setup

Mount: rclone --config=/home/plex/.rclone.conf mount --max-read-ahead 200M --transfers 8 --checkers 16 --verbose --allow-other encrypt: /home/plex/cloud/

Scripts called by Cron
/usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies

/usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv

Logs and processes
Why are there so many spawns of the script processes?

plex 3466 3465 1 03:00 ? 00:04:07 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3493 3492 0 03:01 ? 00:03:17 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3521 3520 0 03:02 ? 00:03:26 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3548 3547 0 03:03 ? 00:02:29 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3575 3574 0 03:04 ? 00:02:44 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3600 3599 0 03:05 ? 00:03:01 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3626 3625 0 03:06 ? 00:02:47 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3652 3651 0 03:07 ? 00:02:51 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3680 3679 0 03:08 ? 00:03:00 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3716 3714 0 03:09 ? 00:03:05 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3780 3779 0 03:10 ? 00:02:27 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3807 3806 0 03:11 ? 00:02:41 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3835 3834 0 03:12 ? 00:02:31 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3860 3859 0 03:13 ? 00:02:37 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3886 3885 0 03:14 ? 00:02:44 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3916 3915 0 03:15 ? 00:02:46 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3944 3943 0 03:16 ? 00:02:38 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 3974 3973 0 03:17 ? 00:02:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 4016 4015 0 03:18 ? 00:02:48 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 4053 4052 0 03:19 ? 00:02:39 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 4113 4112 0 03:20 ? 00:02:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 4464 4463 0 03:21 ? 00:02:12 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 4790 4789 0 03:22 ? 00:02:15 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5071 5070 0 03:23 ? 00:02:34 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5315 5314 0 03:24 ? 00:02:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5572 5571 0 03:25 ? 00:02:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5745 5744 0 03:26 ? 00:02:18 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5784 5783 0 03:27 ? 00:02:33 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5818 5817 0 03:28 ? 00:02:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5844 5843 0 03:29 ? 00:02:23 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5871 5870 0 03:30 ? 00:02:17 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5896 5895 0 03:31 ? 00:02:19 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5922 5921 0 03:32 ? 00:02:25 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5948 5947 0 03:33 ? 00:02:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 5977 5976 0 03:34 ? 00:02:06 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6004 6003 0 03:35 ? 00:02:03 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6030 6029 0 03:36 ? 00:02:26 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6058 6057 0 03:37 ? 00:02:23 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6085 6084 0 03:38 ? 00:02:13 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6117 6115 0 03:39 ? 00:02:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6181 6180 0 03:40 ? 00:02:16 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6208 6207 0 03:41 ? 00:02:11 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6237 6236 0 03:42 ? 00:02:15 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6268 6267 0 03:43 ? 00:02:06 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6295 6294 0 03:44 ? 00:02:11 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6321 6320 0 03:45 ? 00:02:17 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6349 6348 0 03:46 ? 00:02:13 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6375 6374 0 03:47 ? 00:02:14 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6403 6402 0 03:48 ? 00:02:16 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6430 6429 0 03:49 ? 00:02:02 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6455 6454 0 03:50 ? 00:02:12 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6482 6481 0 03:51 ? 00:02:11 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6509 6508 0 03:52 ? 00:02:02 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6536 6535 0 03:53 ? 00:02:04 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6562 6561 0 03:54 ? 00:02:09 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6588 6587 0 03:55 ? 00:02:18 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6613 6612 0 03:56 ? 00:02:10 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6654 6653 0 03:57 ? 00:01:59 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6681 6680 0 03:58 ? 00:01:58 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 6707 6706 0 03:59 ? 00:02:06 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv
plex 7713 7712 0 05:00 ? 00:00:23 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7740 7739 0 05:01 ? 00:00:25 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7765 7764 0 05:02 ? 00:00:29 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7790 7789 0 05:03 ? 00:00:28 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7815 7814 0 05:04 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7838 7837 0 05:05 ? 00:00:25 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7863 7862 0 05:06 ? 00:00:20 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7888 7887 0 05:07 ? 00:00:26 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7911 7910 0 05:08 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 7936 7935 0 05:09 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8000 7999 0 05:10 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8024 8023 0 05:11 ? 00:00:26 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8052 8051 0 05:12 ? 00:00:26 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8076 8075 0 05:13 ? 00:00:26 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8100 8099 0 05:14 ? 00:00:25 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8126 8125 0 05:15 ? 00:00:26 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8151 8150 0 05:16 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8178 8176 0 05:17 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8202 8201 0 05:18 ? 00:00:20 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8228 8227 0 05:19 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8252 8251 0 05:20 ? 00:00:25 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8281 8280 0 05:21 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8319 8318 0 05:22 ? 00:00:25 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8350 8349 0 05:23 ? 00:00:23 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8382 8381 0 05:24 ? 00:00:20 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8413 8412 0 05:25 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8437 8436 0 05:26 ? 00:00:20 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8463 8462 0 05:27 ? 00:00:24 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8494 8493 0 05:28 ? 00:00:23 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8517 8516 0 05:29 ? 00:00:24 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8543 8542 0 05:30 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8566 8565 0 05:31 ? 00:00:24 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8597 8596 0 05:32 ? 00:00:24 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8624 8623 0 05:33 ? 00:00:24 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8649 8648 0 05:34 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8677 8676 0 05:35 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8702 8701 0 05:36 ? 00:00:23 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8731 8730 0 05:37 ? 00:00:23 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8755 8754 0 05:38 ? 00:00:20 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8784 8783 0 05:39 ? 00:00:24 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8850 8849 0 05:40 ? 00:00:18 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8874 8873 0 05:41 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8899 8898 0 05:42 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8928 8927 0 05:43 ? 00:00:19 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8952 8951 0 05:44 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 8975 8974 0 05:45 ? 00:00:19 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 9168 9167 0 05:46 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 9454 9453 0 05:47 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 9746 9745 0 05:48 ? 00:00:17 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10038 10037 0 05:49 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10297 10296 0 05:50 ? 00:00:20 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10321 10320 0 05:51 ? 00:00:17 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10348 10347 0 05:52 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10375 10374 0 05:53 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10402 10401 0 05:54 ? 00:00:19 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10425 10424 0 05:55 ? 00:00:22 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10450 10449 0 05:56 ? 00:00:18 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10479 10478 0 05:57 ? 00:00:18 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10504 10503 0 05:58 ? 00:00:21 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies
plex 10531 10530 0 05:59 ? 00:00:19 /usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies

Example of the log file one of the scripts is writing to

**Renamed some of the files below just for privacy sake

Transferred: 8.743 GBytes (459.623 kBytes/s)
Errors: 13
Checks: 9
Transferred: 9
Elapsed time: 5h32m25.3s
Transferring:

  • … 29/stuff - S29E01 - blah.mkv: 27% done. avg: 102.4, cur: 107.8 kByte/s. ETA: 1h22m20s
  • …/stuff - S29E03 - blah.mkv: 93% done. avg: 101.3, cur: 82.1 kByte/s. ETA: 6m57s
  • …ason 29/stuff - blahv: 0% done. avg: 118.4, cur: 125.3 kByte/s. ETA: 1h46m39s
  • …s - S29E16 - blah: 93% done. avg: 104.9, cur: 96.9 kByte/s. ETA: 7m25s

The problem is running so many copies of rclone at once I’d say.

You want to make sure you are only running one copy of each rclone at once otherwise it will be trying to transfer the same file lots of times.

I see that. But my cron job is only calling the script once. Here is the cron job.

*5 * * * /home/plex/move_movies.sh >> /home/plex/logs/cron-movies.txt 2>&1
*3 * * * /home/plex/move_tv.sh >> /home/plex/logs/cron-tv.txt 2>&1

The script for each was pasted in the original message, but here they are again. Is there something I’m doing wrong to cause it spawn so many processes?

move_movies.sh
/usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 3d --log-file /home/plex/logs/move_movies.log move /home/plex/local/movies/ encrypt:/movies

move_tv.sh
/usr/local/bin/rclone -v --config=/home/plex/.rclone.conf --min-age 7d --log-file /home/plex/logs/move_tv.log move /home/plex/local/tv/ encrypt:/tv

So I have validated this is not a rclone issue, but something with the cronjob spawning multiple processes. I have no idea why, but if I run the script manually, it only spawns a single process. Cron spawns several dozen for whatever reason.

Your cron job says spawn an rclone every 5 minutes (at least it would if it said */5 not *5 - not sure exactly what that means).

At a guess rclone is taking longer than 5 minutes to run - that is why you are getting lots of them.

Here is an article about how to prevent such things: http://bencane.com/2015/09/22/preventing-duplicate-cron-job-executions/

I could add a flag to rclone which opened a local socket which would mean you could only run one with a given port too.

it just didn’t copy right to the board. It’s actually the following.

  • 5 * * *
    unless I’m off base this should execute at 5am. I’m using the flock command now to limit it to 1 process.

You are executing it every minute in the hour of 5am. If you want 5am only you need

0 5 * * *