I'm having an issue for some time where rclone uploads the same file over and over to google drive. It creates copies of the files on the server, sometimes 20-40 copies.
I also caught my server spawning many rclone processes, sometimes a hundred.
I have no idea on how to go about error checking this as there is nothing in the logs.
I run it on linux Ubuntu 18.04, rclone v1.48.0.
My exact cronjob is:
/usr/bin/rclone copy /mnt/local/downloads/files/allfiles/transfer gdrive:Files/bmn -v --tpslimit 5 --transfers 2 >> /home/seed/logs/transferout.log 2>&1
I have tried to limit transfers as can be seen above as well as chaging the --tpslimit. No effect
Are you running rclone off a crontab? You need to make sure that one has stopped before the next one starts. A really easy way of doing this is with adding --rc to the command, but there are more sophisticated ways!
Yea i'm running it off crontab, but it only executes once every 24hrs.
I also had the problem when running off a script where I had several rclone jobs execute one after the other. I moved to crontab to see if it would help. The script also only ran once every 24 hrs.
Well normally I have some 240'ish processes on my machine. When it gets crazy with rclone it exceeds 500 and when I do pidof rclone it shows like alot.
Granted I haven't counted them all but it is alot, and the machine is also sluggish. I normally just kill them with killall.
Right so it looks like I'm idiot. Thanks @Animosity022.
That would also explain why I only see the error intermittently - I have fiddled often with the crontab often to see if that makes any difference and I have on occasion changed the minute to an absolute number, which I will do again.
Thanks for the fast fault checking, its appreaciated!