Is there a way to set --low-level-retries on a running rclone via the `rc` command?

[durval (Durval Menezes)]

As per the subject. Tried both

rclone rc options/set --json '{"main": {"LowLevelRetries": 733}}'

and

rclone rc options/set --json '{"main": {"low-level-retries": 733}}'

but the actual parameter (as shown by the ongoing retries in the verbose output) isn't changed.

TIA.

[Ole (Ole Frost)]

Hi Durval,

@durval

rclone rc options/set --json '{"main": {"LowLevelRetries": 733}}'

This looks good to me, try confirming with

rclone rc options/get | grep LowLevelRetries

However not sure it will take effect on a running command such as a mount or sync/sync. May first be applied from the next command you execute.

[ncw (Nick Craig-Wood)]

@Ole

However not sure it will take effect on a running command such as a mount or sync/sync. May first be applied from the next command you execute.

Low level retries are used in lots of places, but if you are talking about those done by backends, then the initial value is cached by the Pacer that is in use when the backend is started.

This could probably be fixed if it was important!

[durval (Durval Menezes)]

Hi @ncw,

Thanks for the detailed answer. Yes, it's relatively important (I'm in the middle of a hundred-million-files rclone copy from my old Google EDU account -- which is being deactivated, and I need to change this and other parameters while rclone is running -- restarting it costs me days in time for it to begin again from the start).

Why the caching? Why not have everything (command-line parsing, rc setting, etc) changing a global variable, and then Pacer etc getting it straight from there? The former would be read-write but the latter would be read-only, so no major contention and/or locking issues, right?

[Ole (Ole Frost)]

I initially changed to "Help & Support", but sounds like Feature request was indeed the right category. Changing back

[ncw (Nick Craig-Wood)]

@durval

Why the caching? Why not have everything (command-line parsing, rc setting, etc) changing a global variable, and then Pacer etc getting it straight from there? The former would be read-write but the latter would be read-only, so no major contention and/or locking issues, right?

A good question.

Rclone does have a system of global config which is overridable per request using context variables.

We don't currently pass context variables into the pacer so that would need to change. That is lengthy (50 backends to change!) but straight forward.

I guess the other thing to consider would be what happens to the pacer if the number of low level retries changes while it is actually doing low level retries. Probably not too hard but would need consideration.

So, yes, perfectly possible, but a reasonable amount of work, alas.

[durval (Durval Menezes)]

@ncw, thanks again for the detailed, thoughtful response.

I will have a look at the affected code and (at least for my backend ie GoogleDrive) try and see if I can do the implementation myself.

I will keep you posted.

Cheers,
-- Durval.