New backend with local db?

Hi,

I would like to implement my own backend for which I am seeking some advice. I already managed to get a very simple test provider done that just lists static stuff, however my end goal would be to support a provider which is a bit similar like git when fetching the previously uploaded file structures. I have to keep iterating on responses from and endpoint until I can backfill all history. There is no way to request already uploaded directory structures besides that. So I would need some local db where I can store the state. I was thinking of using sqlite in wal mode.

But upon first look, I haven't found any similar backend that would do this. What would be your advice? Should I rather setup a middleware API that builds the db and serves requests back to rclone, so the complexity of my backend doesn't grow too much?

Is there a way to "lock" directory listing requests from the user when I am fetching updates to the db? ie if a user lists a directory and I don't have every update fetched/inserted to the db yet, it shouldn't time out, but fetch everything first.

Thanks

bolt database

1 Like