Recursive HTTP directory fetching

Desired syntax:

rclone copy remotedir:‘http://somewebsite.com/directory/’ Drive:somewebsite/

Desired result:

It should recursively fetch all files in the directory and it’s sub-directories and locally transfer them to said target.

Why?

I want to move some directories with dynamically changing structures (new files regularly added, I want to repeat the command once a week to pull updates), I know there is the possible of using wget but my host restricts usage of any virtual mounts. Also it would be a much more economical way of reducing API hits.

Is that a directory listing as generated by apache/nginx?

If so you are in luck as exactly this feature is being developed in the http branch

1 Like

Yes yes yes! Thank you!