Mount - free space

Feature
1

Hello, First post, hopefully posting in the right place.

I remember seeing this before but I can't find now im looking again but..

When you mount a storage system as a drive in linux or windows, it will default before to 1PB but now will with the latest update mount to 1PB plus whatever space is used (used 100GB so total is 1.01PB or something like that)

I remember in the post I saw you were looking in a beta to maybe expose that option to be changeable via a command line variable? Can this still be a option? I saw this was before the 1.55 version if I am remembering right that it used to just default to 1PB and not the used + 1PB that it is now.

I need to set the total space size to be something closer to what I have available via the cloud-storage of my mounts to be maybe only 10TB more than whats used (used 500GB so total would be 1.5TB) but would prefer to set it via a command line.

Edit: found the post

2

The problem in the original post was that the user had a significant fraction of 1PB of files and didn't want the free size to go down to zero.

What cloud storage are you using? Ideally we'd get rclone to support accurate sizing on it.

3

I am using wdav as the cloud storage. The backend has ~80TB of total but i want to limit it via the mount to 5 or 10TB as I have a program using the mount that will auto delete old data (backups) when it gets full.

4

Information about the remote doesn't show anything

user@linux:~# rclone about wdav-mount:
user@linux:~# rclone about wdav-mount: -vvv
2021/04/23 15:20:26 DEBUG : Using config file from "~/.config/rclone/rclone.conf"
2021/04/23 15:20:26 DEBUG : rclone: Version "v1.55.0" starting with parameters ["rclone" "about" "wdav-mount:" "-vvv"]
2021/04/23 15:20:26 DEBUG : Creating backend with remote "wdav-mount:"
2021/04/23 15:20:26 DEBUG : 5 go routines active
5

It is the same 1PB also when on a Google Workspace GDrive mount also which I can understand as it doesn't have a storage limit technically but wouldn't mind setting this to be lower so my backup programs don't store a unlimited amount of backup versions.

rclone about gd-workspace:
Used:    44.496T
Trashed: 893.203G
Other:   0
6

Can you post what you get if you run this?

rclone about wdav-mount: -vv --dump bodies

I see what you mean. This would require another parameter to the VFS to implement. Are you suggesting that the free space would be the parameter you'd want to control, so the 1PB number we have at the moment?

7 
rclone about wdav-mount: -vv --dump bodies
2021/04/25 01:08:02 DEBUG : Using config file from "~/.config/rclone/rclone.conf"
2021/04/25 01:08:02 DEBUG : rclone: Version "v1.55.0" starting with parameters ["rclone" "about" "wdav-mount:" "-vv" "--dump" "bodies"]
2021/04/25 01:08:02 DEBUG : Creating backend with remote "wdav-mount:"
2021/04/25 01:08:02 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2021/04/25 01:08:02 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/04/25 01:08:02 DEBUG : HTTP REQUEST (req 0xc000141c00)
2021/04/25 01:08:02 DEBUG : PROPFIND / HTTP/1.1
Host: IP_ADDRESS
User-Agent: rclone/v1.55.0
Content-Length: 139
Authorization: XXXX
Depth: 0
Referer: http://IP_ADDRESS/
Accept-Encoding: gzip

<?xml version="1.0" ?>
<D:propfind xmlns:D="DAV:">
 <D:prop>
  <D:quota-available-bytes/>
  <D:quota-used-bytes/>
 </D:prop>
</D:propfind>
2021/04/25 01:08:02 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/04/25 01:08:02 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/04/25 01:08:02 DEBUG : HTTP RESPONSE (req 0xc000141c00)
2021/04/25 01:08:02 DEBUG : HTTP/1.1 207 Multi-Status
Content-Length: 307
Content-Type: text/xml; charset="utf-8"
Date: Sun, 25 Apr 2021 08:08:02 GMT
Server: Apache

<?xml version="1.0" encoding="utf-8"?>
<D:multistatus xmlns:D="DAV:" xmlns:ns0="DAV:">
<D:response xmlns:g0="DAV:">
<D:href>/</D:href>
<D:propstat>
<D:prop>
<g0:quota-available-bytes/>
<g0:quota-used-bytes/>
</D:prop>
<D:status>HTTP/1.1 404 Not Found</D:status>
</D:propstat>
</D:response>
</D:multistatus>
2021/04/25 01:08:02 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/04/25 01:08:02 DEBUG : 4 go routines active

Yes, if this parameter is set, then you could set the total size the mount shows, if its not set, leave it at the 1PB or how the current system is.

8

There is no useful info in there alas!

Can you open a new issue on Github about this.

What is required is to make this constant controlled by a vfs parameter

Would you be interested in adding the feature? I can talk you through it?

9

To give some info, It is a Synology with the WebDav package. I think they have a basic setup just to provide the webdav protocol and nothing else. I can provide config files from the apache server if needed but changing them will just be reset when the package is updated or the unit is rebooted

I have opened this, Hopefully this is all correct.

10

Not all webdav servers support this part of the protocol, so there being nothing useful in there is not too surprising. I don't think it is worth investigating further.

Thanks

11

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.