I want to download a large file (100 GB) directly to the mounted webdav storage, without caching and without saving to /tmp/, because the file is too big for the server's internal storage capacity. Unfortunately when downloading the file, the filesize is unkown, so wget just keeps downloading until its finished.
I think the unkown filesize causes issues with rclone's cache and tmp.
rclone keeps filling /tmp/ with data. Eventually it crashes, as the server's internal storage is full.
Unfortunately webdav needs to know the size of the file at the start of the upload.
If the source isn't telling rclone the size, then rclone doesn't have a choice but to store it to disk in a temporary file.
You could possibly work around this with a bit of scripting...
Use rclone cat | wc to find the size of the file then use rclone cat | rclone rcat --size XXX where the size is what you measured first. This will download the file twice, but it won't store it to disk.