[SOLVED] WebDAV upload failed [Owncube]

M_R · October 3, 2023, 11:32am

What is the problem you are having with rclone?

Web DAV upload failed, upload over webinterface works

Run the command 'rclone version' and share the full output of the command.

v1.63.0

Which cloud storage system are you using? (eg Google Drive)

owncube.cloud

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone mount owncube:/ /home/dev/upload/mount/owncube --umask 0 --allow-other --dir-cache-time 24h --attr-timeout 6h --poll-interval 30s --vfs-cache-max-age 3h --vfs-cache-mode full --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit 512M --vfs-cache-max-size 15G --transfers 4 --checkers 4 --allow-non-empty --log-file="/home/dev/.config/rclone/rclone.log"

The rclone config contents with secrets removed.

[owncube]
type = webdav
url = https://owncube.cloud/remote.php/dav/files/***********
vendor = owncloud
user = **************
pass = **************

A log from the command with the `-vv` flag

2023/10/03 13:30:38 DEBUG : movies/***********************.mkv: vfs cache: starting upload
2023/10/03 13:30:39 DEBUG : /: Lookup: name="movies"
2023/10/03 13:30:39 DEBUG : /: >Lookup: node=movies/, err=<nil>
2023/10/03 13:30:39 DEBUG : movies/: Attr: 
2023/10/03 13:30:39 DEBUG : movies/: >Attr: attr=valid=6h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2023/10/03 13:30:39 DEBUG : movies/***********************.mkv: Update will use the normal upload strategy (no chunks)
2023/10/03 13:30:54 ERROR : movies/***********************.mkv: Failed to copy: 413 Request Entity Too Large

asdffdsa · October 3, 2023, 1:25pm

hi,
***********************.mkv: Failed to copy: 413 Request Entity Too Large
what size is the file?

can you rclone copy direct to webdav, not using the mount?

can remove --checkers, does nothing on a mount command.

M_R · October 3, 2023, 6:53pm

copy also does not work. The file is ~3,5 GiB.

rclone copy Movies/MyTestFolder/ owncube:/movies/
2023/10/03 20:51:01 ERROR : *************.mkv: Failed to copy: 413 Request Entity Too Large
2023/10/03 20:51:01 ERROR : Attempt 1/3 failed with 1 errors and: 413 Request Entity Too Large

And more debug infos

rclone lsf owncube: -vv --dump headers

2023/10/03 20:55:56 DEBUG : rclone: Version "v1.63.0" starting with parameters ["rclone" "lsf" "owncube:" "-vv" "--dump" "headers"]
2023/10/03 20:55:56 DEBUG : Creating backend with remote "owncube:"
2023/10/03 20:55:56 DEBUG : Using config file from "/home/dev/.config/rclone/rclone.conf"
2023/10/03 20:55:56 DEBUG : found headers: 
2023/10/03 20:55:56 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/10/03 20:55:56 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/10/03 20:55:56 DEBUG : HTTP REQUEST (req 0xc000928000)
2023/10/03 20:55:56 DEBUG : PROPFIND /remote.php/dav/files/**********/ HTTP/1.1
Host: owncube.cloud
User-Agent: rclone/v1.63.0
Content-Length: 287
Authorization: XXXX
Depth: 1
Referer: https://owncube.cloud/remote.php/dav/files/**********/
Accept-Encoding: gzip

2023/10/03 20:55:56 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/10/03 20:55:58 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/03 20:55:58 DEBUG : HTTP RESPONSE (req 0xc000928000)
2023/10/03 20:55:58 DEBUG : HTTP/1.1 207 Multi-Status
Cache-Control: no-store, no-cache, must-revalidate
Connection: Upgrade
Content-Security-Policy: default-src 'none';
Content-Type: application/xml; charset=utf-8
Date: Tue, 03 Oct 2023 18:55:56 GMT
Dav: 1, 3, extended-mkcol, access-control, calendarserver-principal-property-search, nextcloud-checksum-update, nc-calendar-search, nc-enable-birthday-calendar
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Pragma: no-cache
Referrer-Policy: no-referrer
Server: Apache
Set-Cookie: ocs0qrwccts3=ae5f5c53ff6bc59f2fe32a52299c7a2f; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc_sessionPassphrase=Nhip%2FYCvvGVYV8ruEqxlrycQNfa0DlMZUVDGyd2J6ZTfJwNJSy9EsQRgdXlgHgCzdikWsF6uKx7y0JkcGzBGVwVfUuODI6%2FpMFAFoSEQH1wqvMx6HcZTtfRCblO6vn%2FM; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=13b1ef45e64bd5b3e641a6bb082e6877; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=13b1ef45e64bd5b3e641a6bb082e6877; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: __Host-nc_sameSiteCookielax=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=lax
Set-Cookie: __Host-nc_sameSiteCookiestrict=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=strict
Set-Cookie: ocs0qrwccts3=13b1ef45e64bd5b3e641a6bb082e6877; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=13b1ef45e64bd5b3e641a6bb082e6877; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=32e376f1914f9140257c660cddfde2f7; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: cookie_test=test; expires=Tue, 03 Oct 2023 19:55:58 GMT; Max-Age=3600
Strict-Transport-Security: max-age=31536000; preload
Upgrade: h2
Vary: Brief,Prefer
X-Content-Type-Options: nosniff
X-Content-Type-Options: nosniff
X-Debug-Token: ZRxjvDdhhO72OP3FCNxMeAAAAoA
X-Frame-Options: SAMEORIGIN
X-Frame-Options: SAMEORIGIN
X-Permitted-Cross-Domain-Policies: none
X-Request-Id: ZRxjvDdhhO72OP3FCNxMeAAAAoA
X-Robots-Tag: noindex, nofollow
X-Xss-Protection: 1; mode=block

asdffdsa · October 3, 2023, 7:00pm

that is a message from the provider, not seeing how it is a rclone bug.

https://forum.rclone.org/t/onedrive-webdav-413-request-entity-too-large/17091/8

https://doc.owncloud.com/server/10.13/admin_manual/configuration/files/big_file_upload_configuration.html

re-copy the file using that flag and post the full output.

not sure it will matter, might try increasing the upload chunk size

M_R · October 3, 2023, 8:59pm

Tested it with a 7,8 GiB file.

2023/10/03 22:54:41 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/03 22:54:41 DEBUG : ********1080p.mkv: Update will use the normal upload strategy (no chunks)
2023/10/03 22:54:42 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/03 22:54:42 DEBUG : HTTP RESPONSE (req 0xc000a60600)
2023/10/03 22:54:42 DEBUG : HTTP/1.1 207 Multi-Status
Cache-Control: no-store, no-cache, must-revalidate
Connection: Upgrade
Content-Security-Policy: default-src 'none';
Content-Type: application/xml; charset=utf-8
Date: Tue, 03 Oct 2023 20:54:39 GMT
Dav: 1, 3, extended-mkcol, access-control, calendarserver-principal-property-search, nextcloud-checksum-update, nc-calendar-search, nc-enable-birthday-calendar
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Pragma: no-cache
Referrer-Policy: no-referrer
Server: Apache
Set-Cookie: ocs0qrwccts3=0c3ab8fea00f4cc5ed1d5f9db9247a10; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc_sessionPassphrase=GgT4Z5vUyBexQCmC7ty%2Fg5N2Vca9mu%2BWqV1kvanfwG5V2RovTTlUHWTvIW3or4rnvYPDnv7Am%2BfcHJCGSVTys%2BnOihgW%2Ffw5QEQ74D1yQxysqzYeO2bm6Pvv2wu5JKFl; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=19695f1d7b8948fb2c28d52149c73823; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=19695f1d7b8948fb2c28d52149c73823; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: __Host-nc_sameSiteCookielax=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=lax
Set-Cookie: __Host-nc_sameSiteCookiestrict=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=strict
Set-Cookie: ocs0qrwccts3=19695f1d7b8948fb2c28d52149c73823; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=19695f1d7b8948fb2c28d52149c73823; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=97c6b431d5ebb8749f0409e4291a3d00; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: cookie_test=test; expires=Tue, 03 Oct 2023 21:54:42 GMT; Max-Age=3600
Strict-Transport-Security: max-age=31536000; preload
Upgrade: h2
Vary: Brief,Prefer
X-Content-Type-Options: nosniff
X-Content-Type-Options: nosniff
X-Debug-Token: ZRx_j86rgzPk7i7EoAFkWAAAAkE
X-Frame-Options: SAMEORIGIN
X-Frame-Options: SAMEORIGIN
X-Permitted-Cross-Domain-Policies: none
X-Request-Id: ZRx_j86rgzPk7i7EoAFkWAAAAkE
X-Robots-Tag: noindex, nofollow
X-Xss-Protection: 1; mode=block

2023/10/03 22:54:42 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/03 22:54:42 DEBUG : webdav root 'movies': Waiting for checks to finish
2023/10/03 22:54:42 DEBUG : webdav root 'movies': Waiting for transfers to finish
2023/10/03 22:55:36 INFO  : 
Transferred:              0 B / 7.841 GiB, 0%, 0 B/s, ETA -
Checks:                10 / 10, 100%
Transferred:            0 / 1, 0%
Elapsed time:       1m1.2s
Transferring:
 *                   ****************-1080p.mkv:  0% /7.841Gi, 0/s, -

Killed

asdffdsa · October 3, 2023, 9:05pm

can you copy the single file and post the ouput
the full output with , command, flags and error.

M_R · October 4, 2023, 7:57am

File upload via owncloud webinterface works.
File upload via rclone webdav failed.
So i think its a bug. Support said there is no upload limit.

Ok here is the command (copy single file):

rclone copy Movies/MyMovie/************-1080p.mkv owncube:/movies/ --dump headers

Log:

2023/10/04 09:47:50 NOTICE: Automatically setting -vv as --dump is enabled
2023/10/04 09:47:50 DEBUG : rclone: Version "v1.63.0" starting with parameters ["rclone" "copy" "Movies/MyMovie/************-1080p.mkv" "owncube:/movies/" "--dump" "headers"]
2023/10/04 09:47:50 DEBUG : Creating backend with remote "Movies/MyMovie/************-1080p.mkv"
2023/10/04 09:47:50 DEBUG : Using config file from "/home/dev/.config/rclone/rclone.conf"
2023/10/04 09:47:50 DEBUG : fs cache: adding new entry for parent of "Movies/MyMovie/************-1080p.mkv", "/home/dev/Downloads/Movies/Tenet.2020.German.DTS.DL.1080p.BluRay.x264-COiNCiDENCE"
2023/10/04 09:47:50 DEBUG : Creating backend with remote "owncube:/movies/"
2023/10/04 09:47:50 DEBUG : found headers: 
2023/10/04 09:47:50 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/10/04 09:47:50 DEBUG : fs cache: renaming cache item "owncube:/movies/" to be canonical "owncube:movies"
2023/10/04 09:47:50 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/10/04 09:47:50 DEBUG : HTTP REQUEST (req 0xc00041a500)
2023/10/04 09:47:50 DEBUG : PROPFIND /remote.php/dav/files/mydomain/movies/************-1080p.mkv HTTP/1.1
Host: owncube.cloud
User-Agent: rclone/v1.63.0
Content-Length: 287
Authorization: XXXX
Depth: 1
Referer: https://owncube.cloud/remote.php/dav/files/mydomain/
Accept-Encoding: gzip

2023/10/04 09:47:50 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/10/04 09:47:55 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/04 09:47:55 DEBUG : HTTP RESPONSE (req 0xc00041a500)
2023/10/04 09:47:55 DEBUG : HTTP/1.1 404 Not Found
Cache-Control: no-store, no-cache, must-revalidate
Connection: Upgrade
Content-Security-Policy: default-src 'none';
Content-Type: application/xml; charset=utf-8
Date: Wed, 04 Oct 2023 07:47:51 GMT
Dav: 1, 3, extended-mkcol, access-control, calendarserver-principal-property-search, nextcloud-checksum-update, nc-calendar-search, nc-enable-birthday-calendar
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Pragma: no-cache
Referrer-Policy: no-referrer
Server: Apache
Set-Cookie: ocs0qrwccts3=69234578c343d2da414f64ff013f0fe5; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc_sessionPassphrase=OmShqOGl8rdjliJfcwm8bEVbKfLN9MyPjXVkrZhjwUAg1AScmzj9Pe2uyOZyuszUDOr6HwSRQJmGKsQ0v7ReKwCwpIxBS7k2ZEqVQ%2FzsdMEUKgiBsAp9dsZwYvLRrhdx; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=b304198f3488d7eece96c3c68314400d; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=b304198f3488d7eece96c3c68314400d; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: __Host-nc_sameSiteCookielax=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=lax
Set-Cookie: __Host-nc_sameSiteCookiestrict=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=strict
Set-Cookie: ocs0qrwccts3=b304198f3488d7eece96c3c68314400d; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=b304198f3488d7eece96c3c68314400d; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=6e73be0e7364810ca112fda538bddd90; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: cookie_test=test; expires=Wed, 04 Oct 2023 08:47:54 GMT; Max-Age=3600
Strict-Transport-Security: max-age=31536000; preload
Upgrade: h2
Vary: Brief,Prefer,Accept-Encoding
X-Content-Type-Options: nosniff
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Frame-Options: SAMEORIGIN
X-Permitted-Cross-Domain-Policies: none
X-Robots-Tag: noindex, nofollow
X-Xss-Protection: 1; mode=block

2023/10/04 09:47:55 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/04 09:47:55 DEBUG : ***************-1080p.mkv: Need to transfer - File not found at Destination
2023/10/04 09:47:55 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/10/04 09:47:55 DEBUG : HTTP REQUEST (req 0xc00041b300)
2023/10/04 09:47:55 DEBUG : MKCOL /remote.php/dav/files/mydomain/movies/ HTTP/1.1
Host: owncube.cloud
User-Agent: rclone/v1.63.0
Authorization: XXXX
Referer: https://owncube.cloud/remote.php/dav/files/mydomain/
Accept-Encoding: gzip

2023/10/04 09:47:55 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/10/04 09:47:59 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/04 09:47:59 DEBUG : HTTP RESPONSE (req 0xc00041b300)
2023/10/04 09:47:59 DEBUG : HTTP/1.1 405 Method Not Allowed
Allow: OPTIONS, GET, HEAD, DELETE, PROPFIND, PUT, PROPPATCH, COPY, MOVE, REPORT
Cache-Control: no-store, no-cache, must-revalidate
Content-Security-Policy: default-src 'none';
Content-Type: application/xml; charset=utf-8
Date: Wed, 04 Oct 2023 07:47:55 GMT
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Pragma: no-cache
Referrer-Policy: no-referrer
Server: Apache
Set-Cookie: ocs0qrwccts3=744c3b27b63ada12187b63071623aea7; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc_sessionPassphrase=imWGOofU5L%2Fe3K4x0y0cP3JLJpQtFGD5ogkdZmRI376keW4HPojahW%2Fc2xpqpXrhQzUBvbQVTrsk%2BaRo0qAsvigePtKLAZWLoVedv%2F0oIq2XhwmjbbP2YYr%2BKUMgKhRa; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=bc28d66d0ddc9095bdfa7bf382e1fa59; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=bc28d66d0ddc9095bdfa7bf382e1fa59; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: __Host-nc_sameSiteCookielax=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=lax
Set-Cookie: __Host-nc_sameSiteCookiestrict=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=strict
Set-Cookie: ocs0qrwccts3=bc28d66d0ddc9095bdfa7bf382e1fa59; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=bc28d66d0ddc9095bdfa7bf382e1fa59; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: ocs0qrwccts3=5cc6f311f44ae54a391d5a9aab9106e8; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: cookie_test=test; expires=Wed, 04 Oct 2023 08:47:59 GMT; Max-Age=3600
Strict-Transport-Security: max-age=31536000; preload
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Frame-Options: SAMEORIGIN
X-Permitted-Cross-Domain-Policies: none
X-Robots-Tag: noindex, nofollow
X-Xss-Protection: 1; mode=block

2023/10/04 09:47:59 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/10/04 09:47:59 DEBUG : **************-1080p.mkv: Update will use the normal upload strategy (no chunks)
2023/10/04 09:48:50 INFO  : 
Transferred:              0 B / 7.841 GiB, 0%, 0 B/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:       1m0.1s
Transferring:
 *                   ******************-1080p.mkv:  0% /7.841Gi, 0/s, -

2023/10/04 09:49:51 INFO  : 
Transferred:              0 B / 7.841 GiB, 0%, 0 B/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:       2m0.4s
Transferring:
 *                   ******************-1080p.mkv:  0% /7.841Gi, 0/s, -

Killed

asdffdsa · October 4, 2023, 12:34pm

you are running an old version of rclone. can run rclone selfupdate

i did not see an error in the output you posted???

i would contact owncube, ask them about it.

M_R · October 4, 2023, 7:28pm

Really?

MOUNT -> Failed to copy: 413 Request Entity Too Large
COPY -> killed

But you can not see an error? Aha.
I asked Owncube and they told me there was no upload limit or problem. So I ended up here ...

asdffdsa · October 4, 2023, 7:56pm

well, yeah, i saw it, but at first, the error was a reply from the server.
now that we have all the addtional info.

so before we call this a bug, should update
rclone selfupdate

M_R · October 4, 2023, 8:10pm

ok i did the update to 1.64 now. Its exactly the same error.

And yes the Webinterface can handle the upload, and the offical owncloud client can handle the upload correct. Only RCLONE cant not upload files over 1GB or so, idk small files are working.

But web and official client can handle the upload correctly. Why not rclone?

Ok, web and the client dont use web DAV or?

asdffdsa · October 4, 2023, 8:12pm

good question.
as far as i know, there is no free cloud storage to test with?

Animosity022 · October 4, 2023, 8:14pm

Your config looks wrong compared to what's documented.

M_R · October 5, 2023, 8:05am

@Animosity022 , not sure what you mean but the URL works. Example is in the docs:
https://docs.nextcloud.com/server/27/user_manual/en/files/access_webdav.html

davs://example.com/nextcloud/remote.php/dav/files/USERNAME/

Okay wait, i try to combine all infos. Files over 1 GB can not be uploaded
Web upload => OK
OwnCloud Sync Client => OK
RClone mount => can only upload small files <1GB
RClone copy => can only upload small files <1GB

So here comes the question need the web dav code an update? In log we found this "Update will use the normal upload strategy (no chunks)" what does it mean? Perhaps we need small chunks to upload a big file?

HERE ARE A TEST ACC, can somebody test it pls? Upload files >1GB for test
https://send.bitwarden.com/#6cxqvMgKZ0awbLCSAITvyg/JpPh7ahipjdcETk0kGFQEQ
PW: rclone

Thanks

Animosity022 · October 5, 2023, 11:44am

In what docs? The rclone and owncube ones disagree.

asdffdsa · October 5, 2023, 1:32pm

please post a full debug log, showing rclone uploading a file smaller than 1GiB.

well, filezilla webdav client fails with same error as rclone
Response: HTTP/1.1 405 Method Not Allowed
and
Response: HTTP/1.1 413 Request Entity Too Large

M_R · October 5, 2023, 2:16pm

Here is the log for a successful uploaded small file with ~50mb.

2023/10/05 16:09:58 DEBUG : rclone: Version "v1.64.0" starting with parameters ["rclone" "mount" "owncube:/" "/home/dev/upload/mount/owncube" "--umask" "0" "--allow-other" "--dir-cache-time" "24h" "--attr-timeout" "6h" "--poll-interval" "30s" "--vfs-cache-max-age" "3h" "--vfs-cache-mode" "full" "--vfs-read-chunk-size" "64M" "--vfs-read-chunk-size-limit" "128M" "--vfs-cache-max-size" "15G" "--transfers" "4" "--allow-non-empty" "--log-file=/home/dev/.config/rclone/rclone.log" "-vv"]
2023/10/05 16:09:58 DEBUG : Creating backend with remote "owncube:/"
2023/10/05 16:09:58 DEBUG : Using config file from "/home/dev/.config/rclone/rclone.conf"
2023/10/05 16:09:58 DEBUG : found headers: 
2023/10/05 16:09:58 DEBUG : fs cache: renaming cache item "owncube:/" to be canonical "owncube:"
2023/10/05 16:09:58 INFO  : webdav root '': poll-interval is not supported by this remote

2023/10/05 16:10:53 DEBUG : /: Lookup: name="test.mkv"
2023/10/05 16:10:53 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/10/05 16:10:53 DEBUG : /: Lookup: name="test.mkv"
2023/10/05 16:10:53 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/10/05 16:10:53 DEBUG : /: Create: name="test.mkv"
2023/10/05 16:10:53 DEBUG : test.mkv: Open: flags=O_WRONLY|O_CREATE|O_TRUNC
2023/10/05 16:10:53 DEBUG : test.mkv: newRWFileHandle: 
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): openPending: 
2023/10/05 16:10:53 DEBUG : test.mkv: vfs cache: truncate to size=0 (not needed as size correct)
2023/10/05 16:10:53 DEBUG : : Added virtual directory entry vAddFile: "test.mkv"
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): >openPending: err=<nil>
2023/10/05 16:10:53 DEBUG : test.mkv: >newRWFileHandle: err=<nil>
2023/10/05 16:10:53 DEBUG : : Added virtual directory entry vAddFile: "test.mkv"
2023/10/05 16:10:53 DEBUG : test.mkv: >Open: fd=test.mkv (rw), err=<nil>
2023/10/05 16:10:53 DEBUG : /: >Create: node=test.mkv, handle=&{test.mkv (rw)}, err=<nil>
2023/10/05 16:10:53 DEBUG : test.mkv: Attr: 
2023/10/05 16:10:53 DEBUG : test.mkv: >Attr: a=valid=6h0m0s ino=0 size=0 mode=-rw-rw-rw-, err=<nil>
2023/10/05 16:10:53 DEBUG : test.mkv: Setattr: a=Setattr [ID=0xf0 Node=0x8 Uid=1000 Gid=1000 Pid=687369] mode=-rw-rw-r-- handle=INVALID-0x0
2023/10/05 16:10:53 DEBUG : test.mkv: >Setattr: err=<nil>
2023/10/05 16:10:53 DEBUG : test.mkv: Attr: 
2023/10/05 16:10:53 DEBUG : test.mkv: >Attr: a=valid=6h0m0s ino=0 size=0 mode=-rw-rw-rw-, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: Write: len=131072, offset=0
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): _writeAt: size=131072, off=0
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): >_writeAt: n=131072, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: >Write: written=131072, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: Write: len=131072, offset=131072
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): _writeAt: size=131072, off=131072
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): >_writeAt: n=131072, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: >Write: written=131072, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: Write: len=131072, offset=262144
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): _writeAt: size=131072, off=262144
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): >_writeAt: n=131072, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: >Write: written=131072, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: Write: len=131072, offset=393216
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): _writeAt: size=131072, off=393216
2023/10/05 16:10:53 DEBUG : test.mkv(0xc0010fd600): >_writeAt: n=131072, err=<nil>
2023/10/05 16:10:53 DEBUG : &{test.mkv (rw)}: >Write: written=131072, err=<nil>

..... cut

2023/10/05 16:11:00 DEBUG : test.mkv: vfs cache: starting upload
2023/10/05 16:11:00 DEBUG : test.mkv: Update will use the normal upload strategy (no chunks)
2023/10/05 16:11:05 DEBUG : test.mkv: Dst hash empty - aborting Src hash check
2023/10/05 16:11:05 INFO  : test.mkv: Copied (new)
2023/10/05 16:11:05 DEBUG : test.mkv: vfs cache: fingerprint now "57356967,2023-10-02 08:46:26 +0000 UTC,"
2023/10/05 16:11:05 DEBUG : test.mkv: vfs cache: writeback object to VFS layer
2023/10/05 16:11:05 DEBUG : test.mkv: Not setting pending mod time 2023-10-02 10:46:26.42 +0200 CEST as it is already set
2023/10/05 16:11:05 DEBUG : : Added virtual directory entry vAddFile: "test.mkv"
2023/10/05 16:11:05 INFO  : test.mkv: vfs cache: upload succeeded try #1

asdffdsa · October 5, 2023, 3:06pm

[rclone v1.63.0] remote Nextcloud not working after upgrade from 1.62.2 to 1.63.0 · Issue #7103 · rclone/rclone · GitHub
i believe the issue is that for for chunked uploads to nextcloud to work, the url must be formatted a certain way, which does not seem to work with owncube.

in the meantime, this worked for me

[owncube]
type = webdav
url = https://zork.owncube.cloud/remote.php/dav/files/admin
vendor = nextcloud
user = admin
pass = redacted

and in the debug log, would see

NOTICE: Chunks temporary upload directory: https://zork.owncube.cloud/remote.php/dav/uploads/admin/
DEBUG : file.ext: Need to transfer - File not found at Destination
DEBUG : file.ext: Update will use the chunked upload strategy
DEBUG : file.ext: sha1 = 9b18df3a1aa42522c18485bbcf6c66f13f44aebd OK
INFO  : file.ext: Copied (new)

M_R · October 5, 2023, 7:03pm

Owncube use Owncloud Version 27.0.2.
And the webinterface show me this WEBDAV url:

@asdffdsa so you think that rclone has an issue with the URL?

@ncw , could you check if here a small bugfix possible?

asdffdsa · October 5, 2023, 7:16pm

maybe. you wanted to copy a file larger than 1GiB to owncube, and i shared how to do that.

as for that grahpic you posted, i do not know that language???
tho i can tell you that 2FA is not the problem, as i enabled that after creating the account.