Icedrive WebDAV connects but doen't work

wallart1 · January 3, 2023, 12:44am

What is the problem you are having with rclone?

First time using Icedrive with rclone. Have been successfully using Dropbox with rclone for some time.

Icedrive works beautifully on their website. I've uploaded a few files this way.
Screenshot from 2023-01-02 19-34-52

Now I want to get rclone to work with it by using WebDAV. I can connect via WebDAV. But, doing anything else fails. For example:

oot@uploads:/home/dan# rclone -vv ls icedrive:rclone
2023/01/02 19:18:36 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "-vv" "ls" "icedrive:rclone"]
2023/01/02 19:18:36 DEBUG : Creating backend with remote "icedrive:rclone"
2023/01/02 19:18:36 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/01/02 19:18:36 DEBUG : found headers: 
2023/01/02 19:18:37 DEBUG : pacer: low level retry 1/10 (error EOF)
2023/01/02 19:18:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2023/01/02 19:18:37 DEBUG : pacer: low level retry 2/10 (error EOF)
2023/01/02 19:18:37 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2023/01/02 19:18:37 DEBUG : pacer: low level retry 3/10 (error EOF)
2023/01/02 19:18:37 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2023/01/02 19:18:37 DEBUG : pacer: Reducing sleep to 60ms
2023/01/02 19:18:37 DEBUG : pacer: low level retry 1/10 (error EOF)
2023/01/02 19:18:37 DEBUG : pacer: Rate limited, increasing sleep to 120ms
2023/01/02 19:18:37 DEBUG : pacer: Reducing sleep to 90ms
2023/01/02 19:18:37 DEBUG : 4 go routines active
root@uploads:/home/dan#

Run the command 'rclone version' and share the full output of the command.

root@uploads:/home/dan# rclone version
rclone v1.61.1

os/version: linuxmint 20.3 (64 bit)
os/kernel: 5.4.0-135-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.19.4
go/linking: static
go/tags: none
root@uploads:/home/dan#

Are you on the latest version of rclone? You can validate by checking the version listed here: Rclone downloads
--> Yes. I downloaded it today.

Which cloud storage system are you using? (eg Google Drive)

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

Please see the problem description, above.

The rclone config contents with secrets removed.

[DBencrypted]
type = crypt
remote = Dropbox:
password = <removed>
password2 = <removed>
batch_mode = async
batch_size = 0
links = true

[DBencryptedChunker]
type = chunker
remote = DBencrypted:
chunk_size = 10G
batch_mode = sync
batch_size = 0
links = true

[Dropbox]
type = dropbox
token = {"access_token":"<removed>","token_type":"bearer","refresh_token":"<removed>","expiry":"2022-11-14T15:29:44.19948959-05:00"}
batch_mode = sync
batch_size = 0
links = true
client_id = <removed>
client_secret = <removed>
chunk_size = 150Mi
batch_timeout = 3s
batch_commit_timeout = 5m0s

[icedrive]
type = webdav
url = https://webdav.icedrive.io
vendor = other
user = danvondra@protonmail.com
pass = <removed>

A log from the command with the `-vv` flag

Please see the problem description, above.

Animosity022 · January 3, 2023, 3:54am

Does this make apply?

ncw · January 3, 2023, 9:26am

If the above doesn't help, then try

rclone -vv lsf icedrive:rclone --dump bodies --retries 1 --low-level-retries 1

And post the result.

wallart1 · January 3, 2023, 2:16pm

root@uploads:/home/dan# rclone -vv lsf icedrive:rclone --dump bodies --retries 1 --low-level-retries 1
2023/01/03 09:13:06 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "-vv" "lsf" "icedrive:rclone" "--dump" "bodies" "--retries" "1" "--low-level-retries" "1"]
2023/01/03 09:13:06 DEBUG : Creating backend with remote "icedrive:rclone"
2023/01/03 09:13:06 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/01/03 09:13:06 DEBUG : found headers: 
2023/01/03 09:13:06 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/01/03 09:13:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/01/03 09:13:06 DEBUG : HTTP REQUEST (req 0xc0008f8c00)
2023/01/03 09:13:06 DEBUG : PROPFIND /rclone HTTP/1.1
Host: webdav.icedrive.io
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 1
Referer: https://webdav.icedrive.io/
Accept-Encoding: gzip

2023/01/03 09:13:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/01/03 09:13:09 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/01/03 09:13:09 DEBUG : HTTP RESPONSE (req 0xc0008f8c00)
2023/01/03 09:13:09 DEBUG : HTTP/1.1 200 OK
Content-Type: text/html; charset=UTF-8
Date: Tue, 03 Jan 2023 14:13:09 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_fcgid/2.3.9 PHP/7.3.32
X-Powered-By: PHP/7.3.32
Content-Length: 0

2023/01/03 09:13:09 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/01/03 09:13:09 DEBUG : pacer: low level retry 1/1 (error EOF)
2023/01/03 09:13:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2023/01/03 09:13:09 Failed to create file system for "icedrive:rclone": read metadata failed: EOF
root@uploads:/home/dan#

paolocalosso · January 3, 2023, 2:22pm

hello, it's a couple of days that the same thing happens to me. i used rclone to sync pcloud with icedrive: everything worked properly until yesterday then the same error of wallart1 started

i just tried the command suggested by ncw and here is the output:

2023/01/03 15:20:31 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "-vv" "lsf" "icedrive-webdav:pCloud/" "--dump" "bodies" "--retries" "1" "--low-level-retries" "1"]
2023/01/03 15:20:31 DEBUG : Creating backend with remote "icedrive-webdav:pCloud/"
2023/01/03 15:20:31 DEBUG : Using config file from "/home/oprsrv/.config/rclone/rclone.conf"
2023/01/03 15:20:31 DEBUG : found headers: 
2023/01/03 15:20:31 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/01/03 15:20:31 DEBUG : fs cache: renaming cache item "icedrive-webdav:pCloud/" to be canonical "icedrive-webdav:pCloud"
2023/01/03 15:20:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/01/03 15:20:31 DEBUG : HTTP REQUEST (req 0xc00003c300)
2023/01/03 15:20:31 DEBUG : PROPFIND /pCloud/ HTTP/1.1
Host: webdav.icedrive.io
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 1
Referer: https://webdav.icedrive.io/
Accept-Encoding: gzip

2023/01/03 15:20:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/01/03 15:20:32 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/01/03 15:20:32 DEBUG : HTTP RESPONSE (req 0xc00003c300)
2023/01/03 15:20:32 DEBUG : HTTP/1.1 200 OK
Content-Type: text/html; charset=UTF-8
Date: Tue, 03 Jan 2023 14:20:32 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_fcgid/2.3.9 PHP/7.3.32
X-Powered-By: PHP/7.3.32
Content-Length: 0

2023/01/03 15:20:32 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/01/03 15:20:32 DEBUG : pacer: low level retry 1/1 (error EOF)
2023/01/03 15:20:32 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2023/01/03 15:20:32 ERROR : : error listing: couldn't list files: EOF
2023/01/03 15:20:32 DEBUG : 4 go routines active
2023/01/03 15:20:32 Failed to lsf with 2 errors: last error was: error in ListJSON: couldn't list files: EOF

ncw · January 3, 2023, 3:08pm

This looks like a bug in the provider.

Rclone sent

2023/01/03 09:13:06 DEBUG : PROPFIND /rclone HTTP/1.1
Host: webdav.icedrive.io
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 1
Referer: https://webdav.icedrive.io/
Accept-Encoding: gzip

But the reply was an empty 200 OK response

2023/01/03 09:13:09 DEBUG : HTTP/1.1 200 OK
Content-Type: text/html; charset=UTF-8
Date: Tue, 03 Jan 2023 14:13:09 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_fcgid/2.3.9 PHP/7.3.32
X-Powered-By: PHP/7.3.32
Content-Length: 0

This should have had info about the /rclone path, or been an error, eg 404 - I don't think just an empty 200 response is valid webDAV protocol.

wallart1 · January 5, 2023, 5:34am

I did finally get an acknowledgement from Icedrive.net that they are having problems with webDAV. It's their only API. It's useless to me now. An annual subscription down the drain.

minesheep · January 6, 2023, 8:19pm

Today I tried running rclone lsd icedrive: a few times in a row ( with and without some debug options). Some of the tries failed and some succeeded after some retries like this `rclone lsd -vv icedrive:
2023/01/06 22:00:09 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "lsd" "-vv" "icedrive:"]
2023/01/06 22:00:09 DEBUG : Creating backend with remote "icedrive:"
2023/01/06 22:00:09 DEBUG : Using config file from "/home/username/.config/rclone/rclone.conf"
2023/01/06 22:00:09 DEBUG : found headers:
2023/01/06 22:00:10 DEBUG : pacer: low level retry 1/10 (error EOF)
2023/01/06 22:00:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2023/01/06 22:00:10 DEBUG : pacer: low level retry 2/10 (error EOF)
2023/01/06 22:00:10 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2023/01/06 22:00:10 DEBUG : pacer: low level retry 3/10 (error EOF)
2023/01/06 22:00:10 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2023/01/06 22:00:10 DEBUG : pacer: low level retry 4/10 (error EOF)
2023/01/06 22:00:10 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2023/01/06 22:00:10 DEBUG : pacer: low level retry 5/10 (error EOF)
2023/01/06 22:00:10 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2023/01/06 22:00:10 DEBUG : pacer: Reducing sleep to 240ms
-1 2022-01-29 20:03:36 -1 Keepass
-1 2022-12-03 20:56:47 -1 archive late 2022
-1 2022-12-03 20:33:29 -1 backups late 2022
-1 2022-02-12 16:48:17 -1 secure2
-1 2022-02-10 18:46:49 -1 test
-1 2022-02-04 15:36:15 -1 old files
2023/01/06 22:00:10 DEBUG : 4 go routines active

but yeah icedrives webdav have never been reliable for me. previous problems include misconfiguration errors after starting large transfers. these resolves automatically by waiting. I know it is too late for you but if you want reliable connection to your cloud storage with rclone then do not choose icedrive

wallart1 · January 6, 2023, 9:45pm

Definitely a case of getting what you pay for. I've moved on, but also working on a refund.

Best prices seem to be $5/TB/mo. Anything less is asking for trouble.

system · January 9, 2023, 9:45pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.