Failed to sync format&jsonlimit=1000 unsupported protocol sheme

martoni35 · August 2, 2021, 2:02pm

Hello,

What is the problem you are having with rclone?

I use rclone 1.56.0 on debian 11 with swissbackup.
With debian 10, everything was OK.
Since my migration between debian 10 => debian 11, rclone is failed with this message :

Failed to sync format&jsonlimit=1000 unsupported protocol sheme

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone sync /var/lib/vz/dump/ sb_project_SBI-XXXXXXXX:default --progress --log-level INFO

Could you help me ?

Martoni

asdffdsa · August 2, 2021, 2:06pm

hello and welcome to the forum,

can you please post the config file - redact id/secrets

and for the command, make these changes and then upload rclone.log

remove --log-level INFO
add --dump=bodies --retries=1 --low-level-retries=1 --log-level=DEBUG --log-file=rclone.log

Ole · August 2, 2021, 2:45pm

Also, you can most likely narrow down the issue and size of the log file by just executing this command:

rclone lsd sb_project_SBI-XXXXXXXX:default

Note the --dump bodies option may write sensitive info (like tokens) in your log file - please redact before posting.

martoni35 · August 2, 2021, 3:38pm

Hello

root@proxmox:~# rclone lsd sb_project_SBI-SM491622:default
2021/08/02 17:37:13 ERROR : : error listing: Get "../default?delimiter=%2F&format=json&limit=1000": unsupported protocol scheme ""
2021/08/02 17:37:13 Failed to lsd with 2 errors: last error was: Get "../default?delimiter=%2F&format=json&limit=1000": unsupported protocol scheme ""

martoni35 · August 2, 2021, 3:43pm

Hello,

root@proxmox:~# rclone sync /var/lib/vz/dump/ sb_project_SBI-SM491622:default --progress --dump bodies --retries 1 --low-level-retries 1 --log-level DEBUG --log-file rclone.log
Transferred:              0 / 0 Byte, -, 0 Byte/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.6s

root@proxmox:~# cat rclone.log 
2021/08/02 17:39:22 DEBUG : rclone: Version "v1.56.0" starting with parameters ["rclone" "sync" "/var/lib/vz/dump/" "sb_project_SBI-SM491622:default" "--progress" "--dump" "bodies" "--retries" "1" "--low-level-retries" "1" "--log-level" "DEBUG" "--log-file" "rclone.log"]
2021/08/02 17:39:22 DEBUG : Creating backend with remote "/var/lib/vz/dump/"
2021/08/02 17:39:22 DEBUG : Using config file from "/root/.rclone.conf"
2021/08/02 17:39:22 DEBUG : Creating backend with remote "sb_project_SBI-SM491622:default"
2021/08/02 17:39:22 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2021/08/02 17:39:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:22 DEBUG : HTTP REQUEST (req 0xc000483b00)
2021/08/02 17:39:22 DEBUG : POST /identity/v3/auth/tokens HTTP/1.1
Host: swiss-backup02.infomaniak.com
User-Agent: rclone/v1.56.0
Content-Length: 227
Content-Type: application/json
Accept-Encoding: gzip


2021/08/02 17:39:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : HTTP RESPONSE (req 0xc000483b00)
2021/08/02 17:39:23 DEBUG : HTTP/1.1 201 CREATED
Connection: close
Content-Type: application/json
Strict-Transport-Security: max-age=63072000
Vary: X-Auth-Token
X-Openstack-Request-Id: req-1d776080-1ce9-4d6e-86e8-53af42444e7a

2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : HTTP REQUEST (req 0xc000482700)
2021/08/02 17:39:23 DEBUG : 
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : HTTP RESPONSE (req 0xc000482700)
2021/08/02 17:39:23 DEBUG : Error: unsupported protocol scheme ""
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : HTTP REQUEST (req 0xc000482900)
2021/08/02 17:39:23 DEBUG : 
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : HTTP RESPONSE (req 0xc000482900)
2021/08/02 17:39:23 DEBUG : Error: unsupported protocol scheme ""
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : HTTP REQUEST (req 0xc000482a00)
2021/08/02 17:39:23 DEBUG : 
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : HTTP RESPONSE (req 0xc000482a00)
2021/08/02 17:39:23 DEBUG : Error: unsupported protocol scheme ""
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : HTTP REQUEST (req 0xc000482b00)
2021/08/02 17:39:23 DEBUG : 
2021/08/02 17:39:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 DEBUG : HTTP RESPONSE (req 0xc000482b00)
2021/08/02 17:39:23 DEBUG : Error: unsupported protocol scheme ""
2021/08/02 17:39:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/08/02 17:39:23 ERROR : Swift container default: error reading destination root directory: Get "../default?delimiter=%2F&format=json&limit=1000": unsupported protocol scheme ""
2021/08/02 17:39:23 DEBUG : Swift container default: Waiting for checks to finish
2021/08/02 17:39:23 DEBUG : Swift container default: Waiting for transfers to finish
2021/08/02 17:39:23 ERROR : Swift container default: not deleting files as there were IO errors
2021/08/02 17:39:23 ERROR : Swift container default: not deleting directories as there were IO errors
2021/08/02 17:39:23 ERROR : Attempt 1/1 failed with 1 errors and: Get "../default?delimiter=%2F&format=json&limit=1000": unsupported protocol scheme ""
2021/08/02 17:39:23 INFO  : 
Transferred:   	          0 / 0 Byte, -, 0 Byte/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.5s

2021/08/02 17:39:23 DEBUG : 2 go routines active
2021/08/02 17:39:23 Failed to sync: Get "../default?delimiter=%2F&format=json&limit=1000": unsupported protocol scheme ""

Ole · August 2, 2021, 3:49pm

Great, we have a simple issue (lsd) to work with

Also, please post your config - it is the output from this:

rclone config show sb_project_SBI-SM491622:

Important: redact any sensitive info like user, password, token, etc.

martoni35 · August 2, 2021, 3:51pm

Hello,

root@proxmox:~# rclone config show sb_project_SBI-SM491622:
--------------------
[sb_project_SBI-SM491622]
type = swift
user = 
key = 
auth = https://swiss-backup02.infomaniak.com/identity/v3
domain = default
tenant = sb_project_SBI-SM491622
tenant_domain = default
region = RegionOne
storage_url = ..
auth_version = 
--------------------

Ole · August 2, 2021, 4:27pm

Hmm, difficult, looking for a good starting point to narrow it further down...

Do you by any chance have a possibility to compare your config to your old (well functioning) setup?
What rclone version were your using in your old setup?
Would it be easy for you to downgrade rclone (to 1.55.1 or your previous version)?

Also please verify your current version with:

./rclone version -vv

martoni35 · August 2, 2021, 4:30pm

Hello,

It's not possible to rollback in my old config...I didn't know also the rclone version on my old debian 10.
I think it's possible to downgrade if i find the good repository or .deb

root@proxmox:~# rclone version -vv
2021/08/02 18:28:09 DEBUG : rclone: Version "v1.56.0" starting with parameters ["rclone" "version" "-vv"]
rclone v1.56.0
- os/version: debian 11.0 (64 bit)
- os/kernel: 5.11.22-2-pve (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.16.5
- go/linking: static
- go/tags: none
2021/08/02 18:28:09 DEBUG : rclone: Version "v1.56.0" finishing with parameters ["rclone" "version" "-vv"]

Ole · August 2, 2021, 6:21pm

Sorry, but this sounds weird to me.

You are using SwissBackup, but you do not have a backup of the software and settings to restore your backup (that is your old well-functioning rclone executable and the config used to make the backup).

Is this correct?

martoni35 · August 3, 2021, 6:50am

Hello,

Yes, i'm using SwissBackup to test their products. But, i backup only some proxmox files witch are some VMs files.
I tried to downgrade in 1.53 but it's the same error....

I think that i will stay with my first option witch is working successfully, rsync....

Ole · August 3, 2021, 7:58am

OK, then I suspect the issue has something to do with your configuration of the remote.

I can see that your configuration is slightly different from the example proposed by SwissBackup

Are the variations in auth and storage_url intentional and correct?

What happens if you use the values proposed by SwissBackup?

martoni35 · August 3, 2021, 8:31am

Hello

Well done because i reconfigure SwissBackup and i kept this two points for storage_url.

Without this, everything is all right !!! Sorry for this mistake....

This request could be close

Thx all

Martoni

system · August 6, 2021, 8:31am

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.

Failed to sync format&jsonlimit=1000 unsupported protocol sheme

What is the problem you are having with rclone?

The command you were trying to run (eg rclone copy /tmp remote:tmp)

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)