Can not install docker volume plugin: "layers from manifest don't match image configuration"

kforner · October 1, 2021, 5:15pm

What is the problem you are having with rclone?

I'm trying to install the rclone docker volume plugin, following the instructions from: Docker Volume Plugin

I did:

sudo apt-get -y install fuse
sudo mkdir -p /var/lib/docker-plugins/rclone/config
sudo mkdir -p /var/lib/docker-plugins/rclone/cache

But when I execute:

docker plugin install rclone/docker-volume-rclone args="-v" --alias rclone --grant-all-%permissions
# I get
latest: Pulling from rclone/docker-volume-rclone
06aea13629c4: Download complete 
layers from manifest don't match image configuration

I also tried adding the option --disable-content-trust with no success

What did I miss ?

versions

lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 20.04.3 LTS
Release:	20.04
Codename:	focal

docker version
Client: Docker Engine - Community
 Version:           19.03.5
 API version:       1.40
 Go version:        go1.12.12
 Git commit:        633a0ea838
 Built:             Wed Nov 13 07:29:52 2019
 OS/Arch:           linux/amd64
 Experimental:      false

Server: Docker Engine - Community
 Engine:
  Version:          19.03.5
  API version:      1.40 (minimum version 1.12)
  Go version:       go1.12.12
  Git commit:       633a0ea838
  Built:            Wed Nov 13 07:28:22 2019
  OS/Arch:          linux/amd64
  Experimental:     true
 containerd:
  Version:          1.2.10
  GitCommit:        b34a5c8af56e510852c35414db4c1f4fa6172339
 runc:
  Version:          1.0.0-rc8+dev
  GitCommit:        3e425f80a8c931f88e6d94a8c831b9d5aa481657
 docker-init:
  Version:          0.18.0
  GitCommit:        fec3683

rclone version
rclone v1.55.1
- os/type: linux
- os/arch: amd64
- go/version: go1.16.3
- go/linking: static
- go/tags: none

ivandeex · October 1, 2021, 9:12pm

Just tried. Works for me.

deex@vesta:~$ sudo apt-get -y install fuse      Reading package lists... Done
Building dependency tree                        Reading state information... Done
fuse is already the newest version (2.9.9-3).
0 upgraded, 0 newly installed, 0 to remove and 71 not upgraded.
deex@vesta:~$ sudo mkdir -p /var/lib/docker-plugins/rclone/config
deex@vesta:~$ sudo mkdir -p /var/lib/docker-plugins/rclone/cache
deex@vesta:~$ docker plugin install rclone/docker-volume-rclone args="-v" --alias rclone --grant-all-permissions
latest: Pulling from rclone/docker-volume-rcloneDigest: sha256:c60373a933a8a4087e29fcdde52ae6dbce7a0d1ab58d2053faffdd30a006e738
036caaf48c4a: Complete
Installed plugin rclone/docker-volume-rclone
deex@vesta:~$ docker version
Client: Docker Engine - Community
 Version:           20.10.8
 API version:       1.41
 Go version:        go1.16.6
 Git commit:        3967b7d
 Built:             Fri Jul 30 19:54:27 2021
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true
Server: Docker Engine - Community
 Engine:
  Version:          20.10.8
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.16.6
  Git commit:       75249d8
  Built:            Fri Jul 30 19:52:33 2021
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.4.9
  GitCommit:        e25210fe30a0a703442421b0f60afac609f950a3
 runc:
  Version:          1.0.1
  GitCommit:        v1.0.1-0-g4144b63
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
deex@vesta:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.2 LTS
Release:        20.04
Codename:       focal
deex@vesta:~$ uname -a
Linux vesta 5.4.0-80-generic #90-Ubuntu SMP Fri Jul 9 22:49:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
deex@vesta:~$ date
Sat 02 Oct 2021 12:13:32 AM MSK
deex@vesta:~$

kforner · October 11, 2021, 1:09pm

Just tried from an AWS ec2 instance, same error message:

sudo apt-get -y install fuse
sudo mkdir -p /var/lib/docker-plugins/rclone/config
sudo mkdir -p /var/lib/docker-plugins/rclone/cache
docker plugin install rclone/docker-volume-rclone args="-v" --alias rclone --grant-all-permissions
latest: Pulling from rclone/docker-volume-rclone
036caaf48c4a: Download complete 
layers from manifest don't match image configuration

So that's not just my local setup. Could it be the docker version ? Is there a prerequisite ?

versions:

$ lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 16.04.7 LTS
Release:	16.04
Codename:	xenial

$ docker version
Client: Docker Engine - Community
 Version:           19.03.8
 API version:       1.40
 Go version:        go1.12.17
 Git commit:        afacb8b7f0
 Built:             Wed Mar 11 01:25:58 2020
 OS/Arch:           linux/amd64
 Experimental:      false

Server: Docker Engine - Community
 Engine:
  Version:          19.03.8
  API version:      1.40 (minimum version 1.12)
  Go version:       go1.12.17
  Git commit:       afacb8b7f0
  Built:            Wed Mar 11 01:24:30 2020
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.2.13
  GitCommit:        7ad184331fa3e55e52b890ea95e65ba581ae3429
 runc:
  Version:          1.0.0-rc10
  GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
 docker-init:
  Version:          0.18.0
  GitCommit:        fec3683

ivandeex · October 11, 2021, 4:18pm

This is strange. I don't know what to do here...

Can you try docker plugin install ... with

ivandeex/docker-volume-rclone:amd64
ivandeex/docker-volume-rclone:latest

Maybe it helps?

ivandeex · October 11, 2021, 4:21pm

Do you see this problem on AWS only or globally?

Animosity022 · October 11, 2021, 4:25pm

i have a Mac with a fresh install of docker and had no messages with a pull. Worked fine for me.

kforner · October 11, 2021, 4:29pm

exact same error with

ivandeex/docker-volume-rclone:amd64
ivandeex/docker-volume-rclone:latest

Do you see this problem on AWS only or globally?

On AWS and on my local computer

I'll retry from virtual box for better reproducibility and so that I can easily change the docker version.
Thanks.

kforner · October 11, 2021, 5:23pm

Just reproduced my error using a fresh virtualbox:

grabbed and installed this image: Download OSB from SourceForge.net

docker install (version 5:19.03.9~3-0~ubuntu-focal):

sudo apt update 
sudo apt install apt-transport-https ca-certificates curl software-properties-common
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu focal stable"
  
sudo apt install docker-ce=5:19.03.9~3-0~ubuntu-focal

sudo apt-get -y install fuse
sudo mkdir -p /var/lib/docker-plugins/rclone/config
sudo mkdir -p /var/lib/docker-plugins/rclone/cache

$ docker plugin install rclone/docker-volume-rclone args="-v" --alias rclone --grant-all-permissions
latest: Pulling from rclone/docker-volume-rclone
036caaf48c4a: Download complete 
layers from manifest don't match image configuration

kforner · October 11, 2021, 5:35pm

works with latest docker version:

sudo apt install docker-ce=5:20.10.9~3-0~ubuntu-focal
$ docker plugin install rclone/docker-volume-rclone args="-v" --alias rclone --grant-all-permissions
latest: Pulling from rclone/docker-volume-rclone
Digest: sha256:c60373a933a8a4087e29fcdde52ae6dbce7a0d1ab58d2053faffdd30a006e738
036caaf48c4a: Complete 
Installed plugin rclone/docker-volume-rclone

Further attempts:

5:19.03.15~3-0~ubuntu-focal
5:19.03.14~3-0~ubuntu-focal

--> It requires docker >= 19.03.15
If this is expected, I guess the installation page should be updated with this prerequisite.

Animosity022 · October 11, 2021, 5:54pm

Is there a reason you are using an old version?

ivandeex · October 11, 2021, 10:52pm

Submitted

github.com/rclone/rclone

docs: note minimum supported docker engine

rclone:master ← ivandeex:pr-docker-minver

opened 10:51PM - 11 Oct 21 UTC

ivandeex

+2 -0

#### What is the purpose of this change? Note minimum supported Docker Engine… #### Was the change discussed in an issue or in the forum before? https://forum.rclone.org/t/can-not-install-docker-volume-plugin-layers-from-manifest-dont-match-image-configuration/26784/9 #### Checklist - [x] I have read the [contribution guidelines](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#submitting-a-pull-request). - [ ] I have added tests for all changes in this PR if appropriate. - [x] I have added documentation for the changes if appropriate. - [x] All commit messages are in [house style](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#commit-messages). - [x] I'm done, this Pull Request is ready for review :-)

ivandeex · October 11, 2021, 10:56pm

Thanks for investigating!

kforner · October 12, 2021, 7:48am

The plugin looks really awesome!

system · October 15, 2021, 7:48am

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.