Chunker not working with idrive-e2

Hello.
I am trying to use "chunker" with a remote based on IDRIVE-E2.
The remote IDRIVE-E2 is working well, but i need to transfer very huge files (> 150Gib) and this is very difficult, So, to avoid to split them "by hand", i'm trying to use chunker.
But i got always the error:
Attempt n/3 failed with 1 errors and: can't setup transaction for

Plese note: the same "chunking" section works fine changing Idrive-e2 with Gdrive or Onedrive.

The output of rclone version is:

rclone v1.56.0
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.4.0-125-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.16.5
- go/linking: static
- go/tags: none

Server is a LUBUNTU:
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.4 LTS
Release:        20.04
Codename:       focal

As said, i am trying to use IDRIVE-E2, with a chunker overlay.
These are the rclone.conf contents:

type = s3
provider = IDrive
access_key_id = XXXXXX
secret_access_key = YYYYYY
endpoint = a0q0.ie.idrivee2-48.com
acl = private
bucket_acl = private
disable_checksum = true
no_check_bucket = true
no_head = true
no_head_object = true
disable_http2 = true

[chunking]
type = chunker
remote = IDRIVE-E2bis:gdrivebackup2
chunk_size = 200Mi
hash_type = none

And this is the output of a copy command for a small file (nothing changes using a big file, instead):

fabrizio@fabrizio-aspirev5123:~$ rclone -vv copy  prova.sh chunking:
2022/09/10 20:00:21 DEBUG : rclone: Version "v1.56.0" starting with parameters ["rclone" "-vv" "copy" "prova.sh" "chunking:"]
2022/09/10 20:00:21 DEBUG : Creating backend with remote "prova.sh"
2022/09/10 20:00:21 DEBUG : Using config file from "/home/fabrizio/.config/rclone/rclone.conf"
2022/09/10 20:00:21 DEBUG : fs cache: adding new entry for parent of "prova.sh", "/home/fabrizio"
2022/09/10 20:00:21 DEBUG : Creating backend with remote "chunking:"
2022/09/10 20:00:21 DEBUG : Creating backend with remote "IDRIVE-E2bis:gdrivebackup2"
2022/09/10 20:00:21 DEBUG : Reset feature "ListR"
2022/09/10 20:00:22 DEBUG : prova.sh: Sizes differ (src 75 vs dst 0)
2022/09/10 20:00:22 ERROR : prova.sh: Failed to copy: can't setup transaction for prova.sh
2022/09/10 20:00:22 ERROR : Attempt 1/3 failed with 1 errors and: can't setup transaction for prova.sh
2022/09/10 20:00:22 DEBUG : prova.sh: Sizes differ (src 75 vs dst 0)
2022/09/10 20:00:22 ERROR : prova.sh: Failed to copy: can't setup transaction for prova.sh
2022/09/10 20:00:22 ERROR : Attempt 2/3 failed with 1 errors and: can't setup transaction for prova.sh
2022/09/10 20:00:22 DEBUG : prova.sh: Sizes differ (src 75 vs dst 0)
2022/09/10 20:00:22 ERROR : prova.sh: Failed to copy: can't setup transaction for prova.sh
2022/09/10 20:00:22 ERROR : Attempt 3/3 failed with 1 errors and: can't setup transaction for prova.sh
2022/09/10 20:00:22 INFO  :
Transferred:              0 / 0 Byte, -, 0 Byte/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.9s

2022/09/10 20:00:22 DEBUG : 6 go routines active
2022/09/10 20:00:22 Failed to copy: can't setup transaction for prova.sh

I tried to change the bucket name, using also fake names: the error is always the same.
Do you have any suggestion?

Tnx in advance

hello and welcome to the forum,

please update to latest stable v1.59.1 and test again
https://rclone.org/downloads/#script-download-and-install

Thank you for your suggestion, but it didnt work.

Now the version is updated but the error remains:

fabrizio@fabrizio-aspirev5123:~$ rclone version
rclone v1.59.1
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.4.0-125-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.18.5
- go/linking: static
- go/tags: none

This is the execution log:

fabrizio@fabrizio-aspirev5123:~$ rclone -vv copy prova.sh chunking:
2022/09/10 21:24:12 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "-vv" "copy" "prova.sh" "chunking:"]
2022/09/10 21:24:12 DEBUG : Creating backend with remote "prova.sh"
2022/09/10 21:24:12 DEBUG : Using config file from "/home/fabrizio/.config/rclone/rclone.conf"
2022/09/10 21:24:12 DEBUG : fs cache: adding new entry for parent of "prova.sh", "/home/fabrizio"
2022/09/10 21:24:12 DEBUG : Creating backend with remote "chunking:"
2022/09/10 21:24:12 DEBUG : Creating backend with remote "IDRIVE-E2bis:gdrivebackup2"
2022/09/10 21:24:12 DEBUG : Reset feature "ListR"
2022/09/10 21:24:13 DEBUG : prova.sh: Sizes differ (src 75 vs dst 0)
2022/09/10 21:24:13 ERROR : prova.sh: Failed to copy: can't setup transaction for prova.sh
2022/09/10 21:24:13 ERROR : Attempt 1/3 failed with 1 errors and: can't setup transaction for prova.sh
2022/09/10 21:24:13 DEBUG : prova.sh: Sizes differ (src 75 vs dst 0)
2022/09/10 21:24:13 ERROR : prova.sh: Failed to copy: can't setup transaction for prova.sh
2022/09/10 21:24:13 ERROR : Attempt 2/3 failed with 1 errors and: can't setup transaction for prova.sh
2022/09/10 21:24:13 DEBUG : prova.sh: Sizes differ (src 75 vs dst 0)
2022/09/10 21:24:13 ERROR : prova.sh: Failed to copy: can't setup transaction for prova.sh
2022/09/10 21:24:13 ERROR : Attempt 3/3 failed with 1 errors and: can't setup transaction for prova.sh
2022/09/10 21:24:13 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.4s

2022/09/10 21:24:13 DEBUG : 5 go routines active

might try removing these

disable_checksum = true
no_check_bucket = true
no_head = true
no_head_object = true
disable_http2 = true

WORKED!

Tnx so much!
These rows were a "workaround" because the first bucket i tried was encrypted and the metadata altered the final file size on the Remote so there were always error (in size and md5). But now are unuseful and i forgot about them

Regards.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.