Error "invalid header" while copying zip-file

Help and Support
1

Hallo,
this is my firtst posting, I am getting the following error.

Error appears after updating rclone to the actual version last weekend

What is the problem you are having with rclone?

I am trying to copy several zip-files from one FTP to an other FTP

Run the command 'rclone version' and share the full output of the command.

rclone v1.68.1

  • os/version: oracle 8.6 (64 bit)
  • os/kernel: 5.4.17-2136.311.6.1.el8uek.x86_64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.23.1
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

1 FTP storage at 1blu germany
2 webdav Storage - IONOS Highdrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy 1bluftp:/backups/ ionoswebdav:/users/myname/backups/

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[1bluftp]
type = ftp
host = XXX
user = XXX
pass = XXX

[ionoswebdav]
type = webdav
url = https://webdav.hidrive.ionos.com/
vendor = other
user = XXX
pass = XXX

A log from the command that you were trying to run with the -vv flag

2024/10/16 14:57:34 ERROR : mmc-tickets/backup_2024-10-16-0124_Tickets_MMCBerlincom_7416d5125a23-db.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:34 ERROR : datenbanken/mendelflohmarkt/db297463x3349024_2024_10_15_04_35.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:35 ERROR : mmc-berlin/backup_2024-10-14-0430_MMCBerlincom_0fe78e1faa63-db.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:35 ERROR : datenbanken/mendelflohmarkt/db297463x3349024_2024_10_14_06_47.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:36 ERROR : datenbanken/mmc-helfer/db297463x3616122_2024_10_13_04_15.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:38 ERROR : datenbanken/mmc-helfer/db297463x3616122_2024_10_14_04_15.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:38 ERROR : datenbanken/mmc-ticketsystem/db297463x3405886_2024_10_14_04_25.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:39 ERROR : datenbanken/mmc-helfer/db297463x3616122_2024_10_15_04_15.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:40 ERROR : datenbanken/mmc-umfrage/db297463x3482340_2024_10_14_04_30.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:40 ERROR : datenbanken/mmc-cloud/db297463x3485266_2024_10_13_04_10.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:41 ERROR : datenbanken/mmc-cloud/db297463x3485266_2024_10_15_04_10.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:44 ERROR : datenbanken/mmc-hp/dbs11260443_2024_10_13_04_05.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:44 ERROR : datenbanken/mmc-ticketsystem/db297463x3405886_2024_10_15_04_25.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:44 ERROR : datenbanken/mmc-hp/dbs11260443_2024_10_14_04_05.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:44 ERROR : datenbanken/mmc-ticketsystem/db297463x3405886_2024_10_13_04_25.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:46 ERROR : datenbanken/mmc-tickets/dbs12269151_2024_10_14_04_20.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:47 ERROR : datenbanken/mmc-tickets/dbs12269151_2024_10_15_04_20.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:47 ERROR : datenbanken/mmc-hp/dbs5885269_2024_10_15_08_46.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:47 ERROR : datenbanken/mmc-hp/dbs11260443_2024_10_15_04_05.sql.gz: Failed to copy: gzip: invalid header
2024/10/16 14:57:47 ERROR : Attempt 1/3 failed with 19 errors and: gzip: invalid header
2

welcome to the forum,

what you posted is ftp to webdav, not ftp to ftp ??

maybe try --no-gzip-encoding

if that does not help, then as a test
please copy just one single file .gz using -vv --retries=1 and post the full output.

also, another test, pick for one .gz file, see if the issue is ftp or webdav?

  1. download file from source to local
  2. upload file from local to webdav
3

Thanx for the fast answer.

  1. That was my fault, I am copying from FTP zu webdav
  2. This is working for me, great!
    I am trying to understand why this is needed after update rclone, was there a change?

Thanx

4

welcome

great! but i would confirm the file copy was good.
pick one file, check the hash on the source and dest

what version were you running before update?

5

FYI

It looks like indeed something changed affecting gzip content transfers.

6

I don't think that issue is related as it is to an S3 backend, but I could be wrong!

I would like to see a single file copied with -vv with working and non working rclone to see if we can see the difference.

Might have to add --dump headers too

7

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.