How to combine On-the-fly HTTP+archive remote to list CRC32s in a HTTP-hosted ZIP?

Help and Support
1

What is the problem you are having with rclone?

I’m trying to use a HTTP remote and a archive remote, in order to list the CRC32s of the contents of a ZIP, which is hosted on a HTTP server.

Run the command 'rclone version' and share the full output of the command.

rclone v1.74.0

* os/version: Microsoft Windows 10 Enterprise 22H2 22H2 (64 bit)
* os/kernel: 10.0.19045.7184 (x86_64)
* os/type: windows
* os/arch: amd64
* go/version: go1.26.2
* go/linking: static
* go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

HTTP and Archive backends

The command you were trying to run (eg rclone copy /tmp remote:tmp)

I’ve tried a bunch of attempts at “on-the-fly remote” commands, but I’ve no idea which of them is most correct.

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

$ rclone config redacted
; empty config
### Double check the config for sensitive info before posting publicly

A log from the command that you were trying to run with the -vv flag

N/A

2

hi,

please post those commands.

3

Let's build up the command. First get the http part working

rclone lsf --http-url "https://downloads.rclone.org" :http:

Now let's add the archive backend

rclone lsf --http-url "https://downloads.rclone.org" :archive::http:

Now let's list one of those archives

$ rclone lsl --http-url "https://downloads.rclone.org" :archive::http:/rclone-current-windows-arm64.zip
  3731930 2026-05-01 15:58:17.000000000 rclone-v1.74.0-windows-arm64/README.html
  2927966 2026-05-01 15:58:17.000000000 rclone-v1.74.0-windows-arm64/README.txt
   108108 2026-05-01 16:09:06.000000000 rclone-v1.74.0-windows-arm64/git-log.txt
  3243716 2026-05-01 15:58:18.000000000 rclone-v1.74.0-windows-arm64/rclone.1
 72039936 2026-05-01 16:09:27.000000000 rclone-v1.74.0-windows-arm64/rclone.exe

And finally the crc32

$ rclone hashsum crc32 --http-url "https://downloads.rclone.org" :archive::http:/rclone-current-windows-arm64.zip
71231ad0  rclone-v1.74.0-windows-arm64/README.html
01fa40e5  rclone-v1.74.0-windows-arm64/README.txt
2f1f43a6  rclone-v1.74.0-windows-arm64/rclone.1
64239088  rclone-v1.74.0-windows-arm64/rclone.exe
ad8e7c03  rclone-v1.74.0-windows-arm64/git-log.txt

If you are a sucker for pushishment you can put the http-url in the remote like this

$ rclone hashsum crc32 ':archive::http,url="https://downloads.rclone.org":/rclone-current-windows-arm64.zip'
71231ad0  rclone-v1.74.0-windows-arm64/README.html
01fa40e5  rclone-v1.74.0-windows-arm64/README.txt
64239088  rclone-v1.74.0-windows-arm64/rclone.exe
2f1f43a6  rclone-v1.74.0-windows-arm64/rclone.1
ad8e7c03  rclone-v1.74.0-windows-arm64/git-log.txt

But you need to be careful with the quoting.

1 Like
4

hi ncw,
not sure i ever saw that syntax before, with the double-colon in the middle.
neither in the forum and in the documentation?

5

The :archive: takes a remote after it. In this case the remote is the :http: hence the double colon. It is unusual certainly!

6

Thanks, that works great. Although I can't get it to work with this URL. Maybe because there is no compatible HTTP file listing - its just a "standalone" file?

$ rclone hashsum crc32 --http-url "https://getsamplefiles.com" :archive::http:/download/zip/sample-1.zip
2026/05/07 22:08:53 ERROR : /: Dir.Stat error: error listing "": directory not found
2026/05/07 22:08:53 CRITICAL: Failed to create file system for ":archive::http:/download/zip/sample-
1.zip": failed to create archive "sample-1.zip": failed to find "sample-1.zip" archive: error listin
g "": directory not found

$ rclone hashsum crc32 --http-url "https://getsamplefiles.com/download/zip" :archive::http:/sample-1.zip --config ""
2026/05/07 22:08:55 CRITICAL: Failed to create file system for ":archive::http:/sample-1.zip": expec
ting to find a file at ":http:/sample-1.zip"
7

can you download that file using wget or curl?

8

Yes that is why it isn't working. There have been various proposals to make it work over the years but I don't think you can right now.

9

I see. I guess I should open a bug or feature request for that.

@asdffdsa Yeah it can be.

10

It almost works! Rclone HEADs the file to check it exists then lists the parent which isn't found.

Perhaps rclone should when pointed at a single file not bother listing the parent at all but return the info that it has got from the HEAD request. That would make it work.

That is not very hard and seems like a worthwhile improvement. Give this a go

v1.75.0-beta.9728.1221cb7af.fix-http-list on branch fix-http-list (uploaded in 15-30 mins)

$ rclone hashsum crc32 --http-url "https://getsamplefiles.com" :archive::http:/download/zip/sample-1.zip
4b70eac1  sample-1/sample-5.webp
7e44c9d7  sample-1/sample-1_1.webp
7e44c9d7  sample-1/sample-1.webp
ee29d087  sample-1/sample-5 (1).jpg
8177b49f  __MACOSX/sample-1/._sample-1.webp
0447ff07  __MACOSX/sample-1/._sample-5.webp
1ebf4b5b  __MACOSX/sample-1/._sample-5 (1).jpg
18a0336d  __MACOSX/sample-1/._sample-1_1.webp
1 Like
11

Thanks. That seems to work.

However it does not work for 7z and rar. Should it be able to support them, since the archive command does support them?

$ ./rclone.exe hashsum crc32 --http-url "https://getsamplefiles.com/" ':archive::http:/download/7z/sample-1.7z'
2026/05/10 05:08:54 ERROR : sample-1.7z: hash unsupported: hash type not supported
2026/05/10 05:08:54 NOTICE: Failed to hashsum with 2 errors: last error was: hash unsupported: hash
type not supported

$ ./rclone.exe hashsum crc32 --http-url "https://getsamplefiles.com/" ':archive::http:/download/rar/sample-1.rar'
2026/05/10 05:09:10 ERROR : sample-1.rar: hash unsupported: hash type not supported
2026/05/10 05:09:10 NOTICE: Failed to hashsum with 2 errors: last error was: hash unsupported: hash
type not supported