Multipart upload error if nginx/proxy_cache enabled (There were headers present in the request which were not signed)

emanuelev · June 3, 2021, 2:38pm

Hi All,

I'm making some test running an object storage server MinIO behind an nginx reverse proxy with proxy_cache directive enabled and making some test of copy files from my pc to/from server with rclone.

Using browser(s) copy to/from storage goes well.

Unfortunately I have this errors with rclone multipart upload/download (filesize > 256M for downloads and filesize > 5M for uploads)

E.g. (copy 1G file from storage to my local dir .):

rclone -vvv copy myserver:test/test.1G .
2021/06/03 15:53:56 DEBUG : Using config file from "/home/user/.config/rclone/rclone.conf"
2021/06/03 15:53:56 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "-vvv" "copy" "myserver:test/test.1G" "."]
2021/06/03 15:53:56 DEBUG : Creating backend with remote "myserver:test/test.1G"
2021/06/03 15:53:56 DEBUG : fs cache: adding new entry for parent of "myserver:test/test.1G", "myserver:test"
2021/06/03 15:53:56 DEBUG : Creating backend with remote "."
2021/06/03 15:53:56 DEBUG : fs cache: renaming cache item "." to be canonical "/home/user/testdir"
2021/06/03 15:53:56 DEBUG : test.1G: Need to transfer - File not found at Destination
2021/06/03 15:53:56 DEBUG : test.1G: Starting multi-thread copy with 4 parts of size 256M
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 4/4 (805306368-1073741824) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 2/4 (268435456-536870912) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 1/4 (0-268435456) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 3/4 (536870912-805306368) size 256M starting
**2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 4/4 failed: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed**
**        status code: 400, request id: 168516EA17107E57, host id:**
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 1/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 3/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 2/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 ERROR : test.1G: Failed to copy: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA17107E57, host id:
2021/06/03 15:53:56 ERROR : Attempt 1/3 failed with 1 errors and: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA17107E57, host id:
2021/06/03 15:53:56 DEBUG : test.1G: Sizes differ (src 1073741824 vs dst 0)
2021/06/03 15:53:56 DEBUG : test.1G: Starting multi-thread copy with 4 parts of size 256M
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 4/4 (805306368-1073741824) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 3/4 (536870912-805306368) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 2/4 (268435456-536870912) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 1/4 (0-268435456) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 4/4 failed: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA18D7B402, host id:
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 1/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 3/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 2/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 ERROR : test.1G: Failed to copy: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA18D7B402, host id:
2021/06/03 15:53:56 ERROR : Attempt 2/3 failed with 1 errors and: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA18D7B402, host id:
2021/06/03 15:53:56 DEBUG : test.1G: Sizes differ (src 1073741824 vs dst 0)
2021/06/03 15:53:56 DEBUG : test.1G: Starting multi-thread copy with 4 parts of size 256M
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 4/4 (805306368-1073741824) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 1/4 (0-268435456) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 3/4 (536870912-805306368) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 2/4 (268435456-536870912) size 256M starting
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 4/4 failed: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA19B9A508, host id:
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 1/4 failed: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA19B53474, host id:
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 3/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 DEBUG : test.1G: multi-thread copy: stream 2/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 15:53:56 ERROR : test.1G: Failed to copy: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA19B9A508, host id:
2021/06/03 15:53:56 ERROR : Attempt 3/3 failed with 1 errors and: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 168516EA19B9A508, host id:
2021/06/03 15:53:56 INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.1s

My rclone version:

rclone -V
rclone v1.55.1
- os/type: linux
- os/arch: amd64
- go/version: go1.16.3
- go/linking: static
- go/tags: none

Rclone config

[myserver]
type = s3
provider = Minio
env_auth = false
access_key_id = *******
secret_access_key = *********
endpoint = https://myserver.test.it
acl = private

[node1]
type = s3
provider = Minio
env_auth = false
access_key_id = *******
secret_access_key = *********
endpoint = https://node1.test.it:9000
acl = private

NOTE: when I bypass nginx and point directly to a one minio cluster node (e.g. rclone -vvv copy node1: test / test.1G.) the file copy goes well. Do you know if there is some issue about interaction rclone / nginx / minio related to this strange error "There were headers present in the request which were not signed" ?

Thanks for support

asdffdsa · June 3, 2021, 2:44pm

hello and welcome to the forum,

that debug log is incomplete, as it missing the top lines, which contain the exact command and other important info.

and to get more details, try to copy a single file and add this to the command.
--dump bodies --retries 1 --low-level-retries 1 --log-level=DEBUG --log-file rclone.log

emanuelev · June 3, 2021, 3:30pm

OK, here you are.


2021/06/03 17:22:37 DEBUG : Using config file from "/home/user/.config/rclone/rclone.conf"
2021/06/03 17:22:37 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "copy" "myserver:test/test.1G" "." "--dump" "bodies" "--retries" "1" "--low-level-retries" "1" "--log-level=DEBUG" "--log-file" "rclone.log"]
2021/06/03 17:22:37 DEBUG : Creating backend with remote "myserver:test/test.1G"
2021/06/03 17:22:37 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : HTTP REQUEST (req 0xc0007fe100)
2021/06/03 17:22:37 DEBUG : HEAD /test/test.1G HTTP/1.1
Host: myserver.test.it
User-Agent: rclone/v1.55.1
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20210603T152237Z

2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : HTTP RESPONSE (req 0xc0007fe100)
2021/06/03 17:22:37 DEBUG : HTTP/1.1 200 OK
Content-Length: 1073741824
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: application/octet-stream
Date: Thu, 03 Jun 2021 15:22:35 GMT
Etag: "1166536d96dad5668f11b58b07900191-205"
Last-Modified: Thu, 03 Jun 2021 12:45:35 GMT
Server: nginx/1.14.1
Vary: Origin
X-Amz-Meta-Md5chksum: WPQ7iUB1HNuIMZ2zwDoEaQ==
X-Amz-Meta-Mtime: 1622724301.879083838
X-Amz-Request-Id: 16851BC0FEE7A3FC
X-Xss-Protection: 1; mode=block

2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : fs cache: adding new entry for parent of "myserver:test/test.1G", "myserver:test"
2021/06/03 17:22:37 DEBUG : Creating backend with remote "."
2021/06/03 17:22:37 DEBUG : fs cache: renaming cache item "." to be canonical "/home/user/testdir"
2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : HTTP REQUEST (req 0xc00057c300)
2021/06/03 17:22:37 DEBUG : HEAD /test/test.1G HTTP/1.1
Host: myserver.test.it
User-Agent: rclone/v1.55.1
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20210603T152237Z

2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : HTTP RESPONSE (req 0xc00057c300)
2021/06/03 17:22:37 DEBUG : HTTP/1.1 200 OK
Content-Length: 1073741824
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: application/octet-stream
Date: Thu, 03 Jun 2021 15:22:35 GMT
Etag: "1166536d96dad5668f11b58b07900191-205"
Last-Modified: Thu, 03 Jun 2021 12:45:35 GMT
Server: nginx/1.14.1
Vary: Origin
X-Amz-Meta-Md5chksum: WPQ7iUB1HNuIMZ2zwDoEaQ==
X-Amz-Meta-Mtime: 1622724301.879083838
X-Amz-Request-Id: 16851BC0FF41048A
X-Xss-Protection: 1; mode=block

2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : test.1G: Need to transfer - File not found at Destination
2021/06/03 17:22:37 DEBUG : test.1G: Starting multi-thread copy with 4 parts of size 256M
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 4/4 (805306368-1073741824) size 256M starting
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 2/4 (268435456-536870912) size 256M starting
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 3/4 (536870912-805306368) size 256M starting
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 1/4 (0-268435456) size 256M starting
2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : HTTP REQUEST (req 0xc00057c900)
2021/06/03 17:22:37 DEBUG : GET /test/test.1G HTTP/1.1
Host: myserver.test.it
User-Agent: rclone/v1.55.1
Authorization: XXXX
Range: bytes=805306368-1073741823
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20210603T152237Z

2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : HTTP REQUEST (req 0xc000594700)
2021/06/03 17:22:37 DEBUG : GET /test/test.1G HTTP/1.1
Host: myserver.test.it
User-Agent: rclone/v1.55.1
Authorization: XXXX
Range: bytes=268435456-536870911
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20210603T152237Z

2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : HTTP REQUEST (req 0xc0007fe400)
2021/06/03 17:22:37 DEBUG : GET /test/test.1G HTTP/1.1
Host: myserver.test.it
User-Agent: rclone/v1.55.1
Authorization: XXXX
Range: bytes=536870912-805306367
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20210603T152237Z

2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : HTTP REQUEST (req 0xc000618000)
2021/06/03 17:22:37 DEBUG : GET /test/test.1G HTTP/1.1
Host: myserver.test.it
User-Agent: rclone/v1.55.1
Authorization: XXXX
Range: bytes=0-268435455
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20210603T152237Z

2021/06/03 17:22:37 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : HTTP RESPONSE (req 0xc00057c900)
2021/06/03 17:22:37 DEBUG : HTTP/1.1 400 Bad Request
Content-Length: 342
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: application/xml
Date: Thu, 03 Jun 2021 15:22:35 GMT
Server: nginx/1.14.1
Vary: Origin
X-Amz-Request-Id: 16851BC0FFD8B7E7
X-Xss-Protection: 1; mode=block

<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><Key>test.1G</Key><BucketName>test</BucketName><Resource>/test/test.1G</Resource><RequestId>16851BC0FFD8B7E7</RequestId><HostId>cbf91113-976d-4570-ab09-c0d5af6a857c</HostId></Error>
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 4/4 failed: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 16851BC0FFD8B7E7, host id: 
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : HTTP RESPONSE (req 0xc000618000)
2021/06/03 17:22:37 DEBUG : Error: context canceled
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 1/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : HTTP RESPONSE (req 0xc000594700)
2021/06/03 17:22:37 DEBUG : Error: context canceled
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 2/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : HTTP RESPONSE (req 0xc0007fe400)
2021/06/03 17:22:37 DEBUG : Error: context canceled
2021/06/03 17:22:37 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/06/03 17:22:37 DEBUG : test.1G: multi-thread copy: stream 3/4 failed: multipart copy: failed to open source: RequestError: send request failed
caused by: Get "https://myserver.test.it/test/test.1G": context canceled
2021/06/03 17:22:37 ERROR : test.1G: Failed to copy: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 16851BC0FFD8B7E7, host id: 
2021/06/03 17:22:37 ERROR : Attempt 1/1 failed with 1 errors and: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 16851BC0FFD8B7E7, host id: 
2021/06/03 17:22:37 INFO  : 
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.0s

2021/06/03 17:22:37 DEBUG : 5 go routines active
2021/06/03 17:22:37 Failed to copy: multipart copy: failed to open source: AccessDenied: There were headers present in the request which were not signed
        status code: 400, request id: 16851BC0FFD8B7E7, host id:

Many thanks!

darthShadow · June 3, 2021, 4:06pm

github.com/minio/minio

nginx proxy cache seems to mess up headers

opened 07:13AM - 14 Apr 17 UTC

closed 07:19PM - 07 Sep 17 UTC

morph027

priority: low

I was just googling around and found this blog post: https://www.nginx.com/blog/…enterprise-grade-cloud-storage-nginx-plus-minio/ Besides simple load balancing and TLS termination, I was trying to test/implement the caching feature. But when accessing the bucket with mc, an error appears: ```mc: <ERROR> Unable to initialize target `test/test`. Access Denied.``` Removing the ```proxy_cache minio_s3;``` makes it usable again. Will provide more output from minio server and nginx logs as soon as i'am back at work. * **nginx config** ``` upstream minio_servers { server minio-server-1:9000; server minio-server-2:9000; server minio-server-3:9000; server minio-server-4:9000; } proxy_cache_path /var/cache/nginx/minio levels=1:2 keys_zone=minio_s3:10m max_size=10g inactive=60m use_temp_path=off; server { listen 80 default_server; location / { proxy_cache minio_s3; proxy_pass http://minio_servers; proxy_set_header Host $http_host; proxy_set_header X-Real-IP $remote_addr; proxy_set_header X-Forward-Proto http; } } ```

emanuelev · June 4, 2021, 8:17am

Hi darthShadow, I tried setting nginx configuration suggested in blog, unfortunately errors persists :-/

emanuelev · June 4, 2021, 8:25am

And this is my nginx configuration:

proxy_cache_path /var/cache/nginx/test.it levels=1:2 keys_zone=minio_cache:10m max_size=10g inactive=60m use_temp_path=off;

upstream minio_servers {
        ip_hash;
        server node1.test.it:9000;
        server node2.test.it:9000;
}

server {
        listen 80;
        server_name myserver.test.it;
        return 301 https://myserver.test.it$request_uri;
}

server {
    ignore_invalid_headers off;
    client_max_body_size 0;
    proxy_buffering off;

    listen       443 ssl;
    server_name  myserver.test.it;

    ssl_certificate "/etc/pki/nginx/pub/test.it/public.crt";
    ssl_certificate_key "/etc/pki/nginx/priv/test.it/private.key";
    ssl_protocols       TLSv1 TLSv1.1 TLSv1.2;
    ssl_ciphers         HIGH:!aNULL:!MD5;


    location / {
            proxy_set_header X-Real-IP $remote_addr;
            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
            proxy_set_header X-Forwarded-Proto $scheme;
            proxy_set_header Host $http_host;
            proxy_cache      minio_cache;
            proxy_cache_convert_head off;
            proxy_cache_key "$scheme$proxy_host$uri$is_args$args|$request_body";
            proxy_read_timeout 300s;
            proxy_connect_timeout 75s;
            proxy_http_version 1.1;
            proxy_set_header Connection "";
            chunked_transfer_encoding on;
            proxy_redirect off;
            proxy_pass       https://minio_servers;
    }

}

emanuelev · June 4, 2021, 8:55am

Another note: with GUI (rclone rcd --rc-web-gui) all trasfers upload/download are OK.