Rclone Sync Transferred 0/0 Bytes

Help and Support
1

Hi Team,
I'm firing below command & command is not getting terminated from long time. Please help. Thanks in advance.
rclone sync -vv src_<minio_bucket_name>:<minio_bucket_name> dest_<minio_bucket_name>:<minio_bucket_name> --stats=5s --exclude restores/**

Below are the logs FYR.

2019/05/17 11:54:10 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2019/05/17 11:54:10 DEBUG : pacer: Reducing sleep to 0s
2019/05/17 11:54:15 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 5s

2019/05/17 11:54:20 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 10s

2019/05/17 11:54:25 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 15s

2019/05/17 11:54:30 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 20s

2

Try adding --dump headers then you'll get to see what HTTP transactions are going on - that might give a clue as to what is happening.

Have you got a very large number of files in a single directory? That could explain it.

3

Below are the logs after adding --dump headers in command. File Size is around 29 MB which contains some folders with config & xml file.

2019/05/17 12:49:40 DEBUG : rclone: Version "v1.45" starting with parameters ["rclone" "sync" "-vv" "src_6ebe1ec960bc4aa888fa4bc5466099ac-l:6ebe1ec960bc4aa888fa4bc5466099ac-l" "dest_6ebe1ec960bc4aa888fa4bc5466099ac:6ebe1ec960bc4aa888fa4bc5466099ac" "--stats=5s" "--exclude" "restores/**" "--dump" "headers"]
2019/05/17 12:49:40 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2019/05/17 12:49:40 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/05/17 12:49:40 DEBUG : HTTP REQUEST (req 0xc000107000)
2019/05/17 12:49:40 DEBUG : GET /6ebe1ec960bc4aa888fa4bc5466099ac?delimiter=%2F&max-keys=1000&prefix= HTTP/1.1
Host: XXXXXX
User-Agent: rclone/v1.45
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20190517T124940Z
Accept-Encoding: gzip

2019/05/17 12:49:40 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/05/17 12:49:40 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/05/17 12:49:40 DEBUG : HTTP REQUEST (req 0xc000106f00)
2019/05/17 12:49:40 DEBUG : GET /6ebe1ec960bc4aa888fa4bc5466099ac-l?delimiter=%2F&max-keys=1000&prefix= HTTP/1.1
Host: 10.96.0.18:9000
User-Agent: rclone/v1.45
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20190517T124940Z
Accept-Encoding: gzip

2019/05/17 12:49:40 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/05/17 12:49:40 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/05/17 12:49:40 DEBUG : HTTP RESPONSE (req 0xc000107000)
2019/05/17 12:49:40 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Accept-Ranges: bytes
Content-Security-Policy: block-all-mixed-content
Content-Type: application/xml
Date: Fri, 17 May 2019 12:49:40 GMT
Server: Minio/RELEASE.2019-04-04T18-31-46Z
Vary: Origin
X-Amz-Request-Id: 159F794FF67394CF
X-Minio-Deployment-Id: 0a38cfc7-3e48-4924-afe2-b98fd100289a
X-Xss-Protection: 1; mode=block

2019/05/17 12:49:40 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/05/17 12:49:40 DEBUG : pacer: Reducing sleep to 0s
2019/05/17 12:49:45 INFO :

4

It seems to be listing directories which is OK.

Can you let it run for longer and see if it keeps printing stuff?

5

Thank you so much for quick response. Issue has been resolved. I was not able to access local minio service via rclone so I made few changes in minio configuration to make it accessible.

1 Like