Backblaze sync stuck at 0 bytes

Help and Support
1

What is the problem you are having with rclone?

Rclone is failing to sync to a b2 bucket stuck at 0 bytes.

What is your rclone version (output from rclone version)

rclone v1.55.1

  • os/type: linux
  • os/arch: amd64
  • go/version: go1.16.3
  • go/linking: static
  • go/tags: none

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Centos 7

Which cloud storage system are you using? (eg Google Drive)

Backblaze b2

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync -vviP --dump headers --dump bodies --stats 5s --timeout 10m --bwlimit=10M /mnt/Primary/Iconik/testDir/ backblaze:nTBucket

The rclone config contents with secrets removed.

[backblaze]
type = b2
account = XXXXX
key = XXXXX

A log from the command with the -vv flag

2021/05/10 16:11:00 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2021/05/10 16:11:00 INFO  : Starting bandwidth limiter at 10MBytes/s
2021/05/10 16:11:00 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "sync" "-vviP" "--dump" "headers" "--dump" "bodies" "--stats" "5s" "--timeout" "10m" "--bwlimit=10M" "/mnt/Primary/Iconik/testDir/" "backblaze:nTBucket"]
2021/05/10 16:11:00 DEBUG : Creating backend with remote "/mnt/Primary/Iconik/testDir/"
2021/05/10 16:11:00 DEBUG : Creating backend with remote "backblaze:nTBucket"
2021/05/10 16:11:00 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2021/05/10 16:11:00 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/10 16:11:00 DEBUG : HTTP REQUEST (req 0xc000192a00)
2021/05/10 16:11:00 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/v1.55.1
Authorization: XXXX
Accept-Encoding: gzip

2021/05/10 16:11:00 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/10 16:11:00 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/10 16:11:00 DEBUG : HTTP RESPONSE (req 0xc000192a00)
2021/05/10 16:11:00 DEBUG : HTTP/1.1 200 
Content-Length: 1018
Cache-Control: max-age=0, no-cache, no-store
Content-Type: application/json;charset=UTF-8
Date: Mon, 10 May 2021 23:13:11 GMT

{
  "absoluteMinimumPartSize": 5000000,
  "accountId": "accountIdXXXX",
  "allowed": {
    "bucketId": null,
    "bucketName": null,
    "capabilities": [
      "listKeys",
      "writeKeys",
      "deleteKeys",
      "listBuckets",
      "writeBuckets",
      "deleteBuckets",
      "readBuckets",
      "listFiles",
      "readFiles",
      "shareFiles",
      "writeFiles",
      "deleteFiles",
      "readBucketEncryption",
      "writeBucketEncryption",
      "bypassGovernance",
      "readBucketRetentions",
      "writeBucketRetentions",
      "readFileRetentions",
      "writeFileRetentions",
      "readFileLegalHolds",
      "writeFileLegalHolds"
    ],
    "namePrefix": null
  },
  "apiUrl": "https://api002.backblazeb2.com",
  "authorizationToken": "authTokenXXXX",
  "downloadUrl": "https://f002.backblazeb2.com",
  "minimumPartSize": 100000000,
  "recommendedPartSize": 100000000,
  "s3ApiUrl": "https://s3.us-west-002.backblazeb2.com"
}
2021/05/10 16:11:00 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-10 16:11:00 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-10 16:11:00 DEBUG : HTTP REQUEST (req 0xc000192000)
2021-05-10 16:11:00 DEBUG : POST /b2api/v1/b2_list_buckets HTTP/1.1
Host: api002.backblazeb2.com
User-Agent: rclone/v1.55.1
Content-Length: 28
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip

{"accountId":"accountIdXXXX"}
2021-05-10 16:11:00 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-10 16:11:00 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-10 16:11:00 DEBUG : HTTP RESPONSE (req 0xc000192000)
2021-05-10 16:11:00 DEBUG : HTTP/1.1 200 
Content-Length: 737
Cache-Control: max-age=0, no-cache, no-store
Content-Type: application/json;charset=UTF-8
Date: Mon, 10 May 2021 23:13:11 GMT

{
  "buckets": [
    {
      "accountId": "accountIdXXXX",
      "bucketId": "bucketIdXXXX",
      "bucketInfo": {},
      "bucketName": "nTBucket",
      "bucketType": "allPrivate",
      "corsRules": [],
      "defaultServerSideEncryption": {
        "isClientAuthorizedToRead": true,
        "value": {
          "algorithm": null,
          "mode": null
        }
      },
      "fileLockConfiguration": {
        "isClientAuthorizedToRead": true,
        "value": {
          "defaultRetention": {
            "mode": null,
            "period": null
          },
          "isFileLockEnabled": false
        }
      },
      "lifecycleRules": [],
      "options": [
        "s3"
      ],
      "revision": 2
    }
  ]
}
2021-05-10 16:11:00 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-10 16:11:00 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-10 16:11:00 DEBUG : HTTP REQUEST (req 0xc0002a0900)
2021-05-10 16:11:00 DEBUG : POST /b2api/v1/b2_list_file_names HTTP/1.1
Host: api002.backblazeb2.com
User-Agent: rclone/v1.55.1
Content-Length: 75
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip

{"bucketId":"bucketIdXXXX","maxFileCount":1000,"delimiter":"/"}
2021-05-10 16:11:00 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-10 16:11:00 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-10 16:11:00 DEBUG : HTTP RESPONSE (req 0xc0002a0900)
2021-05-10 16:11:00 DEBUG : HTTP/1.1 200 
Content-Length: 42
Cache-Control: max-age=0, no-cache, no-store
Content-Type: application/json;charset=UTF-8
Date: Mon, 10 May 2021 23:13:11 GMT

{
  "files": [],
  "nextFileName": null
}
2021-05-10 16:11:00 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Elapsed time:         0.3srclone: copy "test.txt"?
y) Yes, this is OK (default)
n) No, skip this
s) Skip all copy operations with no more questions
!) Do all copy operations with no more questions
2021-05-10 16:11:00 DEBUG : B2 bucket nTBucket: Waiting for checks to finish
2021-05-10 16:11:00 DEBUG : B2 bucket nTBucket: Waiting for transfers to finish
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Transferred:            0 / 2, 0%
Elapsed time:      2m40.2s
Transferring:
 *                                      test.txt: transferring
 *                                 testVideo.mp4: transferring

I've updated the debug log to exclude private information (accountId/authToken/bucketId). I have tried to run sync/copy commands to different buckets to test but they all result in nothing happening and it being stuck at 0 bytes for hours.

2

You've got the -i flag there so it will be waiting for you to confirm something. This is all mixed up in the debug log so it is a bit hard to see.

3

@ncw Oh wow do I feel dumb. Its now working after removing the -i. I do feel its strange behavior that it says it will do 'y)' it by default and then proceed to try and back up but not give an indicator that it is waiting for an input. Anyways thanks for the help.

4

It is an unfortunate interaction between the -vv and the -i that I haven't figured out yet.

You aren't the first person to be tripped up by this so we'll figure something out in due course I'm sure!

5

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.