What is the problem you are having with rclone?
I'm trying to sync to a b2 bucket using the --backup-dir flag. I'm using an application key with limited capabilities. These are the capabilities the key has
listAllBucketNames, listBuckets, listFiles, readBucketEncryption, readBucketNotifications, readBucketReplications, readBucketRetentions, readBuckets, readFileLegalHolds, readFileRetentions, readFiles, writeFiles
. However rclone is trying to create a bucket each time, even though it already exists. I've read about the --s3-no-check-bucket
flag which seems to solve this issue for people on other backends, but that doesn't seem to apply to B2. I've tested and it seems to be the backup-dir flag that causes the failures.
Ideally I think an analog of --s3-no-check-bucket for the b2 backend should solve my issue.
I've tested that I can lsd the bucket.
$ rclone lsd crypt-b2-backups-franklin:
-1 2000-01-01 00:00:00 -1 curr
Run the command 'rclone version' and share the full output of the command.
$ rclone version
rclone 1.69.1
- os/version: gentoo 2.17 (64 bit)
- os/kernel: 6.12.21-gentoo-dist (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.2
- go/linking: dynamic
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Backblaze B2
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone sync --filter-from=/home/matt/.config/rclone/backup-filter --fast-list --links --delete-excluded --backup-dir crypt-b2-backups-franklin:/back/2025-04-14T1621 /mnt/home-snap/matt crypt-b2-backups-franklin:/curr
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
$ rclone config redacted
[b2]
type = b2
account = XXX
key = XXX
[crypt-b2-backups-franklin]
type = crypt
remote = b2:backups-franklin
filename_encryption = standard
directory_name_encryption = true
password = XXX
password2 = XXX
[onedrive]
type = onedrive
token = XXX
drive_id = XXX
drive_type = personal
[onedrive-backup-crypt]
type = crypt
remote = onedrive:franklin-backup
filename_encryption = standard
directory_name_encryption = true
password = XXX
password2 = XXX
### Double check the config for sensitive info before posting publicly
A log from the command that you were trying to run with the -vv
flag
2025/04/14 16:40:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:23 DEBUG : HTTP REQUEST (req 0xc000440500)
2025/04/14 16:40:23 DEBUG : HEAD /file/backups-franklin/o3883jnhuqqeidlamskchvo1to/s3kle27fvmcfsbikdanpl6l1oo/0r3iiida8rj194foqpukbrmjeo/08vv0ra3oe3hl22d18je27b608/9nofh8gpn4muj3vmeabi26dlv0bdv3qdh6s08u6vm0s5ng1dpj30/3mem9k1tv2ffq9jeb8c2qc1fus HTTP/1.1
Host: f004.backblazeb2.com
User-Agent: rclone/1.69.1
Authorization: XXXX
2025/04/14 16:40:23 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:23 DEBUG : dev/wordle/project/target: Excluded
2025/04/14 16:40:23 DEBUG : dev/wordle/core/project/target: Excluded
2025/04/14 16:40:23 DEBUG : dev/wordle/weight-list/target: Excluded
2025/04/14 16:40:23 DEBUG : dev/wordle/project/project/target: Excluded
2025/04/14 16:40:23 DEBUG : .config/discord/0.0.82/modules/discord_utils/node_modules/node-addon-api/tools: Excluded
2025/04/14 16:40:23 DEBUG : .config/discord/0.0.82/modules/discord_spellcheck/node_modules/node-addon-api/tools: Excluded
2025/04/14 16:40:23 DEBUG : .config/discord/0.0.82/modules/discord_utils/node_modules/windows-notification-state/node_modules/node-addon-api/tools: Excluded
2025/04/14 16:40:23 NOTICE: .local/share/scalacli/bloop/daemon/socket: Can't transfer non file/directory
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc000918140)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:24 DEBUG : HTTP REQUEST (req 0xc000440a00)
2025/04/14 16:40:24 DEBUG : POST /b2api/v1/b2_create_bucket HTTP/1.1
Host: api004.backblazeb2.com
User-Agent: rclone/1.69.1
Content-Length: 86
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip
2025/04/14 16:40:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc002194000)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc00065c3c0)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc00065c640)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc0004403c0)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc0009183c0)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc0002e0a00)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc000440500)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 404
Content-Length: 94
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : HTTP RESPONSE (req 0xc000440a00)
2025/04/14 16:40:24 DEBUG : HTTP/1.1 401
Content-Length: 62
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:24 DEBUG : B2 bucket backups-franklin path o3883jnhuqqeidlamskchvo1to/s3kle27fvmcfsbikdanpl6l1oo: Unauthorized: Unknown 401 (401 unauthorized)
2025/04/14 16:40:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:24 DEBUG : HTTP REQUEST (req 0xc0004412c0)
2025/04/14 16:40:24 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/1.69.1
Authorization: XXXX
Accept-Encoding: gzip
2025/04/14 16:40:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : HTTP RESPONSE (req 0xc0004412c0)
2025/04/14 16:40:25 DEBUG : HTTP/1.1 200
Content-Length: 822
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=UTF-8
Date: Mon, 14 Apr 2025 15:40:24 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : pacer: low level retry 1/10 (error Unknown 401 (401 unauthorized))
2025/04/14 16:40:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : HTTP REQUEST (req 0xc000441cc0)
2025/04/14 16:40:25 DEBUG : POST /b2api/v1/b2_create_bucket HTTP/1.1
Host: api004.backblazeb2.com
User-Agent: rclone/1.69.1
Content-Length: 86
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : HTTP RESPONSE (req 0xc000441cc0)
2025/04/14 16:40:25 DEBUG : HTTP/1.1 401
Content-Length: 62
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:25 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : B2 bucket backups-franklin path o3883jnhuqqeidlamskchvo1to/s3kle27fvmcfsbikdanpl6l1oo: Unauthorized: Unknown 401 (401 unauthorized)
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : HTTP REQUEST (req 0xc0002e0f00)
2025/04/14 16:40:25 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/1.69.1
Authorization: XXXX
Accept-Encoding: gzip
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : HTTP RESPONSE (req 0xc0002e0f00)
2025/04/14 16:40:25 DEBUG : HTTP/1.1 200
Content-Length: 822
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=UTF-8
Date: Mon, 14 Apr 2025 15:40:25 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : pacer: Reducing sleep to 10ms
2025/04/14 16:40:25 DEBUG : pacer: low level retry 2/10 (error Unknown 401 (401 unauthorized))
2025/04/14 16:40:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : HTTP REQUEST (req 0xc000918a00)
2025/04/14 16:40:25 DEBUG : POST /b2api/v1/b2_create_bucket HTTP/1.1
Host: api004.backblazeb2.com
User-Agent: rclone/1.69.1
Content-Length: 86
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : HTTP RESPONSE (req 0xc000918a00)
2025/04/14 16:40:25 DEBUG : HTTP/1.1 401
Content-Length: 62
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:25 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : B2 bucket backups-franklin path o3883jnhuqqeidlamskchvo1to/s3kle27fvmcfsbikdanpl6l1oo: Unauthorized: Unknown 401 (401 unauthorized)
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : HTTP REQUEST (req 0xc0009192c0)
2025/04/14 16:40:25 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/1.69.1
Authorization: XXXX
Accept-Encoding: gzip
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : HTTP RESPONSE (req 0xc0009192c0)
2025/04/14 16:40:25 DEBUG : HTTP/1.1 200
Content-Length: 822
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=UTF-8
Date: Mon, 14 Apr 2025 15:40:25 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : pacer: Reducing sleep to 10ms
2025/04/14 16:40:25 DEBUG : pacer: low level retry 3/10 (error Unknown 401 (401 unauthorized))
2025/04/14 16:40:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : HTTP REQUEST (req 0xc0009197c0)
2025/04/14 16:40:25 DEBUG : POST /b2api/v1/b2_create_bucket HTTP/1.1
Host: api004.backblazeb2.com
User-Agent: rclone/1.69.1
Content-Length: 86
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : HTTP RESPONSE (req 0xc0009197c0)
2025/04/14 16:40:25 DEBUG : HTTP/1.1 401
Content-Length: 62
Cache-Control: max-age=0, no-cache, no-store
Connection: keep-alive
Content-Type: application/json;charset=utf-8
Date: Mon, 14 Apr 2025 15:40:25 GMT
Server: nginx
Strict-Transport-Security: max-age=63072000
2025/04/14 16:40:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2025/04/14 16:40:25 DEBUG : B2 bucket backups-franklin path o3883jnhuqqeidlamskchvo1to/s3kle27fvmcfsbikdanpl6l1oo: Unauthorized: Unknown 401 (401 unauthorized)
2025/04/14 16:40:25 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2025/04/14 16:40:25 DEBUG : HTTP REQUEST (req 0xc0004f2000)
2025/04/14 16:40:25 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/1.69.1
Authorization: XXXX
Accept-Encoding: gzip
I've truncated the log here as it's just authorize_account and create_bucket repeated in a loop. Hopefully this is enough to see the flow, it gets a 404 on the target, then tries to create a bucket and gets stuck in a loop when it doesn't have permission. If rclone just copied/deleted the file it should work with the capabilities it has.