Backblaze B2 download "Unsupported protocol scheme "" "

Kaassouffle · August 18, 2022, 12:07am

What is the problem you are having with rclone?

I'm trying to download deleted files (which still have a previous version, they're overwritten with an empty, hidden files but the previous version is still there), but I'm getting the error unsupported protocol scheme ""

I tried downloading using my own URL that I CNAMED in Cloudflare DNS to f003.backblazeb2.com and I tried downloading using f003.backblazeb2.com directly.

Run the command 'rclone version' and share the full output of the command.

rclone v1.50.2

os/arch: linux/amd64
go version: go1.13.8

Which cloud storage system are you using? (eg Google Drive)

Backblaze B2

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone copy b2-crypt:[directory] [directory] -vv --b2-versions

The rclone config contents with secrets removed.

[b2]
type = b2
account = ***
key = ***
hard_delete = false
download_url = f003.backblazeb2.com

[b2-crypt]
type = crypt
remote = b2:robbert
filename_encryption = off
directory_name_encryption = false
password = ***

A log from the command with the `-vv` flag

rclone copy b2-crypt:[source-dir] [output-dir] -vv --b2-versions
2022/08/18 01:55:57 DEBUG : rclone: Version "v1.50.2" starting with parameters ["rclone" "copy" "b2-crypt:[source-dir]" "[output-dir]" "-vv" "--b2-versions"]
2022/08/18 01:55:57 DEBUG : Using config file from "[config path]"
2022/08/18 01:55:59 INFO  : Local file system at [output-dir]: Waiting for checks to finish
2022/08/18 01:55:59 INFO  : Local file system at [output-dir]: Waiting for transfers to finish
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-012959-720: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4ed8c_d20220809_m012959_c003_v0312011_t0001_u01660008599720: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013003-831: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f105b2fcca4a917fb_d20220809_m013003_c003_v0312009_t0009_u01660008603831: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013000-530: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4ed9d_d20220809_m013000_c003_v0312011_t0000_u01660008600530: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013002-394: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f105d8c7d7889da2a_d20220809_m013002_c003_v0312004_t0008_u01660008602394: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013006-066: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f106b6f3cde496144_d20220809_m013006_c003_v0312007_t0004_u01660008606066: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013011-831: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eeb9_d20220809_m013011_c003_v0312011_t0005_u01660008611831: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013012-227: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eebe_d20220809_m013012_c003_v0312011_t0009_u01660008612227: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : Attempt 1/3 failed with 15 errors and: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eebe_d20220809_m013012_c003_v0312011_t0009_u01660008612227: unsupported protocol scheme ""
2022/08/18 01:55:59 INFO  : Local file system at [output-dir]: Waiting for checks to finish
2022/08/18 01:55:59 INFO  : Local file system at [output-dir]: Waiting for transfers to finish
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013002-394: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f105d8c7d7889da2a_d20220809_m013002_c003_v0312004_t0008_u01660008602394: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013000-530: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4ed9d_d20220809_m013000_c003_v0312011_t0000_u01660008600530: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-012959-720: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4ed8c_d20220809_m012959_c003_v0312011_t0001_u01660008599720: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013003-831: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f105b2fcca4a917fb_d20220809_m013003_c003_v0312009_t0009_u01660008603831: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013006-066: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f106b6f3cde496144_d20220809_m013006_c003_v0312007_t0004_u01660008606066: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013011-831: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eeb9_d20220809_m013011_c003_v0312011_t0005_u01660008611831: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013012-227: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eebe_d20220809_m013012_c003_v0312011_t0009_u01660008612227: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : Attempt 2/3 failed with 15 errors and: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eebe_d20220809_m013012_c003_v0312011_t0009_u01660008612227: unsupported protocol scheme ""
2022/08/18 01:55:59 INFO  : Local file system at [output-dir]: Waiting for checks to finish
2022/08/18 01:55:59 INFO  : Local file system at [output-dir]: Waiting for transfers to finish
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013002-394: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f105d8c7d7889da2a_d20220809_m013002_c003_v0312004_t0008_u01660008602394: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013000-530: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4ed9d_d20220809_m013000_c003_v0312011_t0000_u01660008600530: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-012959-720: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4ed8c_d20220809_m012959_c003_v0312011_t0001_u01660008599720: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013003-831: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f105b2fcca4a917fb_d20220809_m013003_c003_v0312009_t0009_u01660008603831: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013006-066: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f106b6f3cde496144_d20220809_m013006_c003_v0312007_t0004_u01660008606066: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013011-831: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eeb9_d20220809_m013011_c003_v0312011_t0005_u01660008611831: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : [file]-v2022-08-09-013012-227: Failed to copy: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eebe_d20220809_m013012_c003_v0312011_t0009_u01660008612227: unsupported protocol scheme ""
2022/08/18 01:55:59 ERROR : Attempt 3/3 failed with 15 errors and: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eebe_d20220809_m013012_c003_v0312011_t0009_u01660008612227: unsupported protocol scheme ""
2022/08/18 01:55:59 Failed to copy with 15 errors: last error was: failed to open source object: failed to open for download: Get f003.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=_f100ddbcd37b4eebe_d20220809_m013012_c003_v0312011_t0009_u01660008612227: unsupported protocol scheme ""

asdffdsa · August 18, 2022, 12:33am

hello,
the lastest version of rclone is v1.59.1.

best to update and test again.

Kaassouffle · August 18, 2022, 12:38am

The lastest in the Ubuntu repository is 1.50.2. How do I update manually?

asdffdsa · August 18, 2022, 12:39am

https://rclone.org/downloads/#script-download-and-install

Kaassouffle · August 18, 2022, 12:43am

Thanks

After updating, I still get the error

asdffdsa · August 18, 2022, 12:45am

please post an updated log file

Kaassouffle · August 18, 2022, 12:52am

I see that the URLs are now different - are these the s3 URLs? Because then the domain f003.backblazeb2.com is wrong

rclone copy b2-crypt:[dir] [dir]/AutoSave_1000 -vv --b2-versions
2022/08/18 02:42:35 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "copy" "b2-crypt:[dir]" "[dir]/AutoSave_1000" "-vv" "--b2-versions"]
2022/08/18 02:42:35 DEBUG : Creating backend with remote "b2-crypt:[dir]"
2022/08/18 02:42:35 DEBUG : Using config file from "[dir]/.config/rclone/rclone.conf"
2022/08/18 02:42:36 DEBUG : Creating backend with remote "b2:[bucket][dir].bin"
2022/08/18 02:42:36 DEBUG : b2: detected overridden config - adding "{pO73u}" suffix to name
2022/08/18 02:42:36 DEBUG : fs cache: renaming cache item "b2:[bucket][dir].bin" to be canonical "b2{pO73u}:[bucket][dir].bin"
2022/08/18 02:42:36 DEBUG : Creating backend with remote "b2:[bucket][dir]"
2022/08/18 02:42:36 DEBUG : b2: detected overridden config - adding "{pO73u}" suffix to name
2022/08/18 02:42:37 DEBUG : fs cache: renaming cache item "b2:[bucket][dir]" to be canonical "b2{pO73u}:[bucket][dir]"
2022/08/18 02:42:37 DEBUG : Creating backend with remote "[dir]/AutoSave_1000"
2022/08/18 02:42:37 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for checks to finish
2022/08/18 02:42:37 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for transfers to finish
2022/08/18 02:42:37 ERROR : SerializationJob_0.save-v2022-08-09-013000-530: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_0.save-v2022-08-09-013000-530.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Header.save-v2022-08-09-012959-720: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/Header.save-v2022-08-09-012959-720.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_1.save-v2022-08-09-013002-394: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_1.save-v2022-08-09-013002-394.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_2.save-v2022-08-09-013003-831: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_2.save-v2022-08-09-013003-831.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_3.save-v2022-08-09-013006-066: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_3.save-v2022-08-09-013006-066.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/Systems.save-v2022-08-09-013011-831.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : WorldData.save-v2022-08-09-013012-227: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/WorldData.save-v2022-08-09-013012-227.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Attempt 1/3 failed with 7 errors and: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/WorldData.save-v2022-08-09-013012-227.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for checks to finish
2022/08/18 02:42:37 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for transfers to finish
2022/08/18 02:42:37 ERROR : Header.save-v2022-08-09-012959-720: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/Header.save-v2022-08-09-012959-720.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_1.save-v2022-08-09-013002-394: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_1.save-v2022-08-09-013002-394.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_3.save-v2022-08-09-013006-066: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_3.save-v2022-08-09-013006-066.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_2.save-v2022-08-09-013003-831: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_2.save-v2022-08-09-013003-831.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_0.save-v2022-08-09-013000-530: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_0.save-v2022-08-09-013000-530.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/Systems.save-v2022-08-09-013011-831.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : WorldData.save-v2022-08-09-013012-227: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/WorldData.save-v2022-08-09-013012-227.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Attempt 2/3 failed with 7 errors and: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/WorldData.save-v2022-08-09-013012-227.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for checks to finish
2022/08/18 02:42:37 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for transfers to finish
2022/08/18 02:42:37 ERROR : SerializationJob_2.save-v2022-08-09-013003-831: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_2.save-v2022-08-09-013003-831.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Header.save-v2022-08-09-012959-720: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/Header.save-v2022-08-09-012959-720.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_1.save-v2022-08-09-013002-394: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_1.save-v2022-08-09-013002-394.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_0.save-v2022-08-09-013000-530: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_0.save-v2022-08-09-013000-530.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : SerializationJob_3.save-v2022-08-09-013006-066: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/SerializationJob_3.save-v2022-08-09-013006-066.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/Systems.save-v2022-08-09-013011-831.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : WorldData.save-v2022-08-09-013012-227: Failed to copy: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/WorldData.save-v2022-08-09-013012-227.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 ERROR : Attempt 3/3 failed with 7 errors and: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/WorldData.save-v2022-08-09-013012-227.bin": unsupported protocol scheme ""
2022/08/18 02:42:37 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 7 (retrying may help)
Elapsed time:         1.5s

2022/08/18 02:42:37 DEBUG : 8 go routines active
2022/08/18 02:42:37 Failed to copy with 7 errors: last error was: failed to open source object: failed to GET for download: Get "f003.backblazeb2.com/file/[bucket][dir]/WorldData.save-v2022-08-09-013012-227.bin": unsupported protocol scheme ""

Edit: Fileinfo in the B2 webui shows these links:

Animosity022 · August 18, 2022, 12:59am

Change that to

download_url = https://f003.backblazeb2.com

Kaassouffle · August 18, 2022, 1:06am

Thanks, it has resolved the "Unsupported protocol scheme" issue (and I feel very stupid right now that I didn't spot that earlier)

But now I'm getting the error "Failed to copy: failed to open source object: object not found"

rclone copy b2-crypt:[dir]/AutoSave_1000 [dir]/AutoSave_1000 -vv --b2-versions
2022/08/18 03:02:06 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "copy" "b2-crypt:[dir]/AutoSave_1000" "[dir]/AutoSave_1000" "-vv" "--b2-versions"]
2022/08/18 03:02:06 DEBUG : Creating backend with remote "b2-crypt:[dir]/AutoSave_1000"
2022/08/18 03:02:06 DEBUG : Using config file from "[dir]/.config/rclone/rclone.conf"
2022/08/18 03:02:06 DEBUG : Creating backend with remote "b2:[bucket][dir]/AutoSave_1000.bin"
2022/08/18 03:02:06 DEBUG : b2: detected overridden config - adding "{pO73u}" suffix to name
2022/08/18 03:02:07 DEBUG : Couldn't decode error response: EOF
2022/08/18 03:02:07 DEBUG : fs cache: renaming cache item "b2:[bucket][dir]/AutoSave_1000.bin" to be canonical "b2{pO73u}:[bucket][dir]/AutoSave_1000.bin"
2022/08/18 03:02:07 DEBUG : Creating backend with remote "b2:[bucket][dir]/AutoSave_1000"
2022/08/18 03:02:07 DEBUG : b2: detected overridden config - adding "{pO73u}" suffix to name
2022/08/18 03:02:07 DEBUG : Couldn't decode error response: EOF
2022/08/18 03:02:07 DEBUG : fs cache: renaming cache item "b2:[bucket][dir]/AutoSave_1000" to be canonical "b2{pO73u}:[bucket][dir]/AutoSave_1000"
2022/08/18 03:02:07 DEBUG : Creating backend with remote "[dir]/AutoSave_1000"
2022/08/18 03:02:07 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for checks to finish
2022/08/18 03:02:07 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for transfers to finish
2022/08/18 03:02:08 ERROR : SerializationJob_0.save-v2022-08-09-013000-530: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Header.save-v2022-08-09-012959-720: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_1.save-v2022-08-09-013002-394: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_3.save-v2022-08-09-013006-066: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_2.save-v2022-08-09-013003-831: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : WorldData.save-v2022-08-09-013012-227: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Attempt 1/3 failed with 7 errors and: failed to open source object: object not found
2022/08/18 03:02:08 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for checks to finish
2022/08/18 03:02:08 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for transfers to finish
2022/08/18 03:02:08 ERROR : Header.save-v2022-08-09-012959-720: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_0.save-v2022-08-09-013000-530: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_1.save-v2022-08-09-013002-394: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_2.save-v2022-08-09-013003-831: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_3.save-v2022-08-09-013006-066: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : WorldData.save-v2022-08-09-013012-227: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Attempt 2/3 failed with 7 errors and: failed to open source object: object not found
2022/08/18 03:02:08 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for checks to finish
2022/08/18 03:02:08 DEBUG : Local file system at [dir]/AutoSave_1000: Waiting for transfers to finish
2022/08/18 03:02:08 ERROR : SerializationJob_0.save-v2022-08-09-013000-530: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Header.save-v2022-08-09-012959-720: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_2.save-v2022-08-09-013003-831: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_1.save-v2022-08-09-013002-394: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : WorldData.save-v2022-08-09-013012-227: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : SerializationJob_3.save-v2022-08-09-013006-066: Failed to copy: failed to open source object: object not found
2022/08/18 03:02:08 ERROR : Attempt 3/3 failed with 7 errors and: failed to open source object: object not found
2022/08/18 03:02:08 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 7 (retrying may help)
Elapsed time:         1.9s

2022/08/18 03:02:08 DEBUG : 16 go routines active
2022/08/18 03:02:08 Failed to copy with 7 errors: last error was: failed to open source object: object not found

Animosity022 · August 18, 2022, 2:07am

What does?

rclone lsd b2:
rclone lsd b2-crypt:

show?

Kaassouffle · August 18, 2022, 12:30pm

rclone lsd b2:
          -1 2022-08-18 14:28:05        -1 b2-snapshots-b62232af5371
          -1 2022-08-18 14:28:05        -1 robbert

It shows my buckets

rclone lsd b2-crypt:
          -1 2022-08-18 14:28:21        -1 [dir1]
          -1 2022-08-18 14:28:21        -1 [dir2]
          -1 2022-08-18 14:28:21        -1 [dir3]
          -1 2022-08-18 14:28:21        -1 [dir4]
          -1 2022-08-18 14:28:21        -1 [dir5]

It shows the folders in the directory that I'm syncing daily (I removed the folder names because of privacy)
Edit: rclone lsd b2-crypt:[directory I want to copy] doesn't show anything. The directory is there, but it's empty.
Edit2: Copying files that have not been deleted works fine. It's only the ones that are marked as deleted (overwritten with a hidden, empty file) but they still should show with --b2-versions, right?

Animosity022 · August 18, 2022, 1:18pm

What's the difference with:

rclone ls b2-crypt:[directory I want to copy]
rclone ls b2-crypt:[directory I want to copy] --b2-versions

I don't use b2 so not really sure how the old versions should show up offhand.

Kaassouffle · August 18, 2022, 1:50pm

It's the same for the two commands: no output at all.
But there are no directories in the directory I want to copy so that is normal.
Changing lsd to ls shows the files, also previous versions
It shows for example 86 Systems.save-v2022-08-09-013011-831
But the copy command gives error Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: object not found

Animosity022 · August 18, 2022, 2:52pm

Without really seeing the output, I'm not quite sure how to help.

Kaassouffle · August 18, 2022, 4:59pm

Output of the copy command (trying to copy the System.save file specifically)

$ rclone copy b2-crypt:[remote path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831 [local path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831 -vv --b2-versions
2022/08/18 18:54:25 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rclone" "copy" "b2-crypt:[remote path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831" "[local path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831" "-vv" "--b2-versions"]
2022/08/18 18:54:25 DEBUG : Creating backend with remote "b2-crypt:[remote path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831"
2022/08/18 18:54:25 DEBUG : Using config file from "[local path]/.config/rclone/rclone.conf"
2022/08/18 18:54:25 DEBUG : Creating backend with remote "b2:robbert/[remote path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831.bin"
2022/08/18 18:54:25 DEBUG : b2: detected overridden config - adding "{pO73u}" suffix to name
2022/08/18 18:54:26 DEBUG : fs cache: adding new entry for parent of "b2:robbert/[remote path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831.bin", "b2{pO73u}:robbert/[remote path]/AutoSave_1000"
2022/08/18 18:54:26 DEBUG : Creating backend with remote "[local path]/AutoSave_1000/Systems.save-v2022-08-09-013011-831"
2022/08/18 18:54:26 DEBUG : Systems.save-v2022-08-09-013011-831: Need to transfer - File not found at Destination
2022/08/18 18:54:26 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: object not found
2022/08/18 18:54:26 ERROR : Attempt 1/3 failed with 1 errors and: failed to open source object: object not found
2022/08/18 18:54:26 DEBUG : Systems.save-v2022-08-09-013011-831: Need to transfer - File not found at Destination
2022/08/18 18:54:26 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: object not found
2022/08/18 18:54:26 ERROR : Attempt 2/3 failed with 1 errors and: failed to open source object: object not found
2022/08/18 18:54:26 DEBUG : Systems.save-v2022-08-09-013011-831: Need to transfer - File not found at Destination
2022/08/18 18:54:26 ERROR : Systems.save-v2022-08-09-013011-831: Failed to copy: failed to open source object: object not found
2022/08/18 18:54:26 ERROR : Attempt 3/3 failed with 1 errors and: failed to open source object: object not found
2022/08/18 18:54:26 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.2s

2022/08/18 18:54:26 DEBUG : 9 go routines active
2022/08/18 18:54:26 Failed to copy: failed to open source object: object not found

Output of the ls command:

$ rclone ls b2-crypt:[remote path]/AutoSave_1000
   464773 Header.save-v2022-08-09-012959-720
 18412051 SerializationJob_0.save-v2022-08-09-013000-530
 15762904 SerializationJob_1.save-v2022-08-09-013002-394
 19212926 SerializationJob_2.save-v2022-08-09-013003-831
  7385077 SerializationJob_3.save-v2022-08-09-013006-066
       86 Systems.save-v2022-08-09-013011-831
  2097160 WorldData.save-v2022-08-09-013012-227

Animosity022 · August 18, 2022, 6:56pm

With all the details redacted, it'll be a bit hard to get it figured out so you are a decision point on trying to progress.

I'm not a great B2/S3 guy so I'm not going to be able to diagnose much more.

You'd want to add --retries 1 --dump bodies,headers and you can decide if you'd like to send a PM to @ncw for a look as that's probably your next step.

I might try testing without the Cloudflare part and see if that works but I'm guessing it'll be the same result.

system · September 17, 2022, 6:57pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.