What is the problem you are having with rclone?
I am new to Rclone and BackblazeB2, I am getting errors when I try to copy my data from my MacBook to cloud storage. I backup everything without deleting anything. Once uploaded to cloud, I remove it from my local.
I run the rclone command manually every day, but after some time it starts throwing error with LR catalog file issue. I verified that the folder and files exist in the source. Not sure what's going on.
Run the command 'rclone version' and share the full output of the command.
rclone v1.62.2
-
os/version: darwin 13.2.1 (64 bit)
-
os/kernel: 22.3.0 (arm64)
-
os/type: darwin
-
os/arch: arm64 (ARMv8 compatible)
-
go/version: go1.20.2
-
go/linking: dynamic
-
go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
BackBlaze B2
The command you were trying to run (eg rclone copy /tmp remote:tmp)
/usr/local/bin/rclone copy /Users/tango/Pictures/ backblaze-b2:Tango/Pictures -q
The rclone config contents with secrets removed.
[backblaze-b2]
type = b2
account = XXX
key = ***
A log from the command with the -vv flag
2023/05/11 16:52:40 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/root-pixels.db: Failed to copy: Post "https://pod-040-2009-16.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402009_t0044": write tcp 192.168.1.170:59334->149.137.133.92:443: use of closed network connection
2023/05/11 16:52:54 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0875.NEF: Failed to copy: Post "https://pod-040-2003-11.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402003_t0029": write tcp 192.168.1.170:59335->149.137.129.128:443: use of closed network connection
2023/05/11 16:54:09 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0874.NEF: Failed to copy: Post "https://pod-040-2016-19.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402016_t0039": write tcp 192.168.1.170:59353->149.137.133.235:443: use of closed network connection
2023/05/11 17:19:47 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0877.NEF: Failed to copy: Post "https://pod-040-2017-18.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0046": write tcp 192.168.1.170:59679->149.137.134.28:443: use of closed network connection
2023/05/11 17:24:21 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0876.NEF: Failed to copy: Post "https://pod-040-2006-00.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402006_t0048": write tcp 192.168.1.170:59750->149.137.132.220:443: use of closed network connection
2023/05/11 17:30:24 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0878.NEF: Failed to copy: Post "https://pod-040-2006-06.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402006_t0043": write tcp 192.168.1.170:59790->149.137.132.226:443: use of closed network connection
2023/05/11 18:01:09 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0879.NEF: Failed to copy: Post "https://pod-040-2007-18.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402007_t0051": write tcp 192.168.1.170:60064->149.137.133.14:443: use of closed network connection
2023/05/11 18:19:39 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0880.NEF: Failed to copy: Post "https://pod-040-2011-02.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402011_t0011": write tcp 192.168.1.170:60150->149.137.133.118:443: use of closed network connection
2023/05/11 18:21:00 ERROR : All Photos/2023/2023-05-11 Birds West Windsor/WestWindsorBlueBird05112023_0881.NEF: Failed to copy: Post "https://pod-040-2015-05.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402015_t0029": write tcp 192.168.1.170:60191->149.137.133.201:443: use of closed network connection
2023/05/11 19:23:53 ERROR : All Photos/2023/2023-05-09 Mercer County Park/MercerCountyParkSunset05092023_6828.NEF: Failed to copy: Post "https://pod-040-2010-10.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402010_t0025": write tcp 192.168.1.170:60993->149.137.133.106:443: use of closed network connection
2023/05/11 19:36:11 ERROR : All Photos/2023/2023-05-09 Mercer County Park/MercerCountyParkSunset05092023_6829.NEF: Failed to copy: Post "https://pod-040-2013-09.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402013_t0053": write tcp 192.168.1.170:61191->149.137.133.165:443: use of closed network connection
2023/05/11 20:32:00 ERROR : All Photos/2023/2023-05-09 Mercer County Park/MercerCountyParkSunset05092023_6836.NEF: Failed to copy: Post "https://pod-040-2011-00.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402011_t0052": write tcp 192.168.1.170:61974->149.137.133.116:443: use of closed network connection
2023/05/11 20:32:29 ERROR : All Photos/2023/2023-05-09 Mercer County Park/MercerCountyParkSunset05092023_6837.NEF: Failed to copy: Post "https://pod-040-2016-06.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402016_t0010": write tcp 192.168.1.170:61982->149.137.133.222:443: use of closed network connection
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/3/3FA3: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/D/DF3A: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/F/FFD0: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/0/0F56: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/B/BF79: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/8/8FCA: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/1/1FEA: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:10:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/C/CF8E: error reading destination directory: Post "https://api004.backblazeb2.com/b2api/v1/b2_list_file_names": dial tcp: lookup api004.backblazeb2.com: no such host
2023/05/12 02:26:06 ERROR : All Photos/2023/2023-05-09 Mercer County Park/MercerCountyParkSunset05092023_6839.NEF: Failed to copy: Post "https://pod-040-2007-15.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402007_t0002": write tcp 192.168.1.170:62718->149.137.133.11:443: write: broken pipe
2023/05/12 02:26:06 ERROR : All Photos/2023/2023-05-09 Mercer County Park/MercerCountyParkSunset05092023_6838.NEF: Failed to copy: Post "https://pod-040-2017-16.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0029": write tcp 192.168.1.170:62713->149.137.134.26:443: write: broken pipe
2023/05/12 07:13:50 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0486.NEF: Failed to copy: Post "https://pod-040-2008-00.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402008_t0047": write tcp 192.168.1.170:63276->149.137.133.56:443: use of closed network connection
2023/05/12 07:17:51 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0489.NEF: Failed to copy: Post "https://pod-040-2017-01.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0001": write tcp 192.168.1.170:63322->149.137.134.11:443: use of closed network connection
2023/05/12 07:46:30 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0493.NEF: Failed to copy: Post "https://pod-040-2002-03.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402002_t0011": write tcp 192.168.1.170:63478->149.137.129.100:443: use of closed network connection
2023/05/12 07:51:19 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0760.NEF: Failed to copy: Post "https://pod-040-2000-00.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402000_t0008": write tcp 192.168.1.170:63527->149.137.129.57:443: use of closed network connection
2023/05/12 07:54:49 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0761.NEF: Failed to copy: Post "https://pod-040-2016-09.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402016_t0051": write tcp 192.168.1.170:63565->149.137.133.225:443: use of closed network connection
2023/05/12 07:58:16 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0762.NEF: Failed to copy: Post "https://pod-040-2015-09.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402015_t0018": write tcp 192.168.1.170:63619->149.137.133.205:443: use of closed network connection
2023/05/12 08:19:56 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0763.NEF: Failed to copy: Post "https://pod-040-2015-04.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402015_t0056": write tcp 192.168.1.170:63676->149.137.133.200:443: write: broken pipe
2023/05/12 08:58:44 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0764.NEF: Failed to copy: Post "https://pod-040-2017-08.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0047": write tcp 192.168.1.170:63744->149.137.134.18:443: write: broken pipe
2023/05/12 09:07:32 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0765.NEF: Failed to copy: Post "https://pod-040-2017-07.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0010": write tcp 192.168.1.170:63813->149.137.134.17:443: write: broken pipe
2023/05/12 09:24:10 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0766.NEF: Failed to copy: Post "https://pod-040-2011-09.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402011_t0047": write tcp 192.168.1.170:63884->149.137.133.125:443: write: broken pipe
2023/05/12 09:42:36 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0767.NEF: Failed to copy: Post "https://pod-040-2006-03.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402006_t0035": write tcp 192.168.1.170:63923->149.137.132.223:443: use of closed network connection
2023/05/12 10:00:31 ERROR : Lightroom/Lightroom Catalog-v12.lrcat: Failed to copy: Post "https://pod-040-2003-15.backblaze.com/b2api/v1/b2_upload_part/4_zad7e0b10cb4ef44b80620e1b_f214943b8d1d6e553_d20230512_m122334_c004_v0402003_t0003_u01683894214478/0025": write tcp 192.168.1.170:63953->149.137.129.132:443: use of closed network connection
2023/05/12 10:36:37 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0768.NEF: Failed to copy: Post "https://pod-040-2006-01.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402006_t0018": write tcp 192.168.1.170:64039->149.137.132.221:443: write: broken pipe
2023/05/12 10:53:49 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0769.NEF: Failed to copy: Post "https://pod-040-2009-13.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402009_t0043": write tcp 192.168.1.170:64076->149.137.133.89:443: write: broken pipe
2023/05/12 11:28:08 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0770.NEF: Failed to copy: Post "https://pod-040-2009-10.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402009_t0027": write tcp 192.168.1.170:64126->149.137.133.86:443: write: broken pipe
2023/05/12 11:48:18 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0771.NEF: Failed to copy: Post "https://pod-040-2003-05.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402003_t0001": write tcp 192.168.1.170:64206->149.137.129.122:443: use of closed network connection
2023/05/12 12:12:01 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0773.NEF: Failed to copy: Post "https://pod-040-2017-13.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0059": write tcp 192.168.1.170:64301->149.137.134.23:443: write: broken pipe
2023/05/12 12:33:04 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0774.NEF: Failed to copy: Post "https://pod-040-2002-16.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402002_t0054": write tcp 192.168.1.170:64359->149.137.129.113:443: write: broken pipe
2023/05/12 12:33:04 ERROR : All Photos/2023/2023-05-11 Pole Farm Birds/PoleFarmBird05112023_0775.NEF: Failed to copy: Post "https://pod-040-2008-07.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402008_t0039": write tcp 192.168.1.170:64355->149.137.133.63:443: write: broken pipe
2023/05/12 12:53:23 ERROR : Artwork/Travel/Travel - New Jersey/MercerCountyParkSunset05092023_6820.psd: Failed to copy: Post "https://pod-040-2016-08.backblaze.com/b2api/v1/b2_upload_part/4_zad7e0b10cb4ef44b80620e1b_f20638d7a66e32712_d20230512_m160724_c004_v0402016_t0006_u01683907644953/0052": write tcp 192.168.1.170:64400->149.137.133.224:443: write: broken pipe
2023/05/12 13:20:43 ERROR : Attempt 1/3 failed with 43 errors and: Post "https://pod-040-2016-08.backblaze.com/b2api/v1/b2_upload_part/4_zad7e0b10cb4ef44b80620e1b_f20638d7a66e32712_d20230512_m160724_c004_v0402016_t0006_u01683907644953/0052": write tcp 192.168.1.170:64400->149.137.133.224:443: write: broken pipe
2023/05/12 13:23:03 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/root-pixels.db: Failed to copy: Post "https://pod-040-2017-02.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0012": can't copy - source file is being updated (size changed from 146898944 to 146989056)
2023/05/12 13:23:43 ERROR : Lightroom/Lightroom Catalog-v12.lrcat: corrupted on transfer: sha1 hash differ "65f9348f7e73e1db2f68f76b038f91fabbaa0549" vs "fbf893e1701794de19017ca81a08d0df6a92cdf6"
2023/05/12 15:22:37 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/5/5FB6/5FB6ECFB-F62B-4845-836B-052579996A32-55096c0afc19ec519c5032d4302e848b.lrprev: Failed to copy: failed to open source object: open /Users/klickzbysri/Pictures/Lightroom/Lightroom Catalog-v12 Previews.lrdata/5/5FB6/5FB6ECFB-F62B-4845-836B-052579996A32-55096c0afc19ec519c5032d4302e848b.lrprev: no such file or directory
2023/05/12 15:22:41 ERROR : Attempt 2/3 failed with 3 errors and: failed to open source object: open /Users/klickzbysri/Pictures/Lightroom/Lightroom Catalog-v12 Previews.lrdata/5/5FB6/5FB6ECFB-F62B-4845-836B-052579996A32-55096c0afc19ec519c5032d4302e848b.lrprev: no such file or directory
2023/05/12 16:20:18 ERROR : All Photos/2023/2023-05-12 Edwin Forsythe Birds/EdwinForsytheBird05122023_1318.MOV: Failed to copy: Post "https://pod-040-2017-18.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402017_t0018": write tcp 192.168.86.106:65062->149.137.134.28:443: write: broken pipe
2023/05/12 16:20:18 ERROR : All Photos/2023/2023-05-12 Edwin Forsythe Birds/EdwinForsytheBird05122023_1321.NEF: Failed to copy: Post "https://pod-040-2013-05.backblaze.com/b2api/v1/b2_upload_file/ad7e0b10cb4ef44b80620e1b/c004_v0402013_t0006": write tcp 192.168.86.106:65059->149.137.133.161:443: write: broken pipe
2023/05/12 17:10:23 ERROR : Lightroom/Lightroom Catalog-v12 Previews.lrdata/C/C920/C9207174-29A3-4B0D-A468-4BF61157E851-1fad798ef9d6324b0a5069b96a8b8c99.lrprev: Failed to copy: failed to open source object: open /Users/klickzbysri/Pictures/Lightroom/Lightroom Catalog-v12 Previews.lrdata/C/C920/C9207174-29A3-4B0D-A468-4BF61157E851-1fad798ef9d6324b0a5069b96a8b8c99.lrprev: no such file or directory
2023/05/12 17:11:32 ERROR : Attempt 3/3 failed with 3 errors and: failed to open source object: open /Users/klickzbysri/Pictures/Lightroom/Lightroom Catalog-v12 Previews.lrdata/C/C920/C9207174-29A3-4B0D-A468-4BF61157E851-1fad798ef9d6324b0a5069b96a8b8c99.lrprev: no such file or directory
2023/05/12 17:11:32 Failed to copy with 3 errors: last error was: failed to open source object: open /Users/klickzbysri/Pictures/Lightroom/Lightroom Catalog-v12 Previews.lrdata/C/C920/C9207174-29A3-4B0D-A468-4BF61157E851-1fad798ef9d6324b0a5069b96a8b8c99.lrprev: no such file or directory