Best transfers and chucksize suggestion for Raspberry 4 2GB

YaPaY · August 31, 2020, 7:43pm

What is the problem you are having with rclone?

killed or slow transfers to backblaze

What is your rclone version (output from `rclone version`)

1.52.3

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Raspberry PI OS 64 bit

Which cloud storage system are you using? (eg Google Drive)

Backblaze

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone -vv copy --transfers 2 --b2-chunk-size 200M Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv remote:mebucket

The rclone config contents with secrets removed.

[remote]
type = b2
remote = xxxxxxxx
account = xxxxxxx
key = xxxxxxx

A log from the command with the `-vv` flag

2020/08/31 20:29:44 DEBUG : rclone: Version "v1.52.3" starting with parameters ["rclone" "-vv" "copy" "--transfers" "24" "--b2-chunk-size" "48M" "Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv" "remote:mebucket"]
2020/08/31 20:29:44 DEBUG : Using config file from "/home/pi/.config/rclone/rclone.conf"
2020/08/31 20:29:44 DEBUG : fs cache: adding new entry for parent of "Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv", "/media/NAS/salaklik"
2020/08/31 20:29:46 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Need to transfer - File not found at Destination
2020/08/31 20:30:29 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Starting upload of large file in 47 chunks (id "4_zb3dedb7f6fcb97f66d5b0d14_f21377ff51a036b55_d20200831_m193029_c001_v0001021_t0002")
2020/08/31 20:30:30 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 1 length 50331648
2020/08/31 20:30:31 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 2 length 50331648
2020/08/31 20:30:33 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 3 length 50331648
2020/08/31 20:30:34 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 4 length 50331648
2020/08/31 20:30:36 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 5 length 50331648
2020/08/31 20:30:37 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 6 length 50331648
2020/08/31 20:30:39 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 7 length 50331648
2020/08/31 20:30:40 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 8 length 50331648
2020/08/31 20:30:42 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 9 length 50331648
2020/08/31 20:30:43 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 10 length 50331648
2020/08/31 20:30:45 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 11 length 50331648
2020/08/31 20:30:45 INFO  : 
Transferred:   	  158.625M / 2.169 GBytes, 7%, 2.675 MBytes/s, ETA 12m50s
Transferred:            0 / 1, 0%
Elapsed time:        59.2s
Transferring:
 * Kadın.İşi.Banka.Soygun….H264.AAC-TurkSeed.mkv:  7% /2.169G, 7.201M/s, 4m46s

2020/08/31 20:30:46 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 12 length 50331648
2020/08/31 20:30:48 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 13 length 50331648
2020/08/31 20:30:50 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 14 length 50331648
2020/08/31 20:30:51 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 15 length 50331648
2020/08/31 20:30:54 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 16 length 50331648
2020/08/31 20:30:55 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 17 length 50331648
2020/08/31 20:30:59 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 18 length 50331648
2020/08/31 20:31:01 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 3
2020/08/31 20:31:01 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 19 length 50331648
2020/08/31 20:31:05 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 20 length 50331648
2020/08/31 20:31:07 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 21 length 50331648
2020/08/31 20:31:09 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 5
2020/08/31 20:31:09 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 22 length 50331648
2020/08/31 20:31:09 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 14
2020/08/31 20:31:09 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 7
2020/08/31 20:31:10 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 2
2020/08/31 20:31:12 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 23 length 50331648
2020/08/31 20:31:12 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 1
2020/08/31 20:31:12 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 10
2020/08/31 20:31:14 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 12
2020/08/31 20:31:15 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 24 length 50331648
2020/08/31 20:31:15 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 4
2020/08/31 20:31:17 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 25 length 50331648
2020/08/31 20:31:20 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 17
2020/08/31 20:31:20 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 26 length 50331648
2020/08/31 20:31:22 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 27 length 50331648
2020/08/31 20:31:24 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 28 length 50331648
2020/08/31 20:31:24 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 6
2020/08/31 20:31:24 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 11
Killed
pi@raspberrypi:/media/NAS/salaklik $ rclone -vv copy --transfers 2 --b2-chunk-size 300M Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv remote:mebucket
2020/08/31 20:31:57 DEBUG : rclone: Version "v1.52.3" starting with parameters ["rclone" "-vv" "copy" "--transfers" "2" "--b2-chunk-size" "300M" "Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv" "remote:mebucket"]
2020/08/31 20:31:57 DEBUG : Using config file from "/home/pi/.config/rclone/rclone.conf"
2020/08/31 20:31:57 DEBUG : fs cache: adding new entry for parent of "Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv", "/media/NAS/salaklik"
2020/08/31 20:31:57 Failed to create file system for "remote:mebucket": b2: upload cutoff: 200M is less than chunk size 300M
pi@raspberrypi:/media/NAS/salaklik $ rclone -vv copy --transfers 2 --b2-chunk-size 200M Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv remote:mebucket
2020/08/31 20:32:11 DEBUG : rclone: Version "v1.52.3" starting with parameters ["rclone" "-vv" "copy" "--transfers" "2" "--b2-chunk-size" "200M" "Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv" "remote:mebucket"]
2020/08/31 20:32:11 DEBUG : Using config file from "/home/pi/.config/rclone/rclone.conf"
2020/08/31 20:32:11 DEBUG : fs cache: adding new entry for parent of "Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv", "/media/NAS/salaklik"
2020/08/31 20:32:12 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Need to transfer - File not found at Destination
2020/08/31 20:32:55 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Starting upload of large file in 12 chunks (id "4_zb3dedb7f6fcb97f66d5b0d14_f208f283184a2b2eb_d20200831_m193254_c001_v0001144_t0015")
2020/08/31 20:32:59 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 1 length 209715200
2020/08/31 20:33:05 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 2 length 209715200
2020/08/31 20:33:12 INFO  : 
Transferred:   	   76.562M / 2.169 GBytes, 3%, 1.291 MBytes/s, ETA 27m41s
Transferred:            0 / 1, 0%
Elapsed time:        59.3s
Transferring:
 * Kadın.İşi.Banka.Soygun….H264.AAC-TurkSeed.mkv:  3% /2.169G, 3.806M/s, 9m23s

2020/08/31 20:33:39 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 2
2020/08/31 20:33:43 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 3 length 209715200
2020/08/31 20:33:44 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 1
2020/08/31 20:33:50 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 4 length 209715200
2020/08/31 20:34:12 INFO  : 
Transferred:   	  652.969M / 2.169 GBytes, 29%, 5.473 MBytes/s, ETA 4m46s
Transferred:            0 / 1, 0%
Elapsed time:      1m59.3s
Transferring:
 * Kadın.İşi.Banka.Soygun….H264.AAC-TurkSeed.mkv: 29% /2.169G, 9.700M/s, 2m41s

2020/08/31 20:34:25 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 4
2020/08/31 20:34:30 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 5 length 209715200
2020/08/31 20:34:30 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 3
2020/08/31 20:34:34 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 6 length 209715200
2020/08/31 20:35:12 INFO  : 
Transferred:   	    1.147G / 2.169 GBytes, 53%, 6.548 MBytes/s, ETA 2m39s
Transferred:            0 / 1, 0%
Elapsed time:      2m59.3s
Transferring:
 * Kadın.İşi.Banka.Soygun….H264.AAC-TurkSeed.mkv: 52% /2.169G, 11.010M/s, 1m35s

2020/08/31 20:35:15 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 5
2020/08/31 20:35:20 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 7 length 209715200
2020/08/31 20:35:21 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 6
2020/08/31 20:35:25 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 8 length 209715200
2020/08/31 20:35:59 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 7
2020/08/31 20:36:02 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 8
2020/08/31 20:36:04 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 9 length 209715200
2020/08/31 20:36:12 INFO  : 
Transferred:   	    1.587G / 2.169 GBytes, 73%, 6.789 MBytes/s, ETA 1m27s
Transferred:            0 / 1, 0%
Elapsed time:      3m59.3s
Transferring:
 * Kadın.İşi.Banka.Soygun….H264.AAC-TurkSeed.mkv: 73% /2.169G, 6.535M/s, 1m31s

2020/08/31 20:36:12 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 10 length 209715200
2020/08/31 20:36:44 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 10
2020/08/31 20:36:49 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 11 length 209715200
2020/08/31 20:36:49 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Error sending chunk 11 (retry=true): Post "https://pod-000-1144-08.backblaze.com/b2api/v1/b2_upload_part/4_zb3dedb7f6fcb97f66d5b0d14_f208f283184a2b2eb_d20200831_m193254_c001_v0001144_t0015/0039": EOF: &url.Error{Op:"Post", URL:"https://pod-000-1144-08.backblaze.com/b2api/v1/b2_upload_part/4_zb3dedb7f6fcb97f66d5b0d14_f208f283184a2b2eb_d20200831_m193254_c001_v0001144_t0015/0039", Err:(*errors.errorString)(0x3c0e028)}
2020/08/31 20:36:49 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Clearing part upload URL because of error: Post "https://pod-000-1144-08.backblaze.com/b2api/v1/b2_upload_part/4_zb3dedb7f6fcb97f66d5b0d14_f208f283184a2b2eb_d20200831_m193254_c001_v0001144_t0015/0039": EOF
2020/08/31 20:36:49 DEBUG : pacer: low level retry 1/10 (error Post "https://pod-000-1144-08.backblaze.com/b2api/v1/b2_upload_part/4_zb3dedb7f6fcb97f66d5b0d14_f208f283184a2b2eb_d20200831_m193254_c001_v0001144_t0015/0039": EOF)
2020/08/31 20:36:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2020/08/31 20:36:49 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 11 length 209715200
2020/08/31 20:36:50 DEBUG : pacer: Reducing sleep to 10ms
2020/08/31 20:37:10 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 9
2020/08/31 20:37:10 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Sending chunk 12 length 21589468
2020/08/31 20:37:12 INFO  : 
Transferred:   	    2.160G / 2.169 GBytes, 100%, 7.388 MBytes/s, ETA 1s
Transferred:            0 / 1, 0%
Elapsed time:      4m59.3s
Transferring:
 * Kadın.İşi.Banka.Soygun….H264.AAC-TurkSeed.mkv: 99% /2.169G, 11.350M/s, 0s

2020/08/31 20:37:13 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 12
2020/08/31 20:37:14 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 11
2020/08/31 20:37:14 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Finishing large file upload with 12 parts
2020/08/31 20:37:15 DEBUG : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: SHA-1 = 9e2a17de2fa12f9a28f5585ab67162163b2ee97d OK
2020/08/31 20:37:15 INFO  : Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Copied (new)
2020/08/31 20:37:15 INFO  : 
Transferred:   	    2.169G / 2.169 GBytes, 100%, 7.330 MBytes/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:       5m3.0s

2020/08/31 20:37:15 DEBUG : 8 go routines active

When I use default command line the transfer interrupting with killed message. When I use --transfer2 for example I am getting around 2Mbps transfer rate which is extremely slow. (BW 1Gbps upload) when I test from Backblaze speedtest I see my BW.

So which config is suitable for safe and rapid upload?

asdffdsa · August 31, 2020, 8:30pm

hello and welcome to the forum,

what is the text of the killed message?
in your command, there is only one file being transferred so --transfers 2 does not speed up the upload.
the backblaze speed test is not a good test
https://help.backblaze.com/hc/en-us/articles/217667448-What-performance-can-I-be-expected-to-achieve-with-B2-
"an estimate of your potential performance"
"Currently, a single thread should be able to upload or download at about 30 - 50 Mbits/sec"
https://help.backblaze.com/hc/en-us/articles/217665458-Why-is-my-backup-slow-
"Comcast PowerBoost or other "temporary speed enhancers" fool the Speed Test into thinking you have more bandwidth than you do."

YaPaY · August 31, 2020, 8:48pm

thanks.

Kadın.İşi.Banka.Soygunu.2014.1080p.Sansursuz.NF.WEB-DL.H264.AAC-TurkSeed.mkv: Done sending chunk 11

Killed

there is no more information. Maybe speedtest is not good idea but 2Mbps upload speed is really slow. (when I use cyberduck I see more and more speed)

asdffdsa · August 31, 2020, 8:52pm

did not know you can run cyberduck on pi?

pehaps the pi is running out of ram?
it has happened to my pi4 4GB.
i am not a linux expert but i have used top and htop to watch ram usage in real time

if you run the command without --transfers 2 --b2-chunk-size 200M does rclone crash?

ncw · August 31, 2020, 9:22pm

It is almost certainly running out of ram.

The default chunk size should be ok.

Rclone will do multiple blocks at once with B2 up to transfers and it does buffer then in ram.

You can try the

--b2-memory-pool-use-mmap

Flag or backend config which should help. (May be only in the beta can't remember)

jwink3101 · September 1, 2020, 2:21am

Since transfers do work for chunks but have to be buffered in ram, I would try upping the transfers and bringing down the chunk size so that you can hold it all in ram. Backblaze themselves is always talking about threads (transfers) being the best way to maximize bandwidth.

Is there a reason you need to be doing 250mb chunks?

system · November 1, 2020, 6:13am

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.