What is the problem you are having with rclone?
When copying a 15 GB file to B2, the copy stalls after a few chunks. It is within the last month my backup script started failing for large files.
Rclone copy works perfectly fine for smaller files <700MB, same destination.
Run the command 'rclone version' and share the full output of the command.
rclone v1.65.0-beta.7392.b296f3780
- os/version: slackware 15.0+ (64 bit)
- os/kernel: 6.1.49-Unraid (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.1
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Backblaze B2
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone copy ./Photoview.tar.gz backblaze_b2_photos:hpe-msg10p-photos/appdata -vv
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[backblaze_b2_photos]
type = b2
account = XXX
key = XXX
[local-remote]
type = alias
remote = /mnt/user/media/rclone-test
A log from the command that you were trying to run with the -vv flag
2023/09/28 22:24:16 DEBUG : rclone: Version "v1.65.0-beta.7392.b296f3780" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone/.rclone.conf" "copy" "./Photoview.tar.gz" "backblaze_b2_photos:hpe-msg10p-photos/appdata" "-vv"]
2023/09/28 22:24:16 DEBUG : Creating backend with remote "./Photoview.tar.gz"
2023/09/28 22:24:16 DEBUG : Using config file from "/boot/config/plugins/rclone/.rclone.conf"
2023/09/28 22:24:16 DEBUG : fs cache: adding new entry for parent of "./Photoview.tar.gz", "/mnt/user/other/backup/appdata/ab_20230925_204052"
2023/09/28 22:24:16 DEBUG : Creating backend with remote "backblaze_b2_photos:hpe-msg10p-photos/appdata"
2023/09/28 22:24:17 DEBUG : Couldn't decode error response: EOF
2023/09/28 22:24:17 DEBUG : Couldn't decode error response: EOF
2023/09/28 22:24:17 DEBUG : Photoview.tar.gz: Need to transfer - File not found at Destination
2023/09/28 22:25:17 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Transferred: 0 / 1, 0%
Elapsed time: 1m1.0s
Transferring:
* Photoview.tar.gz: transferring
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: Starting multi-thread copy with 159 chunks of size 96Mi with 16 parallel streams
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 16/159 (1509949440-1610612736) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 7/159 (603979776-704643072) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 2/159 (100663296-201326592) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 4/159 (301989888-402653184) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 8/159 (704643072-805306368) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 5/159 (402653184-503316480) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 1/159 (0-100663296) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 6/159 (503316480-603979776) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 3/159 (201326592-301989888) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 12/159 (1107296256-1207959552) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 10/159 (905969664-1006632960) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 11/159 (1006632960-1107296256) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 9/159 (805306368-905969664) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 15/159 (1409286144-1509949440) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 13/159 (1207959552-1308622848) size 96Mi starting
2023/09/28 22:25:25 DEBUG : Photoview.tar.gz: multi-thread copy: chunk 14/159 (1308622848-1409286144) size 96Mi starting
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 8 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 10 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 14 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 0 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 2 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 12 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 9 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 7 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 3 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 11 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 1 length 100663296
2023/09/28 22:25:26 DEBUG : Photoview.tar.gz: Sending chunk 6 length 100663296
2023/09/28 22:26:17 INFO :
Transferred: 96 MiB / 14.865 GiB, 1%, 445.978 KiB/s, ETA 9h38m49s
Transferred: 0 / 1, 0%
Elapsed time: 2m1.0s
Transferring:
* Photoview.tar.gz: 0% /14.865Gi, 646.232Ki/s, 6h39m27s
2023/09/28 22:27:17 INFO :
Transferred: 96 MiB / 14.865 GiB, 1%, 9.280 KiB/s, ETA 2w5d7h
Transferred: 0 / 1, 0%
Elapsed time: 3m1.0s
Transferring:
* Photoview.tar.gz: 0% /14.865Gi, 13.448Ki/s, 319h55m3s
2023/09/28 22:28:17 INFO :
Transferred: 96 MiB / 14.865 GiB, 1%, 197 B/s, ETA 2y28w2d
Transferred: 0 / 1, 0%
Elapsed time: 4m1.0s
Transferring:
* Photoview.tar.gz: 0% /14.865Gi, 286/s, 15373h6m19s
2023/09/28 22:29:17 INFO :
Transferred: 96 MiB / 14.865 GiB, 1%, 4 B/s, ETA 122y10w1d
Transferred: 0 / 1, 0%
Elapsed time: 5m1.0s
Transferring:
* Photoview.tar.gz: 0% /14.865Gi, 5/s, 738728h47m5s
2023/09/28 22:30:17 INFO :
Transferred: 96 MiB / 14.865 GiB, 1%, 0 B/s, ETA -
Transferred: 0 / 1, 0%
Elapsed time: 6m1.0s
Transferring:
* Photoview.tar.gz: 0% /14.865Gi, 0/s, 2562047h47m16s
2023/09/28 22:31:17 INFO :
Transferred: 96 MiB / 14.865 GiB, 1%, 0 B/s, ETA -
Transferred: 0 / 1, 0%
Elapsed time: 7m1.0s
Transferring:
* Photoview.tar.gz: 0% /14.865Gi, 0/s, 2562047h47m16s
^C2023/09/28 22:31:18 INFO : Signal received: interrupt
2023/09/28 22:31:18 DEBUG : Photoview.tar.gz: multi-thread copy: cancelling transfer on exit
2023/09/28 22:31:18 DEBUG : Photoview.tar.gz: Cancelling large file upload