Backblaze sync on windows on E: drive too slow

urko · September 19, 2023, 6:32pm

What is the problem you are having with rclone?

Sync never ends when I try to upload backup data on E: drive. I tried before with another directory (around 500MB) within C: and it took few minutes to upload.

Run the command 'rclone version' and share the full output of the command.

rclone v1.64.0

os/version: Microsoft Windows Server 2022 Datacenter 21H2 (64 bit)
os/kernel: 10.0.20348.1726 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.21.1
go/linking: static
go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Backblaze

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

C:\rclone-v1.64.0-windows-amd64\rclone -vv --fast-list --b2-hard-delete --progress --transfers 32 sync "E:\Backup" BACKBLAZE:my-bucket

The rclone config contents with secrets removed.

[BACKBLAZE]
type = b2
account = xxxxxxx
key = xxxxxx
hard_delete = true

A log from the command with the `-vv` flag

asdffdsa · September 19, 2023, 6:35pm

welcome to the forum,
very hard to read that tiny screen snippet, please just paste the text.

what you posted is just the ouput of --progress
best to use a debug log file, as that will show what rclone is doing.

what is e:, local drive, external drive, network share or what?

urko · September 19, 2023, 6:58pm

E: is local drive

2023/09/19 20:54:17 DEBUG : rclone: Version "v1.64.0" starting with parameters ["C:\\rclone-v1.64.0-windows-amd64\\rclone" "-vv" "--fast-list" "--b2-hard-delete" "--transfers" "32" "sync" "\\\\?\\E:\\Backup" "BACKBLAZE:mybucket"]
2023/09/19 20:54:17 DEBUG : Creating backend with remote "\\\\?\\E:\\Backup"
2023/09/19 20:54:17 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2023/09/19 20:54:17 DEBUG : fs cache: renaming cache item "\\\\?\\E:\\Backup" to be canonical "//?/E:/Backup"
2023/09/19 20:54:17 DEBUG : Creating backend with remote "BACKBLAZE:mybucket"
2023/09/19 20:54:17 DEBUG : BACKBLAZE: detected overridden config - adding "{jlU5h}" suffix to name
2023/09/19 20:54:17 DEBUG : fs cache: renaming cache item "BACKBLAZE:mybucket" to be canonical "BACKBLAZE{jlU5h}:mybucket"
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-09T140421.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-11T130032.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-12T130023.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-13T130029.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-14T130034.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-15T130017.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-16T140038.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-18T130025.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : Backup/file_2023-09-19T130024.file: Need to transfer - File not found at Destination
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-10_10-00-18.file: Size and modification time the same (differ by -741.4µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-10_10-00-18.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-11_10-00-16.file: Size and modification time the same (differ by -258.5µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-11_10-00-16.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-12_10-00-08.file: Size and modification time the same (differ by -395.2µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-12_10-00-08.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-13_10-00-16.file: Size and modification time the same (differ by -335.1µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-13_10-00-16.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-14_10-00-22.file: Size and modification time the same (differ by -251.5µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-14_10-00-22.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-15_10-00-25.file: Size and modification time the same (differ by -373.3µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-15_10-00-25.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-16_10-00-06.file: Size and modification time the same (differ by -679.4µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-16_10-00-06.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-17_10-00-06.file: Size and modification time the same (differ by -650.5µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-17_10-00-06.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-18_10-00-12.file: Size and modification time the same (differ by -124.9µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-18_10-00-12.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-19_10-00-11.file: Size and modification time the same (differ by -236.8µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : ConfigBackup/Server/file_2023-09-19_10-00-11.file: Unchanged skipping
2023/09/19 20:54:18 DEBUG : Backup/Backup.file: Size and modification time the same (differ by -560.8µs, within tolerance 1ms)
2023/09/19 20:54:18 DEBUG : Backup: Unchanged skipping
2023/09/19 20:54:18 DEBUG : B2 bucket mybucket: Waiting for checks to finish
2023/09/19 20:54:18 DEBUG : B2 bucket mybucket: Waiting for transfers to finish


2023/09/19 20:57:17 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                11 / 11, 100%
Transferred:            0 / 9, 0%
Elapsed time:       3m0.5s
Transferring:
 * Backup/…-09-09T140421.file: transferring
 * Backup/…-09-11T130032.file: transferring
 * Backup/…-09-12T130023.file: transferring
 * Backup/…-09-13T130029.file: transferring
 * Backup/…-09-14T130034.file: transferring
 * Backup/…-09-15T130017.file: transferring
 * Backup/…-09-16T140038.file: transferring
 * Backup/…-09-18T130025.file: transferring
 * Backup/…-09-19T130024.file: transferring

2023/09/19 20:58:17 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                11 / 11, 100%
Transferred:            0 / 9, 0%
Elapsed time:       4m0.5s
Transferring:
 * Backup/…-09-09T140421.file: transferring
 * Backup/…-09-11T130032.file: transferring
 * Backup/…-09-12T130023.file: transferring
 * Backup/…-09-13T130029.file: transferring
 * Backup/…-09-14T130034.file: transferring
 * Backup/…-09-15T130017.file: transferring
 * Backup/…-09-16T140038.file: transferring
 * Backup/…-09-18T130025.file: transferring
 * Backup/…-09-19T130024.file: transferring

urko · September 20, 2023, 7:37am

I've even tried copy and still same on this E: local drive.

2023/09/20 09:10:04 DEBUG : rclone: Version "v1.64.0" starting with parameters ["C:\\rclone-v1.64.0-windows-amd64\\rclone" "-vv" "--no-traverse" "copy" "\\\\?\\E:\\Backup" "BACKBLAZE:mybucket"]
2023/09/20 09:10:04 DEBUG : Creating backend with remote "\\\\?\\E:\\Backup"
2023/09/20 09:10:04 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2023/09/20 09:10:04 DEBUG : fs cache: renaming cache item "\\\\?\\E:\\Backup" to be canonical "//?/E:/Backup"
2023/09/20 09:10:04 DEBUG : Creating backend with remote "BACKBLAZE:mybucket"
2023/09/20 09:10:06 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:06 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : Couldn't decode error response: EOF
2023/09/20 09:10:07 DEBUG : D2023-09-09T140421.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-11T130032.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-12T130023.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-13T130029.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-14T130034.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-15T130017.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-16T140038.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-18T130025.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : D2023-09-19T130024.file: Need to transfer - File not found at Destination
2023/09/20 09:10:07 DEBUG : Backup.file: Size and modification time the same (differ by -560.8µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : Backup.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-11_10-00-16.file: Size and modification time the same (differ by -258.5µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-11_10-00-16.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-12_10-00-08.file: Size and modification time the same (differ by -395.2µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-12_10-00-08.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-13_10-00-16.file: Size and modification time the same (differ by -335.1µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-13_10-00-16.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-14_10-00-22.file: Size and modification time the same (differ by -251.5µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-14_10-00-22.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-15_10-00-25.file: Size and modification time the same (differ by -373.3µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-15_10-00-25.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-16_10-00-06.file: Size and modification time the same (differ by -679.4µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-16_10-00-06.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-17_10-00-06.file: Size and modification time the same (differ by -650.5µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-17_10-00-06.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-18_10-00-12.file: Size and modification time the same (differ by -124.9µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-18_10-00-12.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : 2023-09-19_10-00-11.file: Size and modification time the same (differ by -236.8µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-19_10-00-11.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : B2 bucket mybucket: Waiting for checks to finish
2023/09/20 09:10:07 DEBUG : 2023-09-10_10-00-18.file: Size and modification time the same (differ by -741.4µs, within tolerance 1ms)
2023/09/20 09:10:07 DEBUG : 2023-09-10_10-00-18.file: Unchanged skipping
2023/09/20 09:10:07 DEBUG : B2 bucket mybucket: Waiting for transfers to finish
Transferred:   	          0 B / 48.628 GiB, 0%, 0 B/s, ETA -
Checks:                11 / 11, 100%
Transferred:            0 / 9, 0%
Elapsed time:       1m0.5s
Transferring:
 * …-09-09T140421.file: transferring
 * …-09-11T130032.file: transferring
 * …-09-12T130023.file: transferring
 * …-09-13T130029.file: transferring


2023/09/20 09:15:05 INFO  : 
Transferred:   	          0 B / 48.628 GiB, 0%, 0 B/s, ETA -
Checks:                11 / 11, 100%
Transferred:            0 / 9, 0%
Elapsed time:       5m0.5s
Transferring:
 * Backup/…-09-09T140421.file: transferring
 * Backup/…-09-11T130032.file: transferring
 * Backup/…-09-12T130023.file: transferring
 * Backup/…-09-13T130029.file: transferring

2023/09/20 09:16:05 INFO  : 
Transferred:   	          0 B / 48.628 GiB, 0%, 0 B/s, ETA -
Checks:                11 / 11, 100%
Transferred:            0 / 9, 0%
Elapsed time:       6m0.5s
Transferring:
 * Backup/…-09-09T140421.file: transferring
 * Backup/…-09-11T130032.file: transferring
 * Backup/…-09-12T130023.file: transferring
 * Backup/…-09-13T130029.file: transferring

2023/09/20 09:17:05 INFO  : 
Transferred:   	          0 B / 48.628 GiB, 0%, 0 B/s, ETA -
Checks:                11 / 11, 100%
Transferred:            0 / 9, 0%
Elapsed time:       7m0.5s
Transferring:
 * Backup/…-09-09T140421.file: transferring
 * Backup/…-09-11T130032.file: transferring
 * Backup/…-09-12T130023.file: transferring
 * Backup/…-09-13T130029.file: transferring

kapitainsky · September 20, 2023, 8:09am

Could you try the previous rclone version? (v1.63.1)

There were some changes in B2 implementation in v1.64 - would be good to confirm if it is related to it or not.

urko · September 20, 2023, 8:25am

Same:

2023/09/20 10:24:10 INFO  : 
Transferred:   	   57.932 KiB / 93.920 GiB, 0%, 246 B/s, ETA 12y50w4d
Transferred:            1 / 20, 5%
Elapsed time:       1m0.5s
Transferring:
 * …-09-09T140421_9EEE.file:  0% /25.947Gi, 0/s, -
 * …-09-11T130032_4EEB.file:  0% /8.293Gi, 0/s, -
 * …-09-12T130023_B495.file:  0% /5.215Gi, 0/s, -
 * …-09-13T130029_6A97.file:  0% /5.824Gi, 0/s, -
 * …-09-14T130034_DB0A.file:  0% /5.239Gi, 0/s, -
 * …-09-15T130017_D505.file:  0% /5.727Gi, 0/s, -
 * …-09-16T140038_89CA.file:  0% /25.959Gi, 0/s, -
 * …-09-18T130025_AC18.file:  0% /6.449Gi, 0/s, -
 * …-09-19T130024_C267.file:  0% /5.255Gi, 0/s, -
 * …023-09-11_10-00-16.file:  0% /1.360Mi, 0/s, -
 * …023-09-12_10-00-08.file:  0% /1.370Mi, 0/s, -
 * …023-09-13_10-00-16.file:  0% /1.371Mi, 0/s, -
 * …023-09-14_10-00-22.file:  0% /1.377Mi, 0/s, -
 * …023-09-15_10-00-25.file:  0% /1.377Mi, 0/s, -
 * …023-09-16_10-00-06.file:  0% /1.358Mi, 0/s, -
 * …023-09-17_10-00-06.file:  0% /1.349Mi, 0/s, -
 * …023-09-18_10-00-12.file:  0% /1.353Mi, 0/s, -
 * …023-09-19_10-00-11.file:  0% /1.351Mi, 0/s, -
 * …023-09-20_10-00-08.file:  0% /1.359Mi, 0/s, -

I was using Rclone v1.59.2 then I switched to latest to see if this was the root of the problem. But looks like not. I've tried to sync with a directory of less than 70MB on C:/ local drive and it worked

kapitainsky · September 20, 2023, 8:47am

A bit of puzzle it is. Given that all works from drive C: it strongly points into some issue with your Windows not with rclone. I am not sure what can be wrong.

ncw · September 20, 2023, 8:48am

This may just be a long delay before starting to upload.

You can try

  --b2-disable-checksum   Disable checksums for large (> upload cutoff) files

urko · September 20, 2023, 9:06am

Still same

"Start date of backup is " 20.09.2023 
"Start time of backup is " 11:01:04,11 
2023/09/20 11:01:04 DEBUG : rclone: Version "v1.64.0" starting with parameters ["C:\\rclone-v1.64.0-windows-amd64\\rclone" "-vv" "--fast-list" "--b2-disable-checksum" "--b2-hard-delete" "--transfers" "32" "sync" "E:\\Backup" "mybucket"]
2023/09/20 11:01:04 DEBUG : Creating backend with remote "E:\\Backup"
2023/09/20 11:01:04 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2023/09/20 11:01:04 DEBUG : fs cache: renaming cache item "E:\\Backup" to be canonical "//?/E:/Backup"
2023/09/20 11:01:04 DEBUG : Creating backend with remote "mybucket"
2023/09/20 11:01:04 DEBUG : BACKBLAZE: detected overridden config - adding "{04jAt}" suffix to name
2023/09/20 11:01:04 DEBUG : fs cache: renaming cache item "mybucket" to be canonical "BACKBLAZE{04jAt}:mybucket"
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-11T130032_4EEB.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-12T130023_B495.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-13T130029_6A97.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-14T130034_DB0A.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-15T130017_D505.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-16T140038_89CA.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-18T130025_AC18.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : D2023-09-19T130024_C267.file: Need to transfer - File not found at Destination
2023/09/20 11:01:05 DEBUG : .file: Size and modification time the same (differ by -560.8µs, within tolerance 1ms)
2023/09/20 11:01:05 DEBUG : .file: Unchanged skipping
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: Starting multi-thread copy with 277 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 16/277 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 6/277 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 1/277 (0-100663296) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 2/277 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 7/277 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 8/277 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 3/277 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 9/277 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 4/277 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 10/277 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 5/277 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 11/277 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 14/277 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 15/277 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 12/277 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:05 DEBUG : D2023-09-09T140421_9EEE.file: multi-thread copy: chunk 13/277 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: Starting multi-thread copy with 89 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 16/89 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 7/89 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 1/89 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 8/89 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 2/89 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 9/89 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 3/89 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 10/89 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 4/89 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 11/89 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 5/89 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 12/89 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 6/89 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 13/89 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 14/89 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-11T130032_4EEB.file: multi-thread copy: chunk 15/89 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: Starting multi-thread copy with 56 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 16/56 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 7/56 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 8/56 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 1/56 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 9/56 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 2/56 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 10/56 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 3/56 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 11/56 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 4/56 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 12/56 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 5/56 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 13/56 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 6/56 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 14/56 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-12T130023_B495.file: multi-thread copy: chunk 15/56 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: Starting multi-thread copy with 63 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 16/63 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 7/63 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 8/63 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 9/63 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 1/63 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 10/63 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 11/63 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 12/63 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 13/63 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 14/63 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 2/63 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 15/63 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 3/63 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 6/63 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 4/63 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-13T130029_6A97.file: multi-thread copy: chunk 5/63 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: Starting multi-thread copy with 56 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 16/56 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 7/56 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 8/56 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 1/56 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 9/56 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 2/56 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 10/56 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 3/56 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 11/56 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 4/56 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 12/56 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 5/56 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 13/56 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 6/56 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 14/56 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-14T130034_DB0A.file: multi-thread copy: chunk 15/56 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: Starting multi-thread copy with 62 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 16/62 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 7/62 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 8/62 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 1/62 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 9/62 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 2/62 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 10/62 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 3/62 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 11/62 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 4/62 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 12/62 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 5/62 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 13/62 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 6/62 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 14/62 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: Starting multi-thread copy with 277 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 16/277 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-15T130017_D505.file: multi-thread copy: chunk 15/62 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 1/277 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 8/277 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 9/277 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 2/277 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 10/277 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 3/277 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 11/277 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 4/277 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 12/277 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 5/277 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 13/277 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 6/277 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 14/277 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 7/277 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-16T140038_89CA.file: multi-thread copy: chunk 15/277 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: Starting multi-thread copy with 69 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 16/69 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 2/69 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 1/69 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 4
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: Starting multi-thread copy with 57 chunks of size 96Mi with 16 parallel streams
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 16/57 (1509949440-1610612736) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 1/57 (0-100663296) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 3/69 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 4/69 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 2/57 (100663296-201326592) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 5/69 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 6/69 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 4/57 (301989888-402653184) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 5/57 (402653184-503316480) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 3/57 (201326592-301989888) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 6/57 (503316480-603979776) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 7/69 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 8/69 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 11/69 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 7/57 (603979776-704643072) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 8/57 (704643072-805306368) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 12/69 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 9/57 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 13/69 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 10/57 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 14/69 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 11/57 (1006632960-1107296256) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 15/69 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 12/57 (1107296256-1207959552) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 9/69 (805306368-905969664) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 13/57 (1207959552-1308622848) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-18T130025_AC18.file: multi-thread copy: chunk 10/69 (905969664-1006632960) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 14/57 (1308622848-1409286144) size 96Mi starting
2023/09/20 11:01:06 DEBUG : D2023-09-19T130024_C267.file: multi-thread copy: chunk 15/57 (1409286144-1509949440) size 96Mi starting
2023/09/20 11:01:12 DEBUG : 2023-09-11_10-00-16.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-12_10-00-08.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-13_10-00-16.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-14_10-00-22.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-15_10-00-25.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-16_10-00-06.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-17_10-00-06.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-18_10-00-12.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-19_10-00-11.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : 2023-09-20_10-00-08.file: Need to transfer - File not found at Destination
2023/09/20 11:01:12 DEBUG : B2 bucket mybucket: Waiting for checks to finish
2023/09/20 11:01:12 DEBUG : B2 bucket mybucket: Waiting for transfers to finish
2023/09/20 11:02:04 INFO  : 
Transferred:   	          0 B / 93.920 GiB, 0%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            0 / 19, 0%
Elapsed time:       1m0.5s
Transferring:
 * Bac…-09-09T140421_9EEE.file:  0% /25.947Gi, 0/s, -
 * Bac…-09-11T130032_4EEB.file:  0% /8.293Gi, 0/s, -
 * Bac…-09-12T130023_B495.file:  0% /5.215Gi, 0/s, -
 * Bac…-09-13T130029_6A97.file:  0% /5.824Gi, 0/s, -
 * Bac…-09-14T130034_DB0A.file:  0% /5.239Gi, 0/s, -
 * Bac…-09-15T130017_D505.file:  0% /5.727Gi, 0/s, -
 * Bac…-09-16T140038_89CA.file:  0% /25.959Gi, 0/s, -
 * Bac…-09-18T130025_AC18.file:  0% /6.449Gi, 0/s, -
 * Bac…-09-19T130024_C267.file:  0% /5.255Gi, 0/s, -
 * …023-09-11_10-00-16.file:  0% /1.360Mi, 0/s, -
 * …023-09-12_10-00-08.file:  0% /1.370Mi, 0/s, -
 * …023-09-13_10-00-16.file:  0% /1.371Mi, 0/s, -
 * …023-09-14_10-00-22.file:  0% /1.377Mi, 0/s, -
 * …023-09-15_10-00-25.file:  0% /1.377Mi, 0/s, -
 * …023-09-16_10-00-06.file:  0% /1.358Mi, 0/s, -
 * …023-09-17_10-00-06.file:  0% /1.349Mi, 0/s, -
 * …023-09-18_10-00-12.file:  0% /1.353Mi, 0/s, -
 * …023-09-19_10-00-11.file:  0% /1.351Mi, 0/s, -
 * …023-09-20_10-00-08.file:  0% /1.359Mi, 0/s, -

2023/09/20 11:03:04 INFO  : 
Transferred:   	          0 B / 93.920 GiB, 0%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            0 / 19, 0%
Elapsed time:       2m0.5s
Transferring:
 * 09-09T140421_9EEE.file:  0% /25.947Gi, 0/s, -
 * 09-11T130032_4EEB.file:  0% /8.293Gi, 0/s, -
 * 09-12T130023_B495.file:  0% /5.215Gi, 0/s, -
 * 09-13T130029_6A97.file:  0% /5.824Gi, 0/s, -
 * 09-14T130034_DB0A.file:  0% /5.239Gi, 0/s, -
 * 09-15T130017_D505.file:  0% /5.727Gi, 0/s, -
 * 09-16T140038_89CA.file:  0% /25.959Gi, 0/s, -
 * 09-18T130025_AC18.file:  0% /6.449Gi, 0/s, -
 * 09-19T130024_C267.file:  0% /5.255Gi, 0/s, -
 * …023-09-11_10-00-16.file:  0% /1.360Mi, 0/s, -
 * …023-09-12_10-00-08.file:  0% /1.370Mi, 0/s, -
 * …023-09-13_10-00-16.file:  0% /1.371Mi, 0/s, -
 * …023-09-14_10-00-22.file:  0% /1.377Mi, 0/s, -
 * …023-09-15_10-00-25.file:  0% /1.377Mi, 0/s, -
 * …023-09-16_10-00-06.file:  0% /1.358Mi, 0/s, -
 * …023-09-17_10-00-06.file:  0% /1.349Mi, 0/s, -
 * …023-09-18_10-00-12.file:  0% /1.353Mi, 0/s, -
 * …023-09-19_10-00-11.file:  0% /1.351Mi, 0/s, -
 * …023-09-20_10-00-08.file:  0% /1.359Mi, 0/s, -

ncw · September 20, 2023, 9:03pm

What kind of disk is E:? Is it an HDD?

It might be that rclone is overloading it.

Try reducing the number of --transfers (start with 1 an work up if that works) and also set --multi-thread-streams 0

urko · September 21, 2023, 9:07am

Hi again, I'm going to try this soon. By the way, I'm going to post here the last execution of the job while night (I forgot to disable it) but looks like some memory error:

2023/09/21 01:47:03 INFO  : 
Transferred:   	    5.781 MiB / 99.249 GiB, 0%, 0 B/s, ETA -
Errors:                10 (retrying may help)
Checks:                 1 / 1, 100%
Transferred:            1 / 11, 9%
Elapsed time:    2h17m0.5s
Transferring:
 * Backup/…-09-09T140421_.file:  0% /25.947Gi, 0/s, -
 * Backup/…-09-11T130032_.file:  0% /8.293Gi, 0/s, -
 * Backup/…-09-12T130023_.file:  0% /5.215Gi, 0/s, -
 * Backup/…-09-13T130029_.file:  0% /5.824Gi, 0/s, -
 * Backup/…-09-14T130034_.file:  0% /5.239Gi, 0/s, -
 * Backup/…-09-15T130017_.file:  0% /5.727Gi, 0/s, -
 * Backup/…-09-16T140038_.file:  0% /25.959Gi, 0/s, -
 * Backup/…-09-18T130025_.file:  0% /6.449Gi, 0/s, -
 * Backup/…-09-19T130024_.file:  0% /5.255Gi, 0/s, -
 * Backup/…-09-20T130023_.file:  0% /5.337Gi, 0/s, -

runtime: VirtualAlloc of 1048576 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x20fef60?, 0xc2a367f000?})
	runtime/panic.go:1077 +0x65 fp=0x52fcfcc8 sp=0x52fcfc98 pc=0x43ddc5
runtime.sysUsedOS(0xc2a3580000, 0x100000)
	runtime/mem_windows.go:83 +0x1bb fp=0x52fcfd28 sp=0x52fcfcc8 pc=0x41ad1b
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x38cb4a0, 0x80, 0x0, 0x8a?)
	runtime/mheap.go:1351 +0x487 fp=0x52fcfdc8 sp=0x52fcfd28 pc=0x42c927
runtime.(*mheap).alloc.func1()
	runtime/mheap.go:968 +0x5c fp=0x52fcfe10 sp=0x52fcfdc8 pc=0x42c0dc
runtime.systemstack()
	runtime/asm_amd64.s:509 +0x49 fp=0x52fcfe20 sp=0x52fcfe10 pc=0x470e09

goroutine 290 [running]:
runtime.systemstack_switch()
	runtime/asm_amd64.s:474 +0x8 fp=0xc000c49a00 sp=0xc000c499f0 pc=0x470da8
runtime.(*mheap).alloc(0x100000?, 0x80?, 0x0?)
	runtime/mheap.go:962 +0x5b fp=0xc000c49a48 sp=0xc000c49a00 pc=0x42c03b
runtime.(*mcache).allocLarge(0xc000c49a70?, 0x100000, 0xe0?)
	runtime/mcache.go:234 +0x85 fp=0xc000c49a90 sp=0xc000c49a48 pc=0x419be5
runtime.mallocgc(0x100000, 0x1be5780, 0x1)
	runtime/malloc.go:1123 +0x4f6 fp=0xc000c49af8 sp=0xc000c49a90 pc=0x410d96
runtime.makeslice(0xc0005c7278?, 0xc000c49b40?, 0xb1e945?)
	runtime/slice.go:103 +0x49 fp=0xc000c49b20 sp=0xc000c49af8 pc=0x453ae9
github.com/rclone/rclone/lib/pool.New.func1(0x69f78b90?)
	github.com/rclone/rclone/lib/pool/pool.go:54 +0x25 fp=0xc000c49b50 sp=0xc000c49b20 pc=0x888045
github.com/rclone/rclone/lib/pool.(*Pool).Get(0xc00034c2a0)
	github.com/rclone/rclone/lib/pool/pool.go:159 +0x85 fp=0xc000c49c00 sp=0xc000c49b50 pc=0x887005
github.com/rclone/rclone/lib/pool.(*RW).writePage(0xc000ae94f0)
	github.com/rclone/rclone/lib/pool/reader_writer.go:172 +0x7c fp=0xc000c49c68 sp=0xc000c49c00 pc=0x887bdc
github.com/rclone/rclone/lib/pool.(*RW).ReadFrom(0xc000ae94f0, {0x26d4400, 0xc0005c7290})
	github.com/rclone/rclone/lib/pool/reader_writer.go:208 +0x2e fp=0xc000c49cb0 sp=0xc000c49c68 pc=0x887dee
io.copyBuffer({0x26d4000, 0xc000ae94f0}, {0x26d4400, 0xc0005c7290}, {0x0, 0x0, 0x0})
	io/io.go:416 +0x147 fp=0xc000c49d30 sp=0xc000c49cb0 pc=0x4aef07
io.Copy(...)
	io/io.go:389
io.CopyN({0x26d4000, 0xc000ae94f0}, {0x4a7f1de0?, 0xc0000e9900}, 0x6000000)
	io/io.go:365 +0x91 fp=0xc000c49d80 sp=0xc000c49d30 pc=0x4aebf1
github.com/rclone/rclone/fs/operations.(*multiThreadCopyState).copyChunk(0xc0005cbbd0, {0x26f4f18, 0xc0005cbb80}, 0x7, {0x26ec2d0, 0xc0006b5970})
	github.com/rclone/rclone/fs/operations/multithread.go:99 +0x628 fp=0xc000c49f38 sp=0xc000c49d80 pc=0xb03ee8
github.com/rclone/rclone/fs/operations.multiThreadCopy.func2()
	github.com/rclone/rclone/fs/operations/multithread.go:213 +0x2b fp=0xc000c49f78 sp=0xc000c49f38 pc=0xb058cb
golang.org/x/sync/errgroup.(*Group).Go.func1()
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75 +0x56 fp=0xc000c49fe0 sp=0xc000c49f78 pc=0x7a2876
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000c49fe8 sp=0xc000c49fe0 pc=0x472dc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 50
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:72 +0x96

goroutine 1 [semacquire, 137 minutes]:
runtime.gopark(0xc0000883c0?, 0xc000929860?, 0xc0?, 0x83?, 0xc0005318c0?)
	runtime/proc.go:398 +0xce fp=0xc0009d9760 sp=0xc0009d9740 pc=0x440a4e
runtime.goparkunlock(...)
	runtime/proc.go:404
runtime.semacquire1(0xc0008ebe50, 0x1c?, 0x1, 0x0, 0x0?)
	runtime/sema.go:160 +0x229 fp=0xc0009d97c8 sp=0xc0009d9760 pc=0x451d89
sync.runtime_Semacquire(0x0?)
	runtime/sema.go:62 +0x25 fp=0xc0009d9800 sp=0xc0009d97c8 pc=0x46dc05
sync.(*WaitGroup).Wait(0x20bf520?)
	sync/waitgroup.go:116 +0x48 fp=0xc0009d9828 sp=0xc0009d9800 pc=0x482068
github.com/rclone/rclone/fs/sync.(*syncCopyMove).stopTransfers(0xc0008ebd40)
	github.com/rclone/rclone/fs/sync/sync.go:481 +0x66 fp=0xc0009d9870 sp=0xc0009d9828 pc=0x18ed986
github.com/rclone/rclone/fs/sync.(*syncCopyMove).run(0xc0008ebd40)
	github.com/rclone/rclone/fs/sync/sync.go:914 +0x318 fp=0xc0009d9900 sp=0xc0009d9870 pc=0x18f07b8
github.com/rclone/rclone/fs/sync.runSyncCopyMove({0x26f4888, 0x3909240}, {0x2706668, 0xc0007dd600}, {0x27079a8, 0xc0004f7860}, 0x3, 0x0, 0x0?, 0x0)
	github.com/rclone/rclone/fs/sync/sync.go:1136 +0x20e fp=0xc0009d9968 sp=0xc0009d9900 pc=0x18f1b6e
github.com/rclone/rclone/fs/sync.Sync({0x26f4888, 0x3909240}, {0x2706668, 0xc0007dd600}, {0x27079a8, 0xc0004f7860}, 0x33?)
	github.com/rclone/rclone/fs/sync/sync.go:1142 +0x72 fp=0xc0009d99c0 sp=0xc0009d9968 pc=0x18f1c52
github.com/rclone/rclone/cmd/sync.glob..func1.1()
	github.com/rclone/rclone/cmd/sync/sync.go:71 +0x45 fp=0xc0009d9a28 sp=0xc0009d99c0 pc=0x1a69c05
github.com/rclone/rclone/cmd.Run(0x1, 0x1, 0x2?, 0xc0009d9c98)
	github.com/rclone/rclone/cmd/cmd.go:258 +0x130 fp=0xc0009d9c60 sp=0xc0009d9a28 pc=0x190ceb0
github.com/rclone/rclone/cmd/sync.glob..func1(0xc0005f7f00?, {0xc0008e0980, 0x2, 0x8})
	github.com/rclone/rclone/cmd/sync/sync.go:69 +0xbd fp=0xc0009d9ce0 sp=0xc0009d9c60 pc=0x1a69b7d
github.com/spf13/cobra.(*Command).execute(0x3882f60, {0xc0000015c0, 0x8, 0xc})
	github.com/spf13/cobra@v1.7.0/command.go:944 +0x863 fp=0xc0009d9e18 sp=0xc0009d9ce0 pc=0x18f99e3
github.com/spf13/cobra.(*Command).ExecuteC(0x3876620)
	github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc0009d9ed0 sp=0xc0009d9e18 pc=0x18fa225
github.com/spf13/cobra.(*Command).Execute(...)
	github.com/spf13/cobra@v1.7.0/command.go:992
github.com/rclone/rclone/cmd.Main()
	github.com/rclone/rclone/cmd/cmd.go:570 +0x71 fp=0xc0009d9f30 sp=0xc0009d9ed0 pc=0x190ee91
main.main()
	github.com/rclone/rclone/rclone.go:14 +0xf fp=0xc0009d9f40 sp=0xc0009d9f30 pc=0x1a78c6f
runtime.main()
	runtime/proc.go:267 +0x2b2 fp=0xc0009d9fe0 sp=0xc0009d9f40 pc=0x440612
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc0009d9fe8 sp=0xc0009d9fe0 pc=0x472dc1

goroutine 2 [force gc (idle), 2 minutes]:
runtime.gopark(0x24b0b1a3ee5fdc?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:398 +0xce fp=0xc00006ffa8 sp=0xc00006ff88 pc=0x440a4e
runtime.goparkunlock(...)
	runtime/proc.go:404
runtime.forcegchelper()
	runtime/proc.go:322 +0xb8 fp=0xc00006ffe0 sp=0xc00006ffa8 pc=0x4408b8
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc00006ffe8 sp=0xc00006ffe0 pc=0x472dc1
created by runtime.init.6 in goroutine 1
	runtime/proc.go:310 +0x1a

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:398 +0xce fp=0xc000071f78 sp=0xc000071f58 pc=0x440a4e
runtime.goparkunlock(...)
	runtime/proc.go:404
runtime.bgsweep(0x0?)
	runtime/mgcsweep.go:321 +0xdf fp=0xc000071fc8 sp=0xc000071f78 pc=0x428e3f
runtime.gcenable.func1()
	runtime/mgc.go:200 +0x25 fp=0xc000071fe0 sp=0xc000071fc8 pc=0x41de05
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000071fe8 sp=0xc000071fe0 pc=0x472dc1
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:200 +0x66

goroutine 4 [GC scavenge wait]:
runtime.gopark(0xc00007c000?, 0x26c7968?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:398 +0xce fp=0xc000085f70 sp=0xc000085f50 pc=0x440a4e
runtime.goparkunlock(...)
	runtime/proc.go:404
runtime.(*scavengerState).park(0x38b1f20)
	runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa0 sp=0xc000085f70 pc=0x4266a9
runtime.bgscavenge(0x0?)
	runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa0 pc=0x426c59
runtime.gcenable.func2()
	runtime/mgc.go:201 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x41dda5
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x472dc1
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:201 +0xa5

goroutine 5 [finalizer wait, 40 minutes]:
runtime.gopark(0x0?, 0xc17c1ea3f0?, 0x0?, 0xe0?, 0x1000000010?)
	runtime/proc.go:398 +0xce fp=0xc000073e28 sp=0xc000073e08 pc=0x440a4e
runtime.runfinq()
	runtime/mfinal.go:193 +0x107 fp=0xc000073fe0 sp=0xc000073e28 pc=0x41cec7
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x472dc1
created by runtime.createfing in goroutine 1
	runtime/mfinal.go:163 +0x3d

goroutine 6 [GC worker (idle)]:
runtime.gopark(0x24b0b1a49d2f6c?, 0x2?, 0x64?, 0xe7?, 0x0?)
	runtime/proc.go:398 +0xce fp=0xc000087f50 sp=0xc000087f30 pc=0x440a4e
runtime.gcBgMarkWorker()
	runtime/mgc.go:1293 +0xe5 fp=0xc000087fe0 sp=0xc000087f50 pc=0x41fa05
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x472dc1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1217 +0x1c

goroutine 18 [GC worker (idle)]:
runtime.gopark(0x24b0b1a49afa30?, 0x2?, 0x80?, 0x95?, 0x0?)
	runtime/proc.go:398 +0xce fp=0xc000081f50 sp=0xc000081f30 pc=0x440a4e
runtime.gcBgMarkWorker()
	runtime/mgc.go:1293 +0xe5 fp=0xc000081fe0 sp=0xc000081f50 pc=0x41fa05
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x472dc1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1217 +0x1c

goroutine 19 [select]:
runtime.gopark(0xc000657f88?, 0x3?, 0x68?, 0x4?, 0xc000657f72?)
	runtime/proc.go:398 +0xce fp=0xc000657e18 sp=0xc000657df8 pc=0x440a4e
runtime.selectgo(0xc000657f88, 0xc000657f6c, 0xc0000e9f80?, 0x0, 0x0?, 0x1)
	runtime/select.go:327 +0x725 fp=0xc000657f38 sp=0xc000657e18 pc=0x450d45
go.opencensus.io/stats/view.(*worker).start(0xc0000e9f80)
	go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x9f fp=0xc000657fc8 sp=0xc000657f38 pc=0xd5621f
go.opencensus.io/stats/view.init.0.func1()
	go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x25 fp=0xc000657fe0 sp=0xc000657fc8 pc=0xd55545
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000657fe8 sp=0xc000657fe0 pc=0x472dc1
created by go.opencensus.io/stats/view.init.0 in goroutine 1
	go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x8d

goroutine 236 [syscall, 2 minutes, locked to thread]:
runtime.cgocall(0x4745a0, 0xc000bf0ac8)
	runtime/cgocall.go:157 +0x3e fp=0xc000a95860 sp=0xc000a95828 pc=0x40823e
syscall.SyscallN(0xc000a95a30?, {0xc000a958f8?, 0xc000a95920?, 0xb?})
	runtime/syscall_windows.go:544 +0x107 fp=0xc000a958d8 sp=0xc000a95860 pc=0x46f907
syscall.Syscall6(0x887dee?, 0x4aef07?, 0x4aebf1?, 0x4aebd0?, 0xb03ee8?, 0xb058cb?, 0x7a2876?, 0x472dc1?)
	runtime/syscall_windows.go:488 +0x4a fp=0xc000a95938 sp=0xc000a958d8 pc=0x46f5aa
syscall.readFile(0x0?, {0xc29d680000?, 0x100000, 0x0?}, 0x0?, 0x800000?)
	syscall/zsyscall_windows.go:1024 +0x8e fp=0xc000a959b0 sp=0xc000a95938 pc=0x48f2ae
syscall.ReadFile(...)
	syscall/syscall_windows.go:438
syscall.Read(0xc000362000?, {0xc29d680000?, 0x0?, 0x526f4ed18?})
	syscall/syscall_windows.go:417 +0x2d fp=0xc000a95a08 sp=0xc000a959b0 pc=0x487eed
internal/poll.(*FD).Read(0xc000362000, {0xc29d680000, 0x100000, 0x100000})
	internal/poll/fd_windows.go:422 +0x1c5 fp=0xc000a95ab0 sp=0xc000a95a08 pc=0x4fb885
os.(*File).read(...)
	os/file_posix.go:29
os.(*File).Read(0xc000880450, {0xc29d680000?, 0x1be5780?, 0xc000688c01?})
	os/file.go:118 +0x52 fp=0xc000a95af0 sp=0xc000a95ab0 pc=0x507592
io.(*LimitedReader).Read(0xc0005c7680, {0xc29d680000?, 0xc00?, 0xc00?})
	io/io.go:480 +0x42 fp=0xc000a95b20 sp=0xc000a95af0 pc=0x4af102
github.com/rclone/rclone/lib/readers.(*LimitedReadCloser).Read(0x745d1738?, {0xc29d680000?, 0xc00?, 0xc000bf0800?})
	<autogenerated>:1 +0x25 fp=0xc000a95b50 sp=0xc000a95b20 pc=0x889365
github.com/rclone/rclone/fs/operations.(*ReOpen).Read(0xc000659c80, {0xc29d680000?, 0x100000?, 0xc29d680000?})
	github.com/rclone/rclone/fs/operations/reopen.go:136 +0xf7 fp=0xc000a95c38 sp=0xc000a95b50 pc=0xb1e597
io.(*LimitedReader).Read(0xc0005c7698, {0xc29d680000?, 0x100000?, 0x100000?})
	io/io.go:480 +0x42 fp=0xc000a95c68 sp=0xc000a95c38 pc=0x4af102
github.com/rclone/rclone/lib/pool.(*RW).ReadFrom(0xc000ae9a40, {0x26d4400, 0xc0005c7698})
	github.com/rclone/rclone/lib/pool/reader_writer.go:209 +0x47 fp=0xc000a95cb0 sp=0xc000a95c68 pc=0x887e07
io.copyBuffer({0x26d4000, 0xc000ae9a40}, {0x26d4400, 0xc0005c7698}, {0x0, 0x0, 0x0})
	io/io.go:416 +0x147 fp=0xc000a95d30 sp=0xc000a95cb0 pc=0x4aef07
io.Copy(...)
	io/io.go:389
io.CopyN({0x26d4000, 0xc000ae9a40}, {0x4a7f1de0?, 0xc000659c80}, 0x6000000)
	io/io.go:365 +0x91 fp=0xc000a95d80 sp=0xc000a95d30 pc=0x4aebf1
github.com/rclone/rclone/fs/operations.(*multiThreadCopyState).copyChunk(0xc0005cba40, {0x26f4f18, 0xc0005cb9f0}, 0x2, {0x26ec2d0, 0xc0006b58c0})
	github.com/rclone/rclone/fs/operations/multithread.go:99 +0x628 fp=0xc000a95f38 sp=0xc000a95d80 pc=0xb03ee8
github.com/rclone/rclone/fs/operations.multiThreadCopy.func2()
	github.com/rclone/rclone/fs/operations/multithread.go:213 +0x2b fp=0xc000a95f78 sp=0xc000a95f38 pc=0xb058cb
golang.org/x/sync/errgroup.(*Group).Go.func1()
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75 +0x56 fp=0xc000a95fe0 sp=0xc000a95f78 pc=0x7a2876
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000a95fe8 sp=0xc000a95fe0 pc=0x472dc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 48
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:72 +0x96

goroutine 34 [select, 2 minutes]:
runtime.gopark(0xc000a9ffa8?, 0x2?, 0xa5?, 0xe?, 0xc000a9ff84?)
	runtime/proc.go:398 +0xce fp=0xc000a6fe28 sp=0xc000a6fe08 pc=0x440a4e
runtime.selectgo(0xc000a6ffa8, 0xc000a9ff80, 0x20fbac4?, 0x0, 0x0?, 0x1)
	runtime/select.go:327 +0x725 fp=0xc000a6ff48 sp=0xc000a6fe28 pc=0x450d45
github.com/rclone/rclone/cmd.StartStats.func2()
	github.com/rclone/rclone/cmd/cmd.go:373 +0xda fp=0xc000a6ffe0 sp=0xc000a6ff48 pc=0x190e0ba
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000a6ffe8 sp=0xc000a6ffe0 pc=0x472dc1
created by github.com/rclone/rclone/cmd.StartStats in goroutine 1
	github.com/rclone/rclone/cmd/cmd.go:369 +0xa7

goroutine 238 [syscall, 2 minutes, locked to thread]:
runtime.cgocall(0x4745a0, 0xc000bf12c8)
	runtime/cgocall.go:157 +0x3e fp=0xc000ac9860 sp=0xc000ac9828 pc=0x40823e
syscall.SyscallN(0xc000ac9a30?, {0xc000ac98f8?, 0xc000ac9920?, 0xb?})
	runtime/syscall_windows.go:544 +0x107 fp=0xc000ac98d8 sp=0xc000ac9860 pc=0x46f907
syscall.Syscall6(0x887dee?, 0x4aef07?, 0x4aebf1?, 0x4aebd0?, 0xb03ee8?, 0xb058cb?, 0x7a2876?, 0x472dc1?)
	runtime/syscall_windows.go:488 +0x4a fp=0xc000ac9938 sp=0xc000ac98d8 pc=0x46f5aa
syscall.readFile(0x0?, {0xc29d780000?, 0x100000, 0x0?}, 0x0?, 0x800000?)
	syscall/zsyscall_windows.go:1024 +0x8e fp=0xc000ac99b0 sp=0xc000ac9938 pc=0x48f2ae
syscall.ReadFile(...)
	syscall/syscall_windows.go:438
syscall.Read(0xc0007e5900?, {0xc29d780000?, 0x0?, 0x526f4ed18?})
	syscall/syscall_windows.go:417 +0x2d fp=0xc000ac9a08 sp=0xc000ac99b0 pc=0x487eed
internal/poll.(*FD).Read(0xc0007e5900, {0xc29d780000, 0x100000, 0x100000})
	internal/poll/fd_windows.go:422 +0x1c5 fp=0xc000ac9ab0 sp=0xc000ac9a08 pc=0x4fb885
os.(*File).read(...)
	os/file_posix.go:29
os.(*File).Read(0xc000880428, {0xc29d780000?, 0x1be5780?, 0x1?})
	os/file.go:118 +0x52 fp=0xc000ac9af0 sp=0xc000ac9ab0 pc=0x507592
io.(*LimitedReader).Read(0xc0005c6d80, {0xc29d780000?, 0xb1e945?, 0x100000?})
	io/io.go:480 +0x42 fp=0xc000ac9b20 sp=0xc000ac9af0 pc=0x4af102
github.com/rclone/rclone/lib/readers.(*LimitedReadCloser).Read(0x70c06498?, {0xc29d780000?, 0xc00?, 0xc000bf1000?})
	<autogenerated>:1 +0x25 fp=0xc000ac9b50 sp=0xc000ac9b20 pc=0x889365
github.com/rclone/rclone/fs/operations.(*ReOpen).Read(0xc000659d80, {0xc29d780000?, 0x100000?, 0xc26b780000?})
	github.com/rclone/rclone/fs/operations/reopen.go:136 +0xf7 fp=0xc000ac9c38 sp=0xc000ac9b50 pc=0xb1e597
io.(*LimitedReader).Read(0xc0005c6dc8, {0xc29d780000?, 0x40ec58?, 0x1d154c0?})
	io/io.go:480 +0x42 fp=0xc000ac9c68 sp=0xc000ac9c38 pc=0x4af102
github.com/rclone/rclone/lib/pool.(*RW).ReadFrom(0xc000ae99a0, {0x26d4400, 0xc0005c6dc8})
	github.com/rclone/rclone/lib/pool/reader_writer.go:209 +0x47 fp=0xc000ac9cb0 sp=0xc000ac9c68 pc=0x887e07
io.copyBuffer({0x26d4000, 0xc000ae99a0}, {0x26d4400, 0xc0005c6dc8}, {0x0, 0x0, 0x0})
	io/io.go:416 +0x147 fp=0xc000ac9d30 sp=0xc000ac9cb0 pc=0x4aef07
io.Copy(...)
	io/io.go:389
io.CopyN({0x26d4000, 0xc000ae99a0}, {0x4a7f1de0?, 0xc000659d80}, 0x6000000)
	io/io.go:365 +0x91 fp=0xc000ac9d80 sp=0xc000ac9d30 pc=0x4aebf1
github.com/rclone/rclone/fs/operations.(*multiThreadCopyState).copyChunk(0xc0005cba40, {0x26f4f18, 0xc0005cb9f0}, 0x4, {0x26ec2d0, 0xc0006b58c0})
	github.com/rclone/rclone/fs/operations/multithread.go:99 +0x628 fp=0xc000ac9f38 sp=0xc000ac9d80 pc=0xb03ee8
github.com/rclone/rclone/fs/operations.multiThreadCopy.func2()
	github.com/rclone/rclone/fs/operations/multithread.go:213 +0x2b fp=0xc000ac9f78 sp=0xc000ac9f38 pc=0xb058cb
golang.org/x/sync/errgroup.(*Group).Go.func1()
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75 +0x56 fp=0xc000ac9fe0 sp=0xc000ac9f78 pc=0x7a2876
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000ac9fe8 sp=0xc000ac9fe0 pc=0x472dc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 48
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:72 +0x96

goroutine 43 [chan send, 137 minutes]:
runtime.gopark(0xc000a57950?, 0x410ea5?, 0x0?, 0x4c?, 0x18?)
	runtime/proc.go:398 +0xce fp=0xc0009cf8e8 sp=0xc0009cf8c8 pc=0x440a4e
runtime.chansend(0xc000830600, 0xc0009cf998, 0x1, 0xc000a57998?)
	runtime/chan.go:259 +0x3a5 fp=0xc0009cf958 sp=0xc0009cf8e8 pc=0x408f65
runtime.chansend1(0x1f1b2e0?, 0xc00091c901?)
	runtime/chan.go:145 +0x17 fp=0xc0009cf988 sp=0xc0009cf958 pc=0x408bb7
golang.org/x/sync/errgroup.(*Group).Go(0xc00061c9c0, 0xc00061d080)
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:68 +0x32 fp=0xc0009cf9a8 sp=0xc0009cf988 pc=0x7a2792
github.com/rclone/rclone/fs/operations.multiThreadCopy({0x26f4f18?, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0xc0008aa8c0, 0x34}, {0x2707a18?, 0xc00091ef60}, 0x4, 0xc00091c8c0)
	github.com/rclone/rclone/fs/operations/multithread.go:212 +0xbd8 fp=0xc0009cfbe0 sp=0xc0009cf9a8 pc=0xb05198
github.com/rclone/rclone/fs/operations.Copy({0x26f4f18, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0x0?, 0x0?}, {0xc0008aa8c0, 0x34}, {0x2707a18, 0xc00091ef60})
	github.com/rclone/rclone/fs/operations/operations.go:422 +0xc3e fp=0xc0009cfee0 sp=0xc0009cfbe0 pc=0xb08f7e
github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc0008ebd40, {0x26f4f18, 0xc0007ded20}, 0x0?, {0x2706668, 0xc0007dd600}, 0x0?, 0x0?)
	github.com/rclone/rclone/fs/sync/sync.go:446 +0x1f6 fp=0xc0009cff90 sp=0xc0009cfee0 pc=0x18ed3d6
github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers.func1()
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x3c fp=0xc0009cffe0 sp=0xc0009cff90 pc=0x18ed8fc
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc0009cffe8 sp=0xc0009cffe0 pc=0x472dc1
created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 1
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x45

goroutine 44 [chan send, 137 minutes]:
runtime.gopark(0xc000a47950?, 0x410ed3?, 0x40?, 0x68?, 0x18?)
	runtime/proc.go:398 +0xce fp=0xc0009c78e8 sp=0xc0009c78c8 pc=0x440a4e
runtime.chansend(0xc000830180, 0xc0009c7998, 0x1, 0xc000a47998?)
	runtime/chan.go:259 +0x3a5 fp=0xc0009c7958 sp=0xc0009c78e8 pc=0x408f65
runtime.chansend1(0xffffffffffffffff?, 0x100000000?)
	runtime/chan.go:145 +0x17 fp=0xc0009c7988 sp=0xc0009c7958 pc=0x408bb7
golang.org/x/sync/errgroup.(*Group).Go(0xc00061c0c0, 0xc00061c700)
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:68 +0x32 fp=0xc0009c79a8 sp=0xc0009c7988 pc=0x7a2792
github.com/rclone/rclone/fs/operations.multiThreadCopy({0x26f4f18?, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0xc0008aa740, 0x34}, {0x2707a18?, 0xc00091eea0}, 0x4, 0xc00091c780)
	github.com/rclone/rclone/fs/operations/multithread.go:212 +0xbd8 fp=0xc0009c7be0 sp=0xc0009c79a8 pc=0xb05198
github.com/rclone/rclone/fs/operations.Copy({0x26f4f18, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0x0?, 0x0?}, {0xc0008aa740, 0x34}, {0x2707a18, 0xc00091eea0})
	github.com/rclone/rclone/fs/operations/operations.go:422 +0xc3e fp=0xc0009c7ee0 sp=0xc0009c7be0 pc=0xb08f7e
github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc0008ebd40, {0x26f4f18, 0xc0007ded20}, 0x0?, {0x2706668, 0xc0007dd600}, 0x0?, 0x0?)
	github.com/rclone/rclone/fs/sync/sync.go:446 +0x1f6 fp=0xc0009c7f90 sp=0xc0009c7ee0 pc=0x18ed3d6
github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers.func1()
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x3c fp=0xc0009c7fe0 sp=0xc0009c7f90 pc=0x18ed8fc
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc0009c7fe8 sp=0xc0009c7fe0 pc=0x472dc1
created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 1
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x45

goroutine 46 [chan send, 137 minutes]:
runtime.gopark(0xc0007c7950?, 0x410ea5?, 0xb0?, 0x2d?, 0x18?)
	runtime/proc.go:398 +0xce fp=0xc000bcd8e8 sp=0xc000bcd8c8 pc=0x440a4e
runtime.chansend(0xc0006dc9c0, 0xc000bcd998, 0x1, 0xc0007c7998?)
	runtime/chan.go:259 +0x3a5 fp=0xc000bcd958 sp=0xc000bcd8e8 pc=0x408f65
runtime.chansend1(0x1f1b2e0?, 0xc0005fc501?)
	runtime/chan.go:145 +0x17 fp=0xc000bcd988 sp=0xc000bcd958 pc=0x408bb7
golang.org/x/sync/errgroup.(*Group).Go(0xc00088a100, 0xc00088a540)
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:68 +0x32 fp=0xc000bcd9a8 sp=0xc000bcd988 pc=0x7a2792
github.com/rclone/rclone/fs/operations.multiThreadCopy({0x26f4f18?, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0xc0008aa1c0, 0x34}, {0x2707a18?, 0xc00091ec00}, 0x4, 0xc0005fc5a0)
	github.com/rclone/rclone/fs/operations/multithread.go:212 +0xbd8 fp=0xc000bcdbe0 sp=0xc000bcd9a8 pc=0xb05198
github.com/rclone/rclone/fs/operations.Copy({0x26f4f18, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0x0?, 0x0?}, {0xc0008aa1c0, 0x34}, {0x2707a18, 0xc00091ec00})
	github.com/rclone/rclone/fs/operations/operations.go:422 +0xc3e fp=0xc000bcdee0 sp=0xc000bcdbe0 pc=0xb08f7e
github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc0008ebd40, {0x26f4f18, 0xc0007ded20}, 0xc0008c75e0?, {0x2706668, 0xc0007dd600}, 0xc0008fe780?, 0xc0008b43c0?)
	github.com/rclone/rclone/fs/sync/sync.go:446 +0x1f6 fp=0xc000bcdf90 sp=0xc000bcdee0 pc=0x18ed3d6
github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers.func1()
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x3c fp=0xc000bcdfe0 sp=0xc000bcdf90 pc=0x18ed8fc
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000bcdfe8 sp=0xc000bcdfe0 pc=0x472dc1
created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 1
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x45

goroutine 47 [chan send, 137 minutes]:
runtime.gopark(0xc000a2b950?, 0x410ea5?, 0xd8?, 0x6f?, 0x18?)
	runtime/proc.go:398 +0xce fp=0xc000bcf8e8 sp=0xc000bcf8c8 pc=0x440a4e
runtime.chansend(0xc000831380, 0xc000bcf998, 0x1, 0xc000a2b998?)
	runtime/chan.go:259 +0x3a5 fp=0xc000bcf958 sp=0xc000bcf8e8 pc=0x408f65
runtime.chansend1(0x1f1b2e0?, 0xc00091c401?)
	runtime/chan.go:145 +0x17 fp=0xc000bcf988 sp=0xc000bcf958 pc=0x408bb7
golang.org/x/sync/errgroup.(*Group).Go(0xc00061d300, 0xc00061d900)
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:68 +0x32 fp=0xc000bcf9a8 sp=0xc000bcf988 pc=0x7a2792
github.com/rclone/rclone/fs/operations.multiThreadCopy({0x26f4f18?, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0xc0008aa380, 0x34}, {0x2707a18?, 0xc00091ecc0}, 0x4, 0xc00091c460)
	github.com/rclone/rclone/fs/operations/multithread.go:212 +0xbd8 fp=0xc000bcfbe0 sp=0xc000bcf9a8 pc=0xb05198
github.com/rclone/rclone/fs/operations.Copy({0x26f4f18, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0x0?, 0x0?}, {0xc0008aa380, 0x34}, {0x2707a18, 0xc00091ecc0})
	github.com/rclone/rclone/fs/operations/operations.go:422 +0xc3e fp=0xc000bcfee0 sp=0xc000bcfbe0 pc=0xb08f7e
github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc0008ebd40, {0x26f4f18, 0xc0007ded20}, 0xc0005fa320?, {0x2706668, 0xc0007dd600}, 0xc0005ad380?, 0xc0005fa640?)
	github.com/rclone/rclone/fs/sync/sync.go:446 +0x1f6 fp=0xc000bcff90 sp=0xc000bcfee0 pc=0x18ed3d6
github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers.func1()
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x3c fp=0xc000bcffe0 sp=0xc000bcff90 pc=0x18ed8fc
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000bcffe8 sp=0xc000bcffe0 pc=0x472dc1
created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 1
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x45

goroutine 48 [chan send, 137 minutes]:
runtime.gopark(0xc000a33950?, 0x410ea5?, 0x68?, 0x4d?, 0x18?)
	runtime/proc.go:398 +0xce fp=0xc000c1f8e8 sp=0xc000c1f8c8 pc=0x440a4e
runtime.chansend(0xc000c023c0, 0xc000c1f998, 0x1, 0xc000a33998?)
	runtime/chan.go:259 +0x3a5 fp=0xc000c1f958 sp=0xc000c1f8e8 pc=0x408f65
runtime.chansend1(0x1f1b2e0?, 0xc00091c501?)
	runtime/chan.go:145 +0x17 fp=0xc000c1f988 sp=0xc000c1f958 pc=0x408bb7
golang.org/x/sync/errgroup.(*Group).Go(0xc00088b440, 0xc00088b880)
	golang.org/x/sync@v0.3.0/errgroup/errgroup.go:68 +0x32 fp=0xc000c1f9a8 sp=0xc000c1f988 pc=0x7a2792
github.com/rclone/rclone/fs/operations.multiThreadCopy({0x26f4f18?, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0xc0008aa440, 0x34}, {0x2707a18?, 0xc00091ed20}, 0x4, 0xc00091c500)
	github.com/rclone/rclone/fs/operations/multithread.go:212 +0xbd8 fp=0xc000c1fbe0 sp=0xc000c1f9a8 pc=0xb05198
github.com/rclone/rclone/fs/operations.Copy({0x26f4f18, 0xc0007ded20}, {0x2706668, 0xc0007dd600}, {0x0?, 0x0?}, {0xc0008aa440, 0x34}, {0x2707a18, 0xc00091ed20})
	github.com/rclone/rclone/fs/operations/operations.go:422 +0xc3e fp=0xc000c1fee0 sp=0xc000c1fbe0 pc=0xb08f7e
github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc0008ebd40, {0x26f4f18, 0xc0007ded20}, 0x0?, {0x2706668, 0xc0007dd600}, 0x0?, 0x0?)
	github.com/rclone/rclone/fs/sync/sync.go:446 +0x1f6 fp=0xc000c1ff90 sp=0xc000c1fee0 pc=0x18ed3d6
github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers.func1()
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x3c fp=0xc000c1ffe0 sp=0xc000c1ff90 pc=0x18ed8fc
runtime.goexit()
	runtime/asm_amd64.s:1650 +0x1 fp=0xc000c1ffe8 sp=0xc000c1ffe0 pc=0x472dc1
created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 1
	github.com/rclone/rclone/fs/sync/sync.go:473 +0x45
.....

I've also added the full crash log as file (half MB)
rclone-crash-log.txt (543.0 KB)

urko · September 21, 2023, 9:16am

HI again, this is the execution log using the flags you suggested:

2023/09/21 11:08:55 DEBUG : rclone: Version "v1.64.0" starting with parameters ["C:\\rclone-v1.64.0-windows-amd64\\rclone" "-vv" "--fast-list" "--b2-disable-checksum" "--b2-hard-delete" "--transfers" "1" "--multi-thread-streams" "0" "sync" "E:\\Backup" "BACKBLAZE:mybucket"]
2023/09/21 11:08:55 DEBUG : Creating backend with remote "E:\\Backup"
2023/09/21 11:08:55 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2023/09/21 11:08:55 DEBUG : fs cache: renaming cache item "E:\\Backup" to be canonical "//?/E:/Backup"
2023/09/21 11:08:55 DEBUG : Creating backend with remote "BACKBLAZE:mybucket"
2023/09/21 11:08:55 DEBUG : BACKBLAZE: detected overridden config - adding "{04jAt}" suffix to name
2023/09/21 11:08:55 DEBUG : fs cache: renaming cache item "BACKBLAZE:mybucket" to be canonical "BACKBLAZE{04jAt}:mybucket"
2023/09/21 11:09:05 DEBUG : 2023-09-09T140421.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-11T130032.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-12T130023.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-13T130029.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-14T130034.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-15T130017.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-16T140038.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-18T130025.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-19T130024.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : 2023-09-20T130023.file: Need to transfer - File not found at Destination
2023/09/21 11:09:05 DEBUG : kup.file: Size and modification time the same (differ by -288.9µs, within tolerance 1ms)
2023/09/21 11:09:05 DEBUG : kup.file: Unchanged skipping
2023/09/21 11:09:09 DEBUG : 2023-09-12_10-00-08.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-13_10-00-16.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-14_10-00-22.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-15_10-00-25.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-16_10-00-06.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-17_10-00-06.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-18_10-00-12.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-19_10-00-11.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-20_10-00-08.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : 2023-09-21_10-00-20.file: Need to transfer - File not found at Destination
2023/09/21 11:09:09 DEBUG : B2 bucket mybucket: Waiting for checks to finish
2023/09/21 11:09:09 DEBUG : B2 bucket mybucket: Waiting for transfers to finish
2023/09/21 11:09:55 INFO  : 
Transferred:   	    1.996 MiB / 99.257 GiB, 0%, 89.928 KiB/s, ETA 1w6d9h
Checks:                 1 / 1, 100%
Transferred:            0 / 20, 0%
Elapsed time:       1m0.5s
Transferring:
 * …-09-09T140421_9EEE.file:  0% /25.947Gi, 89.928Ki/s, 84h2m0s

2023/09/21 11:10:55 INFO  : 
Transferred:   	   11.996 MiB / 99.257 GiB, 0%, 169.489 KiB/s, ETA 1w2h33m
Checks:                 1 / 1, 100%
Transferred:            0 / 20, 0%
Elapsed time:       2m0.5s
Transferring:
 * …-09-09T140421_9EEE.file:  0% /25.947Gi, 169.489Ki/s, 44h34m11s

2023/09/21 11:11:55 INFO  : 
Transferred:   	   22.996 MiB / 99.257 GiB, 0%, 218.514 KiB/s, ETA 5d12h16m
Checks:                 1 / 1, 100%
Transferred:            0 / 20, 0%
Elapsed time:       3m0.5s
Transferring:
 * …-09-09T140421_9EEE.file:  0% /25.947Gi, 218.514Ki/s, 34h33m22s

As you can see it is pretty slow. Let me show you log vs files within C: drive

2023/09/21 11:25:42 DEBUG : rclone: Version "v1.64.0" starting with parameters ["C:\\rclone-v1.64.0-windows-amd64\\rclone" "-vv" "--fast-list" "--b2-disable-checksum" "--b2-hard-delete" "--transfers" "1" "--multi-thread-streams" "0" "sync" "\\\\?\\C:\\PC SOFT" "BACKBLAZE:mybucket"]
2023/09/21 11:25:42 DEBUG : Creating backend with remote "\\\\?\\C:\\PC SOFT"
2023/09/21 11:25:42 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2023/09/21 11:25:42 DEBUG : fs cache: renaming cache item "\\\\?\\C:\\PC SOFT" to be canonical "//?/C:/PC SOFT"
2023/09/21 11:25:42 DEBUG : Creating backend with remote "BACKBLAZE:mybucket"
2023/09/21 11:25:42 DEBUG : BACKBLAZE: detected overridden config - adding "{04jAt}" suffix to name
2023/09/21 11:25:42 DEBUG : fs cache: renaming cache item "BACKBLAZE:mybucket" to be canonical "BACKBLAZE{04jAt}:mybucket"
2023/09/21 11:25:43 DEBUG : HFConf.ini: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : hflogger64.exe: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : hfmailer64.exe: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : manta64.exe: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : mantamanager64.exe: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270com64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270cpl64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270hf64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270html64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270mat64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270net2_64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270ole64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270pdf64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270pnt64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270rtf64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270sql64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270std64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270uni64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270vm64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270xls64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270xml64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wd270zip64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wdhfsrv64.dll: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : wdsqlsrv64.DLL: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__rpl/subscriber/1052_7/part_152.hyl: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__rpl/subscriber/1052_7/rpl.filter: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__rpl/subscriber/1052_7/rpl.pos: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Alert.fic: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Alert.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Alert.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/AlertMail.fic: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/AlertMail.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Backup.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Backup.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Backup.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/BackupHistory.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/BackupHistory.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/BackupHistory.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/DataBaseRight.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/DataBaseRight.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/GroupTable.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/GroupTable.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/GroupTable.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Integrity.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Integrity.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/IntegrityVersion.fic: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/IntegrityVersion.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Meta.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Meta.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Meta.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/QueryLog.fic: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/QueryLog.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/QueryLog.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/ReplicationConfig.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/ReplicationConfig.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/ReplicationConfig.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/ServerRight.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/ServerRight.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/TableRight.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/TableRight.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Task.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Task.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/Task.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/UserTable.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/UserTable.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/UserTable.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/UserTable_GroupTable.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__System/UserTable_GroupTable.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__JNL/__JNL/JNL_FILES.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__JNL/__JNL/JNL_FILES.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__JNL/__JNL/JNL_OPERATION.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__JNL/__JNL/JNL_OPERATION.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__JNL/__JNL/JNL_USERS.FIC: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__JNL/__JNL/JNL_USERS.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__TRS/TRSOperation.TRS: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__TRS/TRSOperation.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__TRS/TRSOperationInfoClient.TRS: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__TRS/TRSOperationInfoClient.mmo: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : BDD/__TRS/TRSOperationInfoClient.ndx: Need to transfer - File not found at Destination
2023/09/21 11:25:43 DEBUG : B2 bucket mybucket: Waiting for checks to finish
2023/09/21 11:25:43 DEBUG : B2 bucket mybucket: Waiting for transfers to finish
2023/09/21 11:25:45 DEBUG : HFConf.ini: sha1 = ba1286486a2a230eaa00e9f7768d31dd063e4e94 OK
2023/09/21 11:25:45 INFO  : HFConf.ini: Copied (new)
2023/09/21 11:25:47 DEBUG : hflogger64.exe: sha1 = 0ee192a9ea93bef44bbd31b79e1fb82138224fba OK
2023/09/21 11:25:47 INFO  : hflogger64.exe: Copied (new)
2023/09/21 11:25:49 DEBUG : hfmailer64.exe: sha1 = 7ca4c5e0fe8437bd148e29b7cedda6b87c2f1044 OK
2023/09/21 11:25:49 INFO  : hfmailer64.exe: Copied (new)
2023/09/21 11:25:49 DEBUG : manta64.exe: sha1 = 08b8ff575a4a8564dc008dd4033db0d49417dfb6 OK
2023/09/21 11:25:49 INFO  : manta64.exe: Copied (new)
2023/09/21 11:25:51 DEBUG : mantamanager64.exe: sha1 = 18e92da66b1b28815811ea35877ed7bb12d39e9f OK
2023/09/21 11:25:51 INFO  : mantamanager64.exe: Copied (new)
2023/09/21 11:25:53 DEBUG : wd270com64.dll: sha1 = a7c4ab785bb1c70a5e83f461e8075ec59790dc1c OK
2023/09/21 11:25:53 INFO  : wd270com64.dll: Copied (new)
2023/09/21 11:25:54 DEBUG : wd270cpl64.dll: sha1 = 5905054b99e1d5176c4275ae71dedede6b6f0919 OK
2023/09/21 11:25:54 INFO  : wd270cpl64.dll: Copied (new)
2023/09/21 11:25:56 DEBUG : wd270hf64.dll: sha1 = d18f80b7b492602789c1b720bed375bad16b1cc6 OK
2023/09/21 11:25:56 INFO  : wd270hf64.dll: Copied (new)
2023/09/21 11:25:58 DEBUG : wd270html64.dll: sha1 = 0adf6689f9e751a737ec980b75259a3877d2cd42 OK
2023/09/21 11:25:58 INFO  : wd270html64.dll: Copied (new)
2023/09/21 11:25:59 DEBUG : wd270mat64.dll: sha1 = 06c187fb801c691a02060b988b76a7c714514b3e OK
2023/09/21 11:25:59 INFO  : wd270mat64.dll: Copied (new)
2023/09/21 11:26:00 DEBUG : wd270net2_64.dll: sha1 = 5dc8341c04ec2776ff5a1e2671e1d1e96c3e8201 OK
2023/09/21 11:26:00 INFO  : wd270net2_64.dll: Copied (new)
2023/09/21 11:26:01 DEBUG : wd270ole64.dll: sha1 = 73f1e4481b8f886957ee02caff022643b70b84ed OK
2023/09/21 11:26:01 INFO  : wd270ole64.dll: Copied (new)
2023/09/21 11:26:03 DEBUG : wd270pdf64.dll: sha1 = 1122d8334aabce354535af27e1a21180ab1ff255 OK
2023/09/21 11:26:03 INFO  : wd270pdf64.dll: Copied (new)
2023/09/21 11:26:04 DEBUG : wd270pnt64.dll: sha1 = 477de9b3f550f7bf40bad14af9545b61b1d0d99d OK
2023/09/21 11:26:04 INFO  : wd270pnt64.dll: Copied (new)
2023/09/21 11:26:05 DEBUG : wd270rtf64.dll: sha1 = d0dec5b86c70afca1273eea4381725f4e34cfbab OK
2023/09/21 11:26:05 INFO  : wd270rtf64.dll: Copied (new)
2023/09/21 11:26:06 DEBUG : wd270sql64.dll: sha1 = 52328dbb05dad5a4e156eaa9bb73c5651bb4599f OK
2023/09/21 11:26:06 INFO  : wd270sql64.dll: Copied (new)
2023/09/21 11:26:08 DEBUG : wd270std64.dll: sha1 = 3a7fbc422a042c556063e23f2f77ba1e1402580d OK
2023/09/21 11:26:08 INFO  : wd270std64.dll: Copied (new)
2023/09/21 11:26:11 DEBUG : wd270uni64.dll: sha1 = 995545564b192c56e585f8c3eb177020640d9d0e OK
2023/09/21 11:26:11 INFO  : wd270uni64.dll: Copied (new)
2023/09/21 11:26:12 DEBUG : wd270vm64.dll: sha1 = 1e68ebe1a11c5698dba2cb6a945ab93d3a2927e5 OK
2023/09/21 11:26:12 INFO  : wd270vm64.dll: Copied (new)
2023/09/21 11:26:13 DEBUG : wd270xls64.dll: sha1 = 30bcf930f967dea2694be8d2a4f21d4447ea84b7 OK
2023/09/21 11:26:13 INFO  : wd270xls64.dll: Copied (new)
2023/09/21 11:26:15 DEBUG : wd270xml64.dll: sha1 = 3cf62fc9ee6a182be72d03d8c1f03a9c4ab06c2e OK
2023/09/21 11:26:15 INFO  : wd270xml64.dll: Copied (new)
2023/09/21 11:26:16 DEBUG : wd270zip64.dll: sha1 = bdf3dca165f52c005404619dcc89a87b751fa26c OK
2023/09/21 11:26:16 INFO  : wd270zip64.dll: Copied (new)
2023/09/21 11:26:18 DEBUG : wdhfsrv64.dll: sha1 = d2968da32d05024e6a40fc944d6a88c1c166487e OK
2023/09/21 11:26:18 INFO  : wdhfsrv64.dll: Copied (new)
2023/09/21 11:26:19 DEBUG : wdsqlsrv64.DLL: sha1 = d90f78bea3f1b8574c1449d8b0a6ddce2293dee0 OK
2023/09/21 11:26:19 INFO  : wdsqlsrv64.DLL: Copied (new)
2023/09/21 11:26:21 DEBUG : BDD/__rpl/subscriber/1052_7/part_152.hyl: sha1 = e48e6a790584a0424dadcffafdca728596bc3b44 OK
2023/09/21 11:26:21 INFO  : BDD/__rpl/subscriber/1052_7/part_152.hyl: Copied (new)
2023/09/21 11:26:23 DEBUG : BDD/__rpl/subscriber/1052_7/rpl.filter: sha1 = 8fb0bf1b07b5abf15b8658d1cb544fece26f4da1 OK
2023/09/21 11:26:23 INFO  : BDD/__rpl/subscriber/1052_7/rpl.filter: Copied (new)
2023/09/21 11:26:24 DEBUG : BDD/__rpl/subscriber/1052_7/rpl.pos: sha1 = 44705f4d0ad759ee211289eaf118a03bf9f81d0f OK
2023/09/21 11:26:24 INFO  : BDD/__rpl/subscriber/1052_7/rpl.pos: Copied (new)
2023/09/21 11:26:25 DEBUG : BDD/__System/Alert.fic: sha1 = fdd3c06d92575f77a95c03af90f3882a9c2f8136 OK
2023/09/21 11:26:25 INFO  : BDD/__System/Alert.fic: Copied (new)
2023/09/21 11:26:26 DEBUG : BDD/__System/Alert.mmo: sha1 = 3bef7df7b4729445c0b9b773987c254bfb15664b OK
2023/09/21 11:26:26 INFO  : BDD/__System/Alert.mmo: Copied (new)
2023/09/21 11:26:27 DEBUG : BDD/__System/Alert.ndx: sha1 = 4b28c09819b0423fa0e87427f9b78c40e3d1eea0 OK
2023/09/21 11:26:27 INFO  : BDD/__System/Alert.ndx: Copied (new)
2023/09/21 11:26:28 DEBUG : BDD/__System/AlertMail.fic: sha1 = dad15bd17e6200dca5030691f422d831b4b2a33b OK
2023/09/21 11:26:28 INFO  : BDD/__System/AlertMail.fic: Copied (new)
2023/09/21 11:26:29 DEBUG : BDD/__System/AlertMail.ndx: sha1 = ec8b141b88c9d85015c828d466718f8e42f2dd97 OK
2023/09/21 11:26:29 INFO  : BDD/__System/AlertMail.ndx: Copied (new)
2023/09/21 11:26:29 DEBUG : BDD/__System/Backup.FIC: sha1 = 5b52fea4834ff2a71f278e5ff5c5642b12c44550 OK
2023/09/21 11:26:29 INFO  : BDD/__System/Backup.FIC: Copied (new)
2023/09/21 11:26:30 DEBUG : BDD/__System/Backup.mmo: sha1 = f8932f9f0f6de89b6767608410119f8d293d83f7 OK
2023/09/21 11:26:30 INFO  : BDD/__System/Backup.mmo: Copied (new)
2023/09/21 11:26:31 DEBUG : BDD/__System/Backup.ndx: sha1 = 4c8ac1c13493cbceaa6d19aed501538ed2e13e09 OK
2023/09/21 11:26:31 INFO  : BDD/__System/Backup.ndx: Copied (new)
2023/09/21 11:26:33 DEBUG : BDD/__System/BackupHistory.FIC: sha1 = 74064d5ec79d6dc804ab3fc61d3468a0fb876cbc OK
2023/09/21 11:26:33 INFO  : BDD/__System/BackupHistory.FIC: Copied (new)
2023/09/21 11:26:34 DEBUG : BDD/__System/BackupHistory.mmo: sha1 = 675f86f86ccef467a2bc8caa1afe12c5681baf5a OK
2023/09/21 11:26:34 INFO  : BDD/__System/BackupHistory.mmo: Copied (new)
2023/09/21 11:26:35 DEBUG : BDD/__System/BackupHistory.ndx: sha1 = b0772d53772a1e5b027c8f723a682499ce48ee50 OK
2023/09/21 11:26:35 INFO  : BDD/__System/BackupHistory.ndx: Copied (new)
2023/09/21 11:26:35 DEBUG : BDD/__System/DataBaseRight.FIC: Clearing upload URL because of error: no tomes available (503 service_unavailable)
2023/09/21 11:26:35 DEBUG : pacer: low level retry 1/1 (error no tomes available (503 service_unavailable))
2023/09/21 11:26:35 DEBUG : pacer: Rate limited, increasing sleep to 1s
2023/09/21 11:26:35 DEBUG : BDD/__System/DataBaseRight.FIC: Received error: no tomes available (503 service_unavailable) - low level retry 1/10
2023/09/21 11:26:35 DEBUG : pacer: Reducing sleep to 500ms
2023/09/21 11:26:37 DEBUG : pacer: Reducing sleep to 250ms
2023/09/21 11:26:37 DEBUG : BDD/__System/DataBaseRight.FIC: sha1 = c0536aab727d624530cb3137de9fe8bb030c3e91 OK
2023/09/21 11:26:37 INFO  : BDD/__System/DataBaseRight.FIC: Copied (new)
2023/09/21 11:26:38 DEBUG : pacer: Reducing sleep to 125ms
2023/09/21 11:26:38 DEBUG : BDD/__System/DataBaseRight.ndx: sha1 = 6b7c2cdff6b57d54f9def8e4d318461713c57c63 OK
2023/09/21 11:26:38 INFO  : BDD/__System/DataBaseRight.ndx: Copied (new)
2023/09/21 11:26:38 DEBUG : BDD/__System/GroupTable.FIC: Clearing upload URL because of error: no tomes available (503 service_unavailable)
2023/09/21 11:26:38 DEBUG : pacer: low level retry 1/1 (error no tomes available (503 service_unavailable))
2023/09/21 11:26:38 DEBUG : pacer: Rate limited, increasing sleep to 1s
2023/09/21 11:26:38 DEBUG : BDD/__System/GroupTable.FIC: Received error: no tomes available (503 service_unavailable) - low level retry 1/10
2023/09/21 11:26:38 DEBUG : pacer: Reducing sleep to 500ms
2023/09/21 11:26:41 DEBUG : pacer: Reducing sleep to 250ms
2023/09/21 11:26:41 DEBUG : BDD/__System/GroupTable.FIC: sha1 = 59809efa59a12fb7c6b05f1cbce34cd21b82d112 OK
2023/09/21 11:26:41 INFO  : BDD/__System/GroupTable.FIC: Copied (new)
2023/09/21 11:26:41 DEBUG : BDD/__System/GroupTable.mmo: Clearing upload URL because of error: no tomes available (503 service_unavailable)
2023/09/21 11:26:41 DEBUG : pacer: low level retry 1/1 (error no tomes available (503 service_unavailable))
2023/09/21 11:26:41 DEBUG : pacer: Rate limited, increasing sleep to 1s
2023/09/21 11:26:41 DEBUG : BDD/__System/GroupTable.mmo: Received error: no tomes available (503 service_unavailable) - low level retry 1/10
2023/09/21 11:26:41 DEBUG : pacer: Reducing sleep to 500ms
2023/09/21 11:26:42 INFO  : 
Transferred:   	   66.696 MiB / 67.541 MiB, 99%, 479.235 KiB/s, ETA 1s
Transferred:           41 / 79, 52%
Elapsed time:       1m0.5s
Transferring:
 * Serveur HFSQL …_System/GroupTable.mmo:  0% /210, 0/s, -

2023/09/21 11:26:44 DEBUG : pacer: Reducing sleep to 250ms
2023/09/21 11:26:44 DEBUG : BDD/__System/GroupTable.mmo: sha1 = 2b7211d89690c329d165c5c044c52c21328b1040 OK
2023/09/21 11:26:44 INFO  : BDD/__System/GroupTable.mmo: Copied (new)
2023/09/21 11:26:45 DEBUG : pacer: Reducing sleep to 125ms
2023/09/21 11:26:45 DEBUG : BDD/__System/GroupTable.ndx: sha1 = 13433965b2c668346a51a1c46d4c3495fcc1d371 OK
2023/09/21 11:26:45 INFO  : BDD/__System/GroupTable.ndx: Copied (new)
2023/09/21 11:26:45 DEBUG : BDD/__System/Integrity.FIC: Clearing upload URL because of error: no tomes available (503 service_unavailable)
2023/09/21 11:26:45 DEBUG : pacer: low level retry 1/1 (error no tomes available (503 service_unavailable))
2023/09/21 11:26:45 DEBUG : pacer: Rate limited, increasing sleep to 1s
2023/09/21 11:26:45 DEBUG : BDD/__System/Integrity.FIC: Received error: no tomes available (503 service_unavailable) - low level retry 1/10
2023/09/21 11:26:45 DEBUG : pacer: Reducing sleep to 500ms
2023/09/21 11:26:47 DEBUG : pacer: Reducing sleep to 250ms
2023/09/21 11:26:47 DEBUG : BDD/__System/Integrity.FIC: sha1 = 57cee879626094be639a693339787d6b870a9d0a OK
2023/09/21 11:26:47 INFO  : BDD/__System/Integrity.FIC: Copied (new)
2023/09/21 11:26:49 DEBUG : pacer: Reducing sleep to 125ms
2023/09/21 11:26:49 DEBUG : BDD/__System/Integrity.ndx: sha1 = b702ed21382edd85d29bf90790f6204a5f2ecec1 OK
2023/09/21 11:26:49 INFO  : BDD/__System/Integrity.ndx: Copied (new)
2023/09/21 11:26:49 DEBUG : pacer: Reducing sleep to 62.5ms
2023/09/21 11:26:49 DEBUG : BDD/__System/IntegrityVersion.fic: sha1 = 5149be60e9add061378fde13abbbabf48f389f9f OK
2023/09/21 11:26:49 INFO  : BDD/__System/IntegrityVersion.fic: Copied (new)
2023/09/21 11:26:51 DEBUG : pacer: Reducing sleep to 31.25ms
2023/09/21 11:26:51 DEBUG : BDD/__System/IntegrityVersion.ndx: sha1 = 1f66aefdb0486c39e6bba630afad2ac7500310ee OK
2023/09/21 11:26:51 INFO  : BDD/__System/IntegrityVersion.ndx: Copied (new)
2023/09/21 11:26:51 DEBUG : pacer: Reducing sleep to 15.625ms
2023/09/21 11:26:51 DEBUG : BDD/__System/Meta.FIC: sha1 = 40387353fdb7742a1b1378023117a791ccb0f399 OK
2023/09/21 11:26:51 INFO  : BDD/__System/Meta.FIC: Copied (new)
2023/09/21 11:26:53 DEBUG : pacer: Reducing sleep to 10ms
2023/09/21 11:26:53 DEBUG : BDD/__System/Meta.mmo: sha1 = 6db9aabcd42b7ee1eb739fe754ecc69ec47d5617 OK
2023/09/21 11:26:53 INFO  : BDD/__System/Meta.mmo: Copied (new)
2023/09/21 11:26:55 DEBUG : BDD/__System/Meta.ndx: sha1 = ea4801100ce1304a07576a4ef5345d1cc7b33ffa OK
2023/09/21 11:26:55 INFO  : BDD/__System/Meta.ndx: Copied (new)
2023/09/21 11:26:57 DEBUG : BDD/__System/QueryLog.fic: sha1 = 667960dfa2b43d3028748969c780b3820b29717d OK
2023/09/21 11:26:57 INFO  : BDD/__System/QueryLog.fic: Copied (new)
2023/09/21 11:26:58 DEBUG : BDD/__System/QueryLog.mmo: sha1 = 75fbd6f994dbe86970d7edbdc84096c6ec4f8b08 OK
2023/09/21 11:26:58 INFO  : BDD/__System/QueryLog.mmo: Copied (new)
2023/09/21 11:26:59 DEBUG : BDD/__System/QueryLog.ndx: sha1 = 3b8575e2f9e47c8875118cb2e0b317bc2fd35b4f OK
2023/09/21 11:26:59 INFO  : BDD/__System/QueryLog.ndx: Copied (new)
2023/09/21 11:26:59 DEBUG : BDD/__System/ReplicationConfig.FIC: sha1 = 2f3d97c052da756a0f627ed153f95a21e4af5360 OK
2023/09/21 11:26:59 INFO  : BDD/__System/ReplicationConfig.FIC: Copied (new)
2023/09/21 11:27:00 DEBUG : BDD/__System/ReplicationConfig.mmo: sha1 = 886f18adb55ab91a17fb44e2ceedb79cbc57438a OK
2023/09/21 11:27:00 INFO  : BDD/__System/ReplicationConfig.mmo: Copied (new)
2023/09/21 11:27:01 DEBUG : BDD/__System/ReplicationConfig.ndx: sha1 = af8778167f18f853323a2ece119d71805c06cf06 OK
2023/09/21 11:27:01 INFO  : BDD/__System/ReplicationConfig.ndx: Copied (new)
2023/09/21 11:27:03 DEBUG : BDD/__System/ServerRight.FIC: sha1 = cb9c8e6ba438e20b9769be0750690c4fe00aab38 OK
2023/09/21 11:27:03 INFO  : BDD/__System/ServerRight.FIC: Copied (new)
2023/09/21 11:27:04 DEBUG : BDD/__System/ServerRight.ndx: sha1 = b7f79b0969e44f578091f733c0f5016ed2dcdc18 OK
2023/09/21 11:27:04 INFO  : BDD/__System/ServerRight.ndx: Copied (new)
2023/09/21 11:27:05 DEBUG : BDD/__System/TableRight.FIC: sha1 = d8965bf9626b8109e02b88efc25446eb2b0b22cc OK
2023/09/21 11:27:05 INFO  : BDD/__System/TableRight.FIC: Copied (new)
2023/09/21 11:27:07 DEBUG : BDD/__System/TableRight.ndx: sha1 = 45e6207b9692c7f4d4dcfa718c8665d452f2b16f OK
2023/09/21 11:27:07 INFO  : BDD/__System/TableRight.ndx: Copied (new)
2023/09/21 11:27:10 DEBUG : BDD/__System/Task.FIC: sha1 = e8a85a08b6b2629c503114ea59b82437e94da912 OK
2023/09/21 11:27:10 INFO  : BDD/__System/Task.FIC: Copied (new)
2023/09/21 11:27:11 DEBUG : BDD/__System/Task.mmo: sha1 = 9e97c185509cc021cec7ba27409e60d6a1aa6cbe OK
2023/09/21 11:27:11 INFO  : BDD/__System/Task.mmo: Copied (new)
2023/09/21 11:27:13 DEBUG : BDD/__System/Task.ndx: sha1 = 929a17472653b0ae4e8e973ee48376cee5bd22a7 OK
2023/09/21 11:27:13 INFO  : BDD/__System/Task.ndx: Copied (new)
2023/09/21 11:27:14 DEBUG : BDD/__System/UserTable.FIC: sha1 = 0b2f9981e15725ef5d28c56e8707a8c1bc0a55b9 OK
2023/09/21 11:27:14 INFO  : BDD/__System/UserTable.FIC: Copied (new)
2023/09/21 11:27:15 DEBUG : BDD/__System/UserTable.mmo: sha1 = 275e51e1a0e9c84a7b0a69f93c155169fa2619ca OK
2023/09/21 11:27:15 INFO  : BDD/__System/UserTable.mmo: Copied (new)
2023/09/21 11:27:16 DEBUG : BDD/__System/UserTable.ndx: sha1 = 876423be4894aa41afa40d4832a4e69f0265ef05 OK
2023/09/21 11:27:16 INFO  : BDD/__System/UserTable.ndx: Copied (new)
2023/09/21 11:27:22 DEBUG : BDD/__System/UserTable_GroupTable.FIC: sha1 = 149e6bef4a94240ced752733b8f8bd51e54835c6 OK
2023/09/21 11:27:22 INFO  : BDD/__System/UserTable_GroupTable.FIC: Copied (new)
2023/09/21 11:27:23 DEBUG : BDD/__System/UserTable_GroupTable.ndx: sha1 = e47efc07dc2d6aaf4f45849dff4875821a36e667 OK
2023/09/21 11:27:23 INFO  : BDD/__System/UserTable_GroupTable.ndx: Copied (new)
2023/09/21 11:27:25 DEBUG : BDD/__JNL/__JNL/JNL_FILES.FIC: sha1 = 321009b64767c692cb8a4bb0fe6d66ea12468eaf OK
2023/09/21 11:27:25 INFO  : BDD/__JNL/__JNL/JNL_FILES.FIC: Copied (new)
2023/09/21 11:27:26 DEBUG : BDD/__JNL/__JNL/JNL_FILES.ndx: sha1 = 26927996b3be8ec7d47792815c2add084450f66b OK
2023/09/21 11:27:26 INFO  : BDD/__JNL/__JNL/JNL_FILES.ndx: Copied (new)
2023/09/21 11:27:26 DEBUG : BDD/__JNL/__JNL/JNL_OPERATION.FIC: sha1 = c8ed08cd6c4d6b3f7910a94a1de9b14f32351489 OK
2023/09/21 11:27:26 INFO  : BDD/__JNL/__JNL/JNL_OPERATION.FIC: Copied (new)
2023/09/21 11:27:27 DEBUG : BDD/__JNL/__JNL/JNL_OPERATION.ndx: sha1 = 36bd5993c93f002e0b925cfb0762afdadb6cb9df OK
2023/09/21 11:27:27 INFO  : BDD/__JNL/__JNL/JNL_OPERATION.ndx: Copied (new)
2023/09/21 11:27:29 DEBUG : BDD/__JNL/__JNL/JNL_USERS.FIC: sha1 = 9d4330e45a2942ba1d733437bf1bee8aef6b26c8 OK
2023/09/21 11:27:29 INFO  : BDD/__JNL/__JNL/JNL_USERS.FIC: Copied (new)
2023/09/21 11:27:30 DEBUG : BDD/__JNL/__JNL/JNL_USERS.ndx: sha1 = 5d4646b54bca96a420b48c50fd2bf621a8561324 OK
2023/09/21 11:27:30 INFO  : BDD/__JNL/__JNL/JNL_USERS.ndx: Copied (new)
2023/09/21 11:27:31 DEBUG : BDD/__TRS/TRSOperation.TRS: sha1 = a00557b4b173982d4700105c4a90fc2b7cfdd2a6 OK
2023/09/21 11:27:31 INFO  : BDD/__TRS/TRSOperation.TRS: Copied (new)
2023/09/21 11:27:32 DEBUG : BDD/__TRS/TRSOperation.ndx: sha1 = df33ce5d0e3b9732e17b2e7c9267eac211273d23 OK
2023/09/21 11:27:32 INFO  : BDD/__TRS/TRSOperation.ndx: Copied (new)
2023/09/21 11:27:33 DEBUG : BDD/__TRS/TRSOperationInfoClient.TRS: sha1 = 424cc5787b12dbc4a3c81382034de531e6068d3a OK
2023/09/21 11:27:33 INFO  : BDD/__TRS/TRSOperationInfoClient.TRS: Copied (new)
2023/09/21 11:27:38 DEBUG : BDD/__TRS/TRSOperationInfoClient.mmo: sha1 = 8b3a481acde6ddefe837fcac420c3852f384a10a OK
2023/09/21 11:27:38 INFO  : BDD/__TRS/TRSOperationInfoClient.mmo: Copied (new)
2023/09/21 11:27:39 DEBUG : BDD/__TRS/TRSOperationInfoClient.ndx: sha1 = 017db19a43c8b317fe65e79b1dbd5e1b64a3ec93 OK
2023/09/21 11:27:39 INFO  : BDD/__TRS/TRSOperationInfoClient.ndx: Copied (new)
2023/09/21 11:27:39 DEBUG : Waiting for deletions to finish
2023/09/21 11:27:39 INFO  : 
Transferred:   	   67.547 MiB / 67.547 MiB, 100%, 422.339 KiB/s, ETA 0s
Transferred:           79 / 79, 100%
Elapsed time:      1m57.1s

2023/09/21 11:27:39 DEBUG : 5 go routines active

asdffdsa · September 21, 2023, 12:54pm

your machine ran out of memory
maybe try without --fast-lsit

backblaze is telling rclone to slow down, too many requests too fast
and might be some network error.

ncw · September 21, 2023, 1:39pm

That is about half the speed of the C: transfer

So that suggests trying --transfers 2 instead of --transfers 1

urko · September 21, 2023, 1:50pm

I don't understand this upload speed. Is this something related on what @asdffdsa said about the Rate limited, increasing sleep to 1s ?

Sorry I cannot figure out what the problem is. We have other machines doing this similar job with same script configuration and they are working fine...

Maybe because of the server RAM usage... cannot figure out.

2023/09/21 15:43:27 DEBUG : rclone: Version "v1.63.1" starting with parameters ["C:\\rclone-v1.63.1-windows-amd64\\rclone" "-vv" "--b2-disable-checksum" "--transfers" "2" "--multi-thread-streams" "0" "sync" "\\\\?\\E:\\Backup" "BACKBLAZE:mybucket"]
2023/09/21 15:43:27 DEBUG : Creating backend with remote "\\\\?\\E:\\Backup"
2023/09/21 15:43:27 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2023/09/21 15:43:27 DEBUG : fs cache: renaming cache item "\\\\?\\E:\\Backup" to be canonical "//?/E:/Backup"
2023/09/21 15:43:27 DEBUG : Creating backend with remote "BACKBLAZE:mybucket"
2023/09/21 15:43:27 DEBUG : BACKBLAZE: detected overridden config - adding "{1SSjr}" suffix to name
2023/09/21 15:43:28 DEBUG : fs cache: renaming cache item "BACKBLAZE:mybucket" to be canonical "BACKBLAZE{1SSjr}:mybucket"
2023/09/21 15:43:29 DEBUG : Backup.vbm: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-09T140421.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-11T130032.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-12T130023.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-13T130029.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-14T130034.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-15T130017.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-16T140038.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-18T130025.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-19T130024.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-20T130023.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : BackupD2023-09-21T130032.file: Need to transfer - File not found at Destination
2023/09/21 15:43:30 DEBUG : BackupD2023-09-09T140421.file: Starting upload of large file in 277 chunks (id "4_z1f3ea1f3ab9bab4987a10a1a_f202ac49804ccd46d_d20230921_m134329_c001_v0001161_t0034_u01695303809937")
2023/09/21 15:43:31 DEBUG : 2023-09-12_10-00-08.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-13_10-00-16.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-14_10-00-22.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-15_10-00-25.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-16_10-00-06.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-17_10-00-06.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-18_10-00-12.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-19_10-00-11.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-20_10-00-08.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-21_10-00-20.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : B2 bucket mybucket: Waiting for checks to finish
2023/09/21 15:43:31 DEBUG : B2 bucket mybucket: Waiting for transfers to finish
2023/09/21 15:43:34 DEBUG : Backup.vbm: sha1 = ad9f64f2721a9d75ca081ca4b3175634d483d764 OK
2023/09/21 15:43:34 INFO  : Backup.vbm: Copied (new)
2023/09/21 15:43:34 DEBUG : BackupD2023-09-11T130032.file: Starting upload of large file in 89 chunks (id "4_z1f3ea1f3ab9bab4987a10a1a_f20546d45a93106f8_d20230921_m134334_c001_v0001102_t0054_u01695303814678")
2023/09/21 15:44:28 INFO  : 
Transferred:   	   70.262 KiB / 104.983 GiB, 0%, 299 B/s, ETA 11y49w5d
Transferred:            1 / 22, 5%
Elapsed time:       1m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 0/s, -
 * Bac…-09-11T130032.file:  0% /8.293Gi, 0/s, -

2023/09/21 15:45:28 INFO  : 
Transferred:   	   70.262 KiB / 104.983 GiB, 0%, 6 B/s, ETA -
Transferred:            1 / 22, 5%
Elapsed time:       2m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 0/s, -
 * Bac…-09-11T130032.file:  0% /8.293Gi, 0/s, -

2023/09/21 15:46:13 DEBUG : BackupD2023-09-09T140421.file: Sending chunk 1 length 100663296

urko · September 21, 2023, 2:12pm

Don't know why this network speed is too low...

As I said, we have other machines uploading data to B2 successfully, I guess problem is related with memory usage. We have another services running here and I see RAM usage is around 86% at the moment.

|2023/09/21 15:43:27 DEBUG : rclone: Version "v1.63.1" starting with parameters ["C:\\rclone-v1.63.1-windows-amd64\\rclone" "-vv" "--b2-disable-checksum" "--transfers" "2" "--multi-thread-streams" "0" "sync" "\\\\?\\E:\\Backup" "BACKBLAZE:mybucket"]
2023/09/21 15:43:27 DEBUG : Creating backend with remote "\\\\?\\E:\\Backup"
2023/09/21 15:43:27 DEBUG : Using config file from "C:\\Users\\Administrator\\AppData\\Roaming\\rclone\\rclone.conf"
2023/09/21 15:43:27 DEBUG : fs cache: renaming cache item "\\\\?\\E:\\Backup" to be canonical "//?/E:/Backup"
2023/09/21 15:43:27 DEBUG : Creating backend with remote "BACKBLAZE:mybucket"
2023/09/21 15:43:27 DEBUG : BACKBLAZE: detected overridden config - adding "{1SSjr}" suffix to name
2023/09/21 15:43:28 DEBUG : fs cache: renaming cache item "BACKBLAZE:mybucket" to be canonical "BACKBLAZE{1SSjr}:mybucket"
2023/09/21 15:43:29 DEBUG : /D2023-09-09T140421.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-11T130032.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-12T130023.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-13T130029.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-14T130034.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-15T130017.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-16T140038.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-18T130025.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-19T130024.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-20T130023.file: Need to transfer - File not found at Destination
2023/09/21 15:43:29 DEBUG : /D2023-09-21T130032.file: Need to transfer - File not found at Destination
2023/09/21 15:43:30 DEBUG : /D2023-09-09T140421.file: Starting upload of large file in 277 chunks (id "4_z1f3ea1f3ab9bab4987a10a1a_f202ac49804ccd46d_d20230921_m134329_c001_v0001161_t0034_u01695303809937")
2023/09/21 15:43:31 DEBUG : 2023-09-12_10-00-08.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-13_10-00-16.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-14_10-00-22.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-15_10-00-25.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-16_10-00-06.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-17_10-00-06.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-18_10-00-12.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-19_10-00-11.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-20_10-00-08.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : 2023-09-21_10-00-20.file: Need to transfer - File not found at Destination
2023/09/21 15:43:31 DEBUG : B2 bucket mybucket: Waiting for checks to finish
2023/09/21 15:43:31 DEBUG : B2 bucket mybucket: Waiting for transfers to finish
2023/09/21 15:43:34 DEBUG : /.vbm: sha1 = ad9f64f2721a9d75ca081ca4b3175634d483d764 OK
2023/09/21 15:43:34 INFO  : /.vbm: Copied (new)
2023/09/21 15:43:34 DEBUG : /D2023-09-11T130032.file: Starting upload of large file in 89 chunks (id "4_z1f3ea1f3ab9bab4987a10a1a_f20546d45a93106f8_d20230921_m134334_c001_v0001102_t0054_u01695303814678")
2023/09/21 15:44:28 INFO  : 
Transferred:   	   70.262 KiB / 104.983 GiB, 0%, 299 B/s, ETA 11y49w5d
Transferred:            1 / 22, 5%
Elapsed time:       1m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 0/s, -
 * Bac…-09-11T130032.file:  0% /8.293Gi, 0/s, -

2023/09/21 15:45:28 INFO  : 
Transferred:   	   70.262 KiB / 104.983 GiB, 0%, 6 B/s, ETA -
Transferred:            1 / 22, 5%
Elapsed time:       2m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 0/s, -
 * Bac…-09-11T130032.file:  0% /8.293Gi, 0/s, -

2023/09/21 15:46:13 DEBUG : /D2023-09-09T140421.file: Sending chunk 1 length 100663296
2023/09/21 15:46:23 DEBUG : /D2023-09-11T130032.file: Sending chunk 1 length 100663296
2023/09/21 15:46:24 DEBUG : /D2023-09-09T140421.file: Done sending chunk 1
2023/09/21 15:46:28 INFO  : 
Transferred:   	  130.162 MiB / 104.983 GiB, 0%, 5.248 MiB/s, ETA 5h40m58s
Transferred:            1 / 22, 5%
Elapsed time:       3m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 3.771Mi/s, 1h56m59s
 * Bac…-09-11T130032.file:  0% /8.293Gi, 1.474Mi/s, 1h35m40s

2023/09/21 15:46:42 DEBUG : /D2023-09-11T130032.file: Done sending chunk 1
2023/09/21 15:47:28 INFO  : 
Transferred:   	  192.069 MiB / 104.983 GiB, 0%, 248.238 KiB/s, ETA 5d2h57m
Transferred:            1 / 22, 5%
Elapsed time:       4m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 80.368Ki/s, 93h41m48s
 * Bac…-09-11T130032.file:  1% /8.293Gi, 165.639Ki/s, 14h25m8s

2023/09/21 15:48:28 INFO  : 
Transferred:   	  192.069 MiB / 104.983 GiB, 0%, 5.165 KiB/s, ETA 35w1d4h
Transferred:            1 / 22, 5%
Elapsed time:       5m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 1.672Ki/s, 4502h26m32s
 * Bac…-09-11T130032.file:  1% /8.293Gi, 3.446Ki/s, 692h52m36s

2023/09/21 15:49:15 DEBUG : /D2023-09-09T140421.file: Sending chunk 2 length 100663296
2023/09/21 15:49:20 DEBUG : /D2023-09-11T130032.file: Sending chunk 2 length 100663296
2023/09/21 15:49:23 DEBUG : /D2023-09-09T140421.file: Done sending chunk 2
2023/09/21 15:49:28 INFO  : 
Transferred:   	  325.412 MiB / 104.983 GiB, 0%, 5.930 MiB/s, ETA 5h1m12s
Transferred:            1 / 22, 5%
Elapsed time:       6m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 3.849Mi/s, 1h54m13s
 * Bac…-09-11T130032.file:  1% /8.293Gi, 2.032Mi/s, 1h8m34s

2023/09/21 15:49:50 DEBUG : /D2023-09-11T130032.file: Done sending chunk 2
2023/09/21 15:50:28 INFO  : 
Transferred:   	  384.069 MiB / 104.983 GiB, 0%, 256.937 KiB/s, ETA 4d22h35m
Transferred:            1 / 22, 5%
Elapsed time:       7m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 82.020Ki/s, 91h28m36s
 * Bac…-09-11T130032.file:  2% /8.293Gi, 172.814Ki/s, 13h39m44s

2023/09/21 15:51:28 INFO  : 
Transferred:   	  384.069 MiB / 104.983 GiB, 0%, 5.347 KiB/s, ETA 33w6d10h
Transferred:            1 / 22, 5%
Elapsed time:       8m0.5s
Transferring:
 * Bac…-09-09T140421.file:  0% /25.947Gi, 1.706Ki/s, 4395h45m49s
 * Bac…-09-11T130032.file:  2% /8.293Gi, 3.596Ki/s, 656h30m54s

2023/09/21 15:52:11 DEBUG : /D2023-09-09T140421.file: Sending chunk 3 length 100663296
2023/09/21 15:52:18 DEBUG : /D2023-09-11T130032.file: Sending chunk 3 length 100663296
2023/09/21 15:52:20 DEBUG : /D2023-09-09T140421.file: Done sending chunk 3
2023/09/21 15:52:28 INFO  : 
Transferred:   	  543.756 MiB / 104.983 GiB, 1%, 5.914 MiB/s, ETA 5h1m25s
Transferred:            1 / 22, 5%
Elapsed time:       9m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 2.946Mi/s, 2h28m40s
 * Bac…-09-11T130032.file:  3% /8.293Gi, 2.922Mi/s, 46m58s

2023/09/21 15:52:40 DEBUG : /D2023-09-11T130032.file: Done sending chunk 3
2023/09/21 15:53:28 INFO  : 
Transferred:   	  576.069 MiB / 104.983 GiB, 1%, 202.082 KiB/s, ETA 6d6h30m
Transferred:            1 / 22, 5%
Elapsed time:      10m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 62.784Ki/s, 119h4m7s
 * Bac…-09-11T130032.file:  3% /8.293Gi, 138.305Ki/s, 16h52m25s

2023/09/21 15:54:28 INFO  : 
Transferred:   	  576.069 MiB / 104.983 GiB, 1%, 4.205 KiB/s, ETA 43w8h17m
Transferred:            1 / 22, 5%
Elapsed time:      11m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 1.306Ki/s, 5721h39m11s
 * Bac…-09-11T130032.file:  3% /8.293Gi, 2.878Ki/s, 810h50m30s

2023/09/21 15:55:28 INFO  : 
Transferred:   	  576.069 MiB / 104.983 GiB, 1%, 89 B/s, ETA 39y35w15h
Transferred:            1 / 22, 5%
Elapsed time:      12m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 27/s, 274944h26m40s
 * Bac…-09-11T130032.file:  3% /8.293Gi, 61/s, 38963h38m9s

2023/09/21 15:55:41 DEBUG : /D2023-09-09T140421.file: Sending chunk 4 length 100663296
2023/09/21 15:55:43 DEBUG : /D2023-09-11T130032.file: Sending chunk 4 length 100663296
2023/09/21 15:55:48 DEBUG : /D2023-09-09T140421.file: Done sending chunk 4
2023/09/21 15:56:01 DEBUG : /D2023-09-11T130032.file: Done sending chunk 4
2023/09/21 15:56:28 INFO  : 
Transferred:   	  768.069 MiB / 104.983 GiB, 1%, 1.172 MiB/s, ETA 1d1h18m
Transferred:            1 / 22, 5%
Elapsed time:      13m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 422.766Ki/s, 17h37m5s
 * Bac…-09-11T130032.file:  4% /8.293Gi, 772.066Ki/s, 2h59m14s

2023/09/21 15:57:28 INFO  : 
Transferred:   	  768.069 MiB / 104.983 GiB, 1%, 24.965 KiB/s, ETA 7w1d16h
Transferred:            1 / 22, 5%
Elapsed time:      14m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 8.797Ki/s, 846h36m31s
 * Bac…-09-11T130032.file:  4% /8.293Gi, 16.066Ki/s, 143h33m3s

2023/09/21 15:58:28 INFO  : 
Transferred:   	  768.069 MiB / 104.983 GiB, 1%, 532 B/s, ETA 6y34w6d
Transferred:            1 / 22, 5%
Elapsed time:      15m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 187/s, 40682h21m53s
 * Bac…-09-11T130032.file:  4% /8.293Gi, 342/s, 6898h6m8s

2023/09/21 15:58:38 DEBUG : /D2023-09-09T140421.file: Sending chunk 5 length 100663296
2023/09/21 15:58:40 DEBUG : /D2023-09-11T130032.file: Sending chunk 5 length 100663296
2023/09/21 15:58:46 DEBUG : /D2023-09-09T140421.file: Done sending chunk 5
2023/09/21 15:58:56 DEBUG : /D2023-09-11T130032.file: Done sending chunk 5
2023/09/21 15:59:28 INFO  : 
Transferred:   	  960.069 MiB / 104.983 GiB, 1%, 815.476 KiB/s, ETA 1d13h9m
Transferred:            1 / 22, 5%
Elapsed time:      16m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 367.421Ki/s, 20h11m51s
 * Bac…-09-11T130032.file:  5% /8.293Gi, 443.203Ki/s, 5h8m32s

2023/09/21 16:00:28 INFO  : 
Transferred:   	  960.069 MiB / 104.983 GiB, 1%, 16.970 KiB/s, ETA 10w4d9h
Transferred:            1 / 22, 5%
Elapsed time:      17m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 7.646Ki/s, 970h33m41s
 * Bac…-09-11T130032.file:  5% /8.293Gi, 9.223Ki/s, 247h6m26s

2023/09/21 16:01:28 INFO  : 
Transferred:   	  960.069 MiB / 104.983 GiB, 1%, 361 B/s, ETA 9y41w3d
Transferred:            1 / 22, 5%
Elapsed time:      18m0.5s
Transferring:
 * Bac…-09-09T140421.file:  1% /25.947Gi, 162/s, 46638h42m29s
 * Bac…-09-11T130032.file:  5% /8.293Gi, 196/s, 11874h19m25s

2023/09/21 16:01:33 DEBUG : /D2023-09-09T140421.file: Sending chunk 6 length 100663296
2023/09/21 16:01:37 DEBUG : /D2023-09-11T130032.file: Sending chunk 6 length 100663296
2023/09/21 16:01:40 DEBUG : /D2023-09-09T140421.file: Done sending chunk 6
2023/09/21 16:02:02 DEBUG : /D2023-09-11T130032.file: Done sending chunk 6
2023/09/21 16:02:28 INFO  : 
Transferred:   	    1.125 GiB / 104.983 GiB, 1%, 842.494 KiB/s, ETA 1d11h54m
Transferred:            1 / 22, 5%
Elapsed time:      19m0.5s
Transferring:
 * Bac…-09-09T140421.file:  2% /25.947Gi, 245.456Ki/s, 30h7m20s
 * Bac…-09-11T130032.file:  6% /8.293Gi, 592.090Ki/s, 3h48m11s

2023/09/21 16:03:28 INFO  : 
Transferred:   	    1.125 GiB / 104.983 GiB, 1%, 17.532 KiB/s, ETA 10w1d21h
Transferred:            1 / 22, 5%
Elapsed time:      20m0.5s
Transferring:
 * Bac…-09-09T140421.file:  2% /25.947Gi, 5.107Ki/s, 1447h28m37s
 * Bac…-09-11T130032.file:  6% /8.293Gi, 12.321Ki/s, 182h45m13s

2023/09/21 16:04:28 INFO  : 
Transferred:   	    1.125 GiB / 104.983 GiB, 1%, 373 B/s, ETA 9y24w1d
Transferred:            1 / 22, 5%
Elapsed time:      21m0.5s
Transferring:
 * Bac…-09-09T140421.file:  2% /25.947Gi, 108/s, 69556h4m55s
 * Bac…-09-11T130032.file:  6% /8.293Gi, 262/s, 8781h55m5s

2023/09/21 16:05:00 DEBUG : /D2023-09-09T140421.file: Sending chunk 7 length 100663296
2023/09/21 16:05:08 DEBUG : /D2023-09-09T140421.file: Done sending chunk 7
2023/09/21 16:05:09 DEBUG : /D2023-09-11T130032.file: Sending chunk 7 length 100663296
2023/09/21 16:05:28 INFO  : 
Transferred:   	    1.269 GiB / 104.983 GiB, 1%, 3.610 MiB/s, ETA 8h10m19s
Transferred:            1 / 22, 5%
Elapsed time:      22m0.5s
Transferring:
 * Bac…-09-09T140421.file:  2% /25.947Gi, 1.430Mi/s, 5h1m56s
 * Bac…-09-11T130032.file:  7% /8.293Gi, 2.159Mi/s, 1h0m43s

2023/09/21 16:05:33 DEBUG : /D2023-09-11T130032.file: Done sending chunk 7
2023/09/21 16:06:28 INFO  : 
Transferred:   	    1.313 GiB / 104.983 GiB, 1%, 149.641 KiB/s, ETA 1w1d9h
Transferred:            1 / 22, 5%
Elapsed time:      23m0.5s
Transferring:
 * Bac…-09-09T140421.file:  2% /25.947Gi, 30.462Ki/s, 241h49m4s
 * Bac…-09-11T130032.file:  7% /8.293Gi, 118.266Ki/s, 18h48m33s

2023/09/21 16:07:28 INFO  : 
Transferred:   	    1.313 GiB / 104.983 GiB, 1%, 3.113 KiB/s, ETA 1y5w4d
Transferred:            1 / 22, 5%
Elapsed time:      24m0.5s
Transferring:
 * Bac…-09-09T140421.file:  2% /25.947Gi, 649/s, 11620h9m34s
 * Bac…-09-11T130032.file:  7% /8.293Gi, 2.461Ki/s, 903h50m37s

2023/09/21 16:08:28 INFO  : 
Transferred:   	    1.313 GiB / 104.983 GiB, 1%, 66 B/s, ETA 53y9w6d
Transferred:            1 / 22, 5%
Elapsed time:      25m0.5s
Transferring:
 * Bac…-09-09T140421.file:  2% /25.947Gi, 13/s, 558387h15m46s
 * Bac…-09-11T130032.file:  7% /8.293Gi, 52/s, 43432h41m43s

2023/09/21 16:09:19 DEBUG : D2023-09-09T140421.file: Sending chunk 8 length 100663296

ncw · September 22, 2023, 4:08pm

You need to check the usual sysadmin things when rclone is running.

Check to see if the computer is thrashing its swap file
Check disk IO status on the drive rclone is reading from (is it an HDD? Is it seeking a lot?)

urko · September 27, 2023, 8:15pm

Hi Nick. Thanks so much for your suggestion. I was watching resource manager on that windows machine.

I realize disk I/O read speed was too low, I saw it had a low priority. I've seen this post on stackoverflow which gives me the key to update my scheduled task priority to a higher value.

So I changed value from 7 to 3 and now it is working really good

system · September 30, 2023, 8:15pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.