Problems copying big files from local to remote using 'rclone rc'

Faw · October 5, 2023, 2:32pm

What is the problem you are having with rclone?

I'm using rclone as a server (rclone rcd --rc-no-auth) and sending all my commands using rclone rc.
I'm trying to copy a large file (about 800MB) from a local file to a remote SMB server. I'm getting the following error:

{
        "error": "multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned",
        "input": {
                "dstFs": "DESTINATION:",
                "dstRemote": "Backup/BIG-FILE.BAK",
                "srcFs": "/storage",
                "srcRemote": "BIG-FILE.BAK"
        },
        "path": "operations/copyfile",
        "status": 500
}

Any help on how to get this to work? Small files work ok.

Run the command 'rclone version' and share the full output of the command.

rclone v1.65.0-beta.7409.a75256384

os/version: ubuntu 22.04 (64 bit)
os/kernel: 6.2.0-33-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.21.1
go/linking: static
go/tags: none

Which cloud storage system are you using? (eg Google Drive)

SMB

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone rc operations/copyfile srcFs=/storage srcRemote=BIG-FILE.BAK dstFs=DESTINATION: dstRemote=Backup/BIG-FILE.BAK

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[DESTINATION]
type = smb
host = XXX
user = XXX
pass = XXX

A log from the command that you were trying to run with the `-vv` flag

Log from server:

2023/10/05 10:22:23 DEBUG : rclone: Version "v1.65.0-beta.7409.a75256384" starting with parameters ["rclone" "rcd" "--rc-no-auth" "-vv"]
2023/10/05 10:22:23 NOTICE: Serving remote control on http://127.0.0.1:5572/
2023/10/05 10:22:35 DEBUG : rc: "operations/copyfile": with parameters map[dstFs:DESTINATION: dstRemote:Backup/BIG-FILE.BAK srcFs:/storage srcRemote:BIG-FILE.BAK]
2023/10/05 10:22:35 DEBUG : Creating backend with remote "/storage"
2023/10/05 10:22:35 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/10/05 10:22:35 DEBUG : Creating backend with remote "DESTINATION:"
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: Need to transfer - File not found at Destination
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: write buffer set to 131072
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: Starting multi-thread copy with 13 chunks of size 64Mi with 4 parallel streams
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 (201326592-268435456) size 64Mi starting
2023/10/05 10:22:35 DEBUG : Backup/BIG-FILE.BAK: writing chunk 3
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 (0-67108864) size 64Mi starting
2023/10/05 10:22:35 DEBUG : Backup/BIG-FILE.BAK: writing chunk 0
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 (67108864-134217728) size 64Mi starting
2023/10/05 10:22:35 DEBUG : Backup/BIG-FILE.BAK: writing chunk 1
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 (134217728-201326592) size 64Mi starting
2023/10/05 10:22:35 DEBUG : Backup/BIG-FILE.BAK: writing chunk 2
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet rturned
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 (268435456-335544320) size 64Mi starting
2023/10/05 10:22:35 DEBUG : Backup/BIG-FILE.BAK: writing chunk 4
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet rturned
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet rturned
2023/10/05 10:22:35 DEBUG : BIG-FILE.BAK: multi-thread copy: cancelling transfer on exit
2023/10/05 10:22:35 ERROR : BIG-FILE.BAK: Failed to copy: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 10:22:35 ERROR : rc: "operations/copyfile": error: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned

ncw · October 5, 2023, 2:52pm

That error is coming from here

github.com

hirochachacha/go-smb2/blob/c8e61c7a5fa7bcd1143359f071f9425a9f4dda3f/conn.go#L713


      
          	p := PacketCodec(pkt)
          
          	msgId := p.MessageId()
          
          	if msgId != 0xFFFFFFFFFFFFFFFF {
          		if p.Flags()&SMB2_FLAGS_SIGNED != 0 {
          			if conn.session == nil || conn.session.sessionId != p.SessionId() {
          				return &InvalidResponseError{"unknown session id returned"}
          			} else {
          				if !conn.session.verify(pkt) {
          					return &InvalidResponseError{"unverified packet returned"}
          				}
          			}
          		} else {
          			if conn.requireSigning && !isEncrypted {
          				if conn.session != nil {
          					if conn.session.sessionFlags&(SMB2_SESSION_FLAG_IS_GUEST|SMB2_SESSION_FLAG_IS_NULL) == 0 {
          						if conn.session.sessionId == p.SessionId() {
          							return &InvalidResponseError{"signing required"}
          						}
          					}

Try putting the share name into the dstFs instead, like this

dstFs=DESTINATION:Backup dstRemote=BIG-FILE.BAK

That is what is indicated by this issue.

Faw · October 5, 2023, 3:00pm

Tried it, same error:
Command:

rclone rc operations/copyfile srcFs=/storage srcRemote=BIG-FILE.BAK dstFs=DESTINATION:Backup dstRemote=BIG-FILE.BAK -vv

Output:

2023/10/05 10:57:52 DEBUG : rclone: Version "v1.65.0-beta.7409.a75256384" starting with parameters ["rclone" "rc" "operations/copyfile" "srcFs=/storage" "srcRemote=BIG-FILE.BAK" "dstFs=DESTINATION:Backup" "dstRemote=BIG-FILE.BAK" "-vv"]
{
        "error": "multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned",
        "input": {
                "dstFs": "DESTINATION:Backup",
                "dstRemote": "BIG-FILE.BAK",
                "srcFs": "/storage",
                "srcRemote": "BIG-FILE.BAK"
        },
        "path": "operations/copyfile",
        "status": 500
}
2023/10/05 10:57:52 DEBUG : 6 go routines active
2023/10/05 10:57:52 Failed to rc: operation "operations/copyfile" failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned

ncw · October 5, 2023, 4:30pm

Can you try not via the rc on the command line? Does it work there? So something like

rclone copyto /storage/BIG-FILE.BAK DESTINATION:Backup/BIG-FILE.BAK -vv

Does it work if you add --disable OpenWriterAt to that?

If that does work you can add --disable OpenWriterAt to your rclone rcd command.

If that does work then it points the finger of blame here:

github.com

rclone/rclone/blob/a752563842b3a603c7d73b00e71c6ff1fd120382/backend/smb/smb.go#L484


      
          		Free:  fs.NewUsageValue(bs * int64(stat.AvailableBlockCount())),
          	}
          	return usage, nil
          }
          
          // OpenWriterAt opens with a handle for random access writes
          //
          // Pass in the remote desired and the size if known.
          //
          // It truncates any existing object
          func (f *Fs) OpenWriterAt(ctx context.Context, remote string, size int64) (fs.WriterAtCloser, error) {
          	var err error
          	o := &Object{
          		fs:     f,
          		remote: remote,
          	}
          	share, filename := o.split()
          	if share == "" || filename == "" {
          		return nil, fs.ErrorIsDir
          	}

Faw · October 5, 2023, 4:49pm

Ok, tried 'rclone copyto /storage/BIG-FILE.BAK DESTINATION:Backup/BIG-FILE.BAK -vv' and it failed as well:

2023/10/05 12:46:54 DEBUG : rclone: Version "v1.65.0-beta.7409.a75256384" starting with parameters ["rclone" "copyto" "/storage/BIG-FILE.BAK" "DESTINATION:Backup/BIG-FILE.BAK" "-vv"]
2023/10/05 12:46:54 DEBUG : Creating backend with remote "/storage/BIG-FILE.BAK"
2023/10/05 12:46:54 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/10/05 12:46:54 DEBUG : fs cache: adding new entry for parent of "/storage/BIG-FILE.BAK", "/storage"
2023/10/05 12:46:54 DEBUG : Creating backend with remote "DESTINATION:Backup/"
2023/10/05 12:46:54 DEBUG : fs cache: renaming cache item "DESTINATION:Backup/" to be canonical "DESTINATION:Backup"
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: Need to transfer - File not found at Destination
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: write buffer set to 131072
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: Starting multi-thread copy with 13 chunks of size 64Mi with 4 parallel streams
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 (201326592-268435456) size 64Mi starting
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 (67108864-134217728) size 64Mi starting
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: writing chunk 1
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: writing chunk 3
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 (0-67108864) size 64Mi starting
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: writing chunk 0
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 (134217728-201326592) size 64Mi starting
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: writing chunk 2
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 (268435456-335544320) size 64Mi starting
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: writing chunk 4
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 12:46:54 DEBUG : BIG-FILE.BAK: multi-thread copy: cancelling transfer on exit
2023/10/05 12:46:55 ERROR : BIG-FILE.BAK: Failed to copy: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 ERROR : Attempt 1/3 failed with 1 errors and: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: Need to transfer - File not found at Destination
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: write buffer set to 131072
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: Starting multi-thread copy with 13 chunks of size 64Mi with 4 parallel streams
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 (201326592-268435456) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 (0-67108864) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 0
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 3
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 (67108864-134217728) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 1
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 (134217728-201326592) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 2
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 (268435456-335544320) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 4
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: cancelling transfer on exit
2023/10/05 12:46:55 ERROR : BIG-FILE.BAK: Failed to copy: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 ERROR : Attempt 2/3 failed with 1 errors and: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: Need to transfer - File not found at Destination
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: write buffer set to 131072
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: Starting multi-thread copy with 13 chunks of size 64Mi with 4 parallel streams
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 (201326592-268435456) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 3
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 (67108864-134217728) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 1
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 (0-67108864) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 0
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 (134217728-201326592) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 2
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 (268435456-335544320) size 64Mi starting
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: writing chunk 4
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/05 12:46:55 DEBUG : BIG-FILE.BAK: multi-thread copy: cancelling transfer on exit
2023/10/05 12:46:55 ERROR : BIG-FILE.BAK: Failed to copy: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 ERROR : Attempt 3/3 failed with 1 errors and: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/05 12:46:55 INFO  :
Transferred:        1.625 MiB / 1.625 MiB, 100%, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.8s

2023/10/05 12:46:55 DEBUG : 16 go routines active
2023/10/05 12:46:55 DEBUG : smb://spectron@vm-sql2008:445/Backup/: Closing 1 unused connections
2023/10/05 12:46:55 Failed to copyto: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned

Using '--disable OpenWriterAt' on both 'rclone copyto' and 'rclone rcd' the copy works.

ncw · October 9, 2023, 11:15am

OK, that simplifies things a bit. I have an idea what the problem is - can you try this please?

v1.65.0-beta.7410.0731de6a5.fix-smb-writerat on branch fix-smb-writerat (uploaded in 15-30 mins)

Can you tell my what the remote server is (eg Windows 2008 server) and where it is (eg on local lan, or in datacenter with ping of 100ms) - thank you.

ncw · October 11, 2023, 10:35am

Did this work for you @Faw ?

Faw · October 11, 2023, 1:16pm

I have been busy and just saw the message today. I'll try and test it. Is a linux samba server, local network, 1gb lan.

EDIT: Was mistaken Windows 7 Pro machine not the linux samba (although I'm using those as well)
Tested, and it didn't work.

Command: rclone copyto /storage/BIG-FILE.BAK DESTINATION:Backup/BIG-FILE.BAK -vv

2023/10/11 09:37:26 DEBUG : rclone: Version "v1.65.0-beta.7410.0731de6a5.fix-smb-writerat" starting with parameters ["rclone" "copyto" "/storage/BIG-FILE.BAK" "DESTINATION:Backup/BIG-FILE.BAK" "-vv"]
2023/10/11 09:37:26 DEBUG : Creating backend with remote "/storage/BIG-FILE.BAK"
2023/10/11 09:37:26 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/10/11 09:37:26 DEBUG : fs cache: adding new entry for parent of "/storage/BIG-FILE.BAK", "/storage"
2023/10/11 09:37:26 DEBUG : Creating backend with remote "DESTINATION:Backup/"
2023/10/11 09:37:26 DEBUG : fs cache: renaming cache item "DESTINATION:Backup/" to be canonical "DESTINATION:Backup"
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: Sizes differ (src 861554176 vs dst 0)
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: write buffer set to 131072
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: Starting multi-thread copy with 13 chunks of size 64Mi with 4 parallel streams
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 (201326592-268435456) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 3
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 (0-67108864) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 0
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 (67108864-134217728) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 1
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 (134217728-201326592) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 2
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 (268435456-335544320) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 4
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: cancelling transfer on exit
2023/10/11 09:37:26 ERROR : BIG-FILE.BAK: Failed to copy: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 ERROR : Attempt 1/3 failed with 1 errors and: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: Need to transfer - File not found at Destination
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: write buffer set to 131072
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 4
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: Starting multi-thread copy with 13 chunks of size 64Mi with 4 parallel streams
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 (201326592-268435456) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 3
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 (67108864-134217728) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 (0-67108864) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 (134217728-201326592) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 0
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 2
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 1
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 4/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 (268435456-335544320) size 64Mi starting
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: writing chunk 4
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 5/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 3/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 2/13 failed: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: chunk 1/13 failed: multi-thread copy: failed to write chunk: context canceled
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: cancelling transfer on exit
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: multi-thread copy: abort failed: remove BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 ERROR : BIG-FILE.BAK: Failed to copy: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 ERROR : Attempt 2/3 failed with 1 errors and: multi-thread copy: failed to write chunk: write BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 DEBUG : BIG-FILE.BAK: Sizes differ (src 861554176 vs dst 33554432)
2023/10/11 09:37:26 ERROR : BIG-FILE.BAK: Failed to copy: multi-thread copy: failed to open chunk writer: failed to open: open BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 ERROR : Attempt 3/3 failed with 1 errors and: multi-thread copy: failed to open chunk writer: failed to open: open BIG-FILE.BAK: invalid response error: unverified packet returned
2023/10/11 09:37:26 INFO  :
Transferred:            1 MiB / 1 MiB, 100%, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.6s

2023/10/11 09:37:26 DEBUG : 8 go routines active
2023/10/11 09:37:26 DEBUG : smb://spectron@vm-sql2008:445/Backup/: Closing 1 unused connections
2023/10/11 09:37:26 Failed to copyto: multi-thread copy: failed to open chunk writer: failed to open: open BIG-FILE.BAK: invalid response error: unverified packet returned

system · November 10, 2023, 1:16pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.