Panic: runtime error: slice bounds out of range

rclone v1.62.2

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 5.15.0-1034-realtime (x86_64)

i get this error with OneDrive uploads
not with small files but with larger files
panic: runtime error: slice bounds out of range [-1248:]

goroutine 496997 [running]:
github.com/rclone/rclone/backend/onedrive/quickxorhash.(*quickXorHash).Write(0xd55bc00, {0x11772000, 0x100000, 0x100000})
github.com/rclone/rclone/backend/onedrive/quickxorhash/quickxorhash.go:66 +0x1dd
io.(*multiWriter).Write(0x1055b4c0, {0x11772000, 0x100000, 0x100000})
io/multi.go:85 +0x6d
github.com/rclone/rclone/fs/hash.(*MultiHasher).Write(...)
github.com/rclone/rclone/fs/hash/hash.go:227
github.com/rclone/rclone/backend/local.(*localOpenFile).Read(0xd605158, {0x11772000, 0x100000, 0x100000})
github.com/rclone/rclone/backend/local/local.go:1054 +0x232
github.com/rclone/rclone/fs/operations.(*ReOpen).Read(0xd4ea730, {0x11772000, 0x100000, 0x100000})
github.com/rclone/rclone/fs/operations/reopen.go:116 +0xbb
github.com/rclone/rclone/lib/readers.ReadFill({0xef695e10, 0xd4ea730}, {0x11772000, 0x100000, 0x100000})
github.com/rclone/rclone/lib/readers/readfill.go:14 +0x68
github.com/rclone/rclone/fs/asyncreader.(*buffer).read(0xd604b40, {0xef695e10, 0xd4ea730})
github.com/rclone/rclone/fs/asyncreader/asyncreader.go:351 +0x41
github.com/rclone/rclone/fs/asyncreader.(*AsyncReader).init.func1()
github.com/rclone/rclone/fs/asyncreader/asyncreader.go:95 +0x16f
created by github.com/rclone/rclone/fs/asyncreader.(*AsyncReader).init
github.com/rclone/rclone/fs/asyncreader/asyncreader.go:83 +0x1ca

any advice ?

First step would be to fill out the help and support template.

sorry will do, i am new here
rclone is running again now with -vv
i am wating for the output

here the info

What is the problem you are having with rclone?

Rclone stops with a panic error to onedrive

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 5.15.0-1034-realtime (x86_64)
  • os/type: linux
  • os/arch: 386
  • go/version: go1.20.2
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

OneDrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

export RCLONE_CONFIG="./rclone.conf"
export RCLONE_STATS="15m"
export RCLONE_STATS_ONE_LINE=true
export RCLONE_STATS_LOG_LEVEL="NOTICE"
export RCLONE_EXCLUDE="@**"
export RCLONE_TRANSFERS=16

./rclone sync /home/mutje/backup onedrive:bewaren/backup -vv

The rclone config contents with secrets removed.

[onedrive]
type = onedrive
client_id = 
client_secret = 
token = {"access_token":"}
drive_id = 
drive_type = personal

A log from the command with the -vv flag

2023/04/12 20:54:08 DEBUG : Setting --stats "15m0s" from environment variable RCLONE_STATS="15m"
2023/04/12 20:54:08 DEBUG : Setting --transfers "16" from environment variable RCLONE_TRANSFERS="16"
2023/04/12 20:54:08 DEBUG : Setting --config "./rclone.conf" from environment variable RCLONE_CONFIG="./rclone.conf"
2023/04/12 20:54:08 DEBUG : Setting --fast-list "true" from environment variable RCLONE_FAST_LIST="true"
2023/04/12 20:54:08 DEBUG : Setting --stats-log-level "NOTICE" from environment variable RCLONE_STATS_LOG_LEVEL="NOTICE"
2023/04/12 20:54:08 DEBUG : Setting --stats-one-line "true" from environment variable RCLONE_STATS_ONE_LINE="true"
2023/04/12 20:54:08 DEBUG : Setting --exclude "[@**]" from environment variable RCLONE_EXCLUDE="@**"
2023/04/12 20:54:08 DEBUG : rclone: Version "v1.62.2" starting with parameters ["./rclone" "sync" "/home/mutje/backup" "onedrive:bewaren/backup" "-vv"]
2023/04/12 20:54:08 DEBUG : Creating backend with remote "/home/mutje/backup"
2023/04/12 20:54:08 DEBUG : Using config file from "/home/mutje/bash/rclone.conf"
2023/04/12 20:54:08 DEBUG : Creating backend with remote "onedrive:bewaren/backup"
2023/04/12 20:54:10 DEBUG : yvonne/CoronaCheck - Internationaal.pdf: Size and modification time the same (differ by -689ms, within tolerance 1s)
2023/04/12 20:54:10 DEBUG : yvonne/2020-07-13 implantaat Yvonne.JPG: Size and modification time the same (differ by 0s, within tolerance 1s)
2023/04/12 20:54:10 DEBUG : yvonne/2020-07-13 implantaat Yvonne.JPG: Unchanged skipping
2023/04/12 20:54:10 DEBUG : yvonne/CoronaCheck - Internationaal.pdf: Unchanged skipping
2023/04/12 20:54:10 DEBUG : yvonne/IMG_2191.jpg: Size and modification time the same (differ by 0s, within tolerance 1s)
2023/04/12 20:54:10 DEBUG : yvonne/IMG_2191.jpg: Unchanged skipping

/skip 90.000 lines /

2023/04/12 23:26:36 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_091343-Duplicate00001.jpg: quickxor = a8fb9227902c930622b420be9631a86d3793476b OK
2023/04/12 23:26:36 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_091343-Duplicate00001.jpg: Copied (new)
2023/04/12 23:26:36 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101451.jpg: Starting multipart upload
2023/04/12 23:26:36 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101020.jpg: Uploading segment 0/2870185 size 2870185
2023/04/12 23:26:36 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101451.jpg: Uploading segment 0/2359741 size 2359741
2023/04/12 23:26:37 DEBUG : onze-spullen/archief/Paul-Werk/kpn-mail/2016.7z: Uploading segment 2128609280/2621691530 size 10485760
2023/04/12 23:26:37 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094830.jpg: quickxor = dd7943a858f92e3eb795657cad191846f5aedd5d OK
2023/04/12 23:26:37 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094830.jpg: Copied (new)
2023/04/12 23:26:37 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101628.jpg: Starting multipart upload
2023/04/12 23:26:37 DEBUG : onze-spullen/archief/Paul-Werk/kpn-mail/2015.7z: Uploading segment 2128609280/2316308045 size 10485760
2023/04/12 23:26:37 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101628.jpg: Uploading segment 0/3610478 size 3610478
2023/04/12 23:26:38 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_091403-Duplicate00001.jpg: quickxor = 4fd126f4cb471c58e87590f61637a9dcf645a96f OK
2023/04/12 23:26:38 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_091403-Duplicate00001.jpg: Copied (new)
2023/04/12 23:26:38 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101632.jpg: Starting multipart upload
2023/04/12 23:26:38 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101632.jpg: Uploading segment 0/3867983 size 3867983
2023/04/12 23:26:39 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094811.jpg: quickxor = be5a0c728e8ab88cde1e81d4a4f53a98dc5158f1 OK
2023/04/12 23:26:39 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094811.jpg: Copied (new)
2023/04/12 23:26:39 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_102205.jpg: Starting multipart upload
2023/04/12 23:26:39 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094652.jpg: quickxor = 0c8fa1236dccdda1eb3a6045677b22667dd429c6 OK
2023/04/12 23:26:39 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094652.jpg: Copied (new)
2023/04/12 23:26:39 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_102232.jpg: Starting multipart upload
2023/04/12 23:26:39 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_102232.jpg: Uploading segment 0/2930629 size 2930629
2023/04/12 23:26:39 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_102205.jpg: Uploading segment 0/3078817 size 3078817
2023/04/12 23:26:40 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094839.jpg: quickxor = 47ba59432745de3efb42ea103ee6909a45196aa4 OK
2023/04/12 23:26:40 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_094839.jpg: Copied (new)
2023/04/12 23:26:40 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_102649.jpg: Starting multipart upload
2023/04/12 23:26:41 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_102649.jpg: Uploading segment 0/2407421 size 2407421
2023/04/12 23:26:41 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_095756.jpg: quickxor = da846bf2e0032527d8c8a8168bec85b25a6bc6d6 OK
2023/04/12 23:26:41 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_095756.jpg: Copied (new)
2023/04/12 23:26:41 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_103651.jpg: Starting multipart upload
2023/04/12 23:26:41 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_103651.jpg: Uploading segment 0/3346571 size 3346571
2023/04/12 23:26:41 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101451.jpg: quickxor = 3966c87e215481d55807f79edb41aa2b711d515b OK
2023/04/12 23:26:41 INFO  : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_101451.jpg: Copied (new)
2023/04/12 23:26:41 DEBUG : foto-video/fotos/jaar/2016/2016_09/2016_09_Nexus 5X/IMG_20160904_103656.jpg: Starting multipart upload
panic: runtime error: slice bounds out of range [-1248:]

goroutine 88269 [running]:
github.com/rclone/rclone/backend/onedrive/quickxorhash.(*quickXorHash).Write(0xd720700, {0xeefa000, 0x100000, 0x100000})
	github.com/rclone/rclone/backend/onedrive/quickxorhash/quickxorhash.go:66 +0x1dd
io.(*multiWriter).Write(0xd3660d0, {0xeefa000, 0x100000, 0x100000})
	io/multi.go:85 +0x6d
github.com/rclone/rclone/fs/hash.(*MultiHasher).Write(...)
	github.com/rclone/rclone/fs/hash/hash.go:227
github.com/rclone/rclone/backend/local.(*localOpenFile).Read(0xd20a1f8, {0xeefa000, 0x100000, 0x100000})
	github.com/rclone/rclone/backend/local/local.go:1054 +0x232
github.com/rclone/rclone/fs/operations.(*ReOpen).Read(0xd214190, {0xeefa000, 0x100000, 0x100000})
	github.com/rclone/rclone/fs/operations/reopen.go:116 +0xbb
github.com/rclone/rclone/lib/readers.ReadFill({0xef637368, 0xd214190}, {0xeefa000, 0x100000, 0x100000})
	github.com/rclone/rclone/lib/readers/readfill.go:14 +0x68
github.com/rclone/rclone/fs/asyncreader.(*buffer).read(0xeef0cf0, {0xef637368, 0xd214190})
	github.com/rclone/rclone/fs/asyncreader/asyncreader.go:351 +0x41
github.com/rclone/rclone/fs/asyncreader.(*AsyncReader).init.func1()
	github.com/rclone/rclone/fs/asyncreader/asyncreader.go:95 +0x16f
created by github.com/rclone/rclone/fs/asyncreader.(*AsyncReader).init
	github.com/rclone/rclone/fs/asyncreader/asyncreader.go:83 +0x1ca


That looks like a bug.

In fact it is a 32bit / 64 bit bug.

You are running a 32 bit rclone on your 64 bit OS

If you download the amd/64 rclone then this will fix the problem.

However this is a bug which needs fixing so I've fixed it here and the 32 bit version should work fine here too.

v1.63.0-beta.6942.690cf0673.fix-quickxorhash on branch fix-quickxorhash (uploaded in 15-30 mins)

1 Like

thanks
i downloaded the 64-bits version
rclone check runs now, and so far it runs fine

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.