Sharepoint Item not found

Suspected Bug
1

What is the problem you are having with rclone?

Can't copy items between different sharepoint remotes. The remotes have different accounts in different tenants. It works with v1.66.0

Run the command 'rclone version' and share the full output of the command.

rclone v1.67.0

  • os/version: Microsoft Windows 11 Pro 23H2 (64 bit)
  • os/kernel: 10.0.22631.3737 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.22.4
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Microsoft OneDrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy spRemote:IejbI0a.jpg spRemote2: -vv

The rclone config contents with secrets removed.

[spRemote]
type = onedrive
client_id = 4XXXXXXXXXXXXXXX
client_secret = iXXXXXXXXXXXXXXX
server_side_across_configs = true
link_scope = organization
av_override = true
delta = true
token = {"access_token":"eXXXXXXXXXXXXXXXXX","expiry":"2024-07-01T20:21:31.575101+02:00"}
drive_id = b!pXXXXXXXXXXXXXXXXXXXXXX
drive_type = documentLibrary

[spRemote2]
type = onedrive
client_id = 4XXXXXXXXXXXXX
client_secret = iXXXXXXXXXXXXXX
server_side_across_configs = true
av_override = true
delta = true
token = {"access_token":"eXXXXXXXXXXXXX","expiry":"2024-07-01T20:13:43.4380418+02:00"}
drive_id = b!_qXXXXXXXXXXXXXXXXXX
drive_type = documentLibrary

A log from the command with the -vv flag

2024/07/01 19:24:04 DEBUG : rclone: Version "v1.67.0" starting with parameters ["rclone" "copy" "spRemote:IejbI0a.jpg" "spRemote2:" "-vv"]
2024/07/01 19:24:04 DEBUG : Creating backend with remote "spRemote:IejbI0a.jpg"
2024/07/01 19:24:04 DEBUG : Using config file from "R:\\rclone.conf"
2024/07/01 19:24:05 DEBUG : fs cache: adding new entry for parent of "spRemote:IejbI0a.jpg", "spRemote:"
2024/07/01 19:24:05 DEBUG : Creating backend with remote "spRemote2:"
2024/07/01 19:24:05 DEBUG : IejbI0a.jpg: Need to transfer - File not found at Destination
2024/07/01 19:24:06 ERROR : IejbI0a.jpg: Failed to copy: itemNotFound: Item not found
2024/07/01 19:24:06 ERROR : Attempt 1/3 failed with 1 errors and: itemNotFound: Item not found
2024/07/01 19:24:06 DEBUG : IejbI0a.jpg: Need to transfer - File not found at Destination
2024/07/01 19:24:06 ERROR : IejbI0a.jpg: Failed to copy: itemNotFound: Item not found
2024/07/01 19:24:06 ERROR : Attempt 2/3 failed with 1 errors and: itemNotFound: Item not found
2024/07/01 19:24:06 DEBUG : IejbI0a.jpg: Need to transfer - File not found at Destination
2024/07/01 19:24:07 ERROR : IejbI0a.jpg: Failed to copy: itemNotFound: Item not found
2024/07/01 19:24:07 ERROR : Attempt 3/3 failed with 1 errors and: itemNotFound: Item not found
2024/07/01 19:24:07 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         2.9s

2024/07/01 19:24:07 DEBUG : 6 go routines active
2024/07/01 19:24:07 Failed to copy: itemNotFound: Item not found
2

can you run the same exact command and post the full debug output?

3 
rclone copy spRemote:IejbI0a.jpg spRemote2: -vv
2024/07/02 23:47:31 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "copy" "spRemote:IejbI0a.jpg" "spRemote2:" "-vv"]
2024/07/02 23:47:31 DEBUG : Creating backend with remote "spRemote:IejbI0a.jpg"
2024/07/02 23:47:31 DEBUG : Using config file from "R:\\rclone.conf"
2024/07/02 23:47:31 DEBUG : fs cache: adding new entry for parent of "spRemote:IejbI0a.jpg", "spRemote:"
2024/07/02 23:47:31 DEBUG : Creating backend with remote "spRemote2:"
2024/07/02 23:47:33 DEBUG : IejbI0a.jpg: Need to transfer - File not found at Destination
2024/07/02 23:47:33 DEBUG : IejbI0a.jpg: Can't server-side copy - cross-drive but not OneDrive Personal
2024/07/02 23:47:33 DEBUG : IejbI0a.jpg: Starting multipart upload
2024/07/02 23:47:34 DEBUG : IejbI0a.jpg: Uploading segment 0/62267 size 62267
2024/07/02 23:47:35 DEBUG : IejbI0a.jpg: quickxor = fe468a1c01f48b338f2bc3cc5a931dd102c43d51 OK
2024/07/02 23:47:35 INFO  : IejbI0a.jpg: Copied (new)
2024/07/02 23:47:35 INFO  :
Transferred:       60.808 KiB / 60.808 KiB, 100%, 30.195 KiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         4.6s

2024/07/02 23:47:35 DEBUG : 10 go routines active
4

hmm, i have no idea why that would occur with the newest version.
i looked at the changelog, did not see anything that stood out to me.

i wonder if the issue is with the source or the dest?

also, can use --dump=headers --retries=1 for a look at the api calls.

5

For v1.66.0 https://pastebin.com/raw/kPzdX3pu
For v1.67.0 https://pastebin.com/raw/wNNvPhit

Thanks for looking at it

6

tl;dr at some point, might want to open an issue at rclone github, post the link here in the forum.

that does appear in v1.67.0
so maybe that is a hint, rclone is confused, treating the remotes differently.
which remote, if any, is personal?

and in the dump logs, another difference with v1.67.0:
the text sharepoint does not appear

i lack onedrive experience, but the drive_id for each remote is a bit different, b! versus b!_
and spRemote2 is missing link_scope = organization

7

I tried with and without link_scope, it is the same. After that I tried with different configurations and narrowed the problem: it is the server-side-across-configs flag, if it isn't present it works.
Here is the log with v1.67.0 copying the file without the server-side-across-configs (I removed it from the remotes in rclone.conf)
https://pastebin.com/raw/qRdzkvMJ

8

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.