Unable to do server side copy between two onedrives. Getting "unknown" error"

Help and Support
1

What is the problem you are having with rclone?

Hello Guys, I am new to rclone and strugging to find out the reason behind this error.

When I try to copy folders/files from one remote(onedrive business) to another remote(onedrive business) using the command rclone copy onedrive1:beta-2 onedrive2:delta-2 --onedrive-server-side-across-configs -P -vv , I am getting an "unknown" error.

Could someone tell me what blindingly obvious thing it is I’m doing wrong? Please? :slightly_smiling_face:

What is your rclone version (output from rclone version)

v1.52.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Linux 64bit

Which cloud storage system are you using? (eg Google Drive)

Onedrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy onedrive1:beta-2 onedrive2:delta-2 --onedrive-server-side-across-configs -P -vv

The rclone config contents with secrets removed.

Paste config here

A log from the command with the -vv flag

2020/07/23 11:48:38 DEBUG : rclone: Version "v1.52.2" starting with parameters ["rclone" "copy" "onedrive1:beta-2" "onedrive2:delta-2" "--onedrive-server-side-across-configs" "-P" "-vv" "--ignore-size" "--ignore-checksum"]
2020/07/23 11:48:38 DEBUG : Using config file from "/home/ubuntu/.config/rclone/rclone.conf"
2020-07-23 11:48:44 DEBUG : One drive root 'delta-2': Waiting for checks to finish
2020-07-23 11:48:44 DEBUG : One drive root 'delta-2': Waiting for transfers to finish
2020-07-23 11:48:47 ERROR : btd.docx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:47 ERROR : Book.xlsx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:47 ERROR : btd1.pptx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:47 INFO  : There was nothing to transfer
2020-07-23 11:48:47 ERROR : Attempt 1/3 failed with 3 errors and: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:48 DEBUG : One drive root 'delta-2': Waiting for checks to finish
2020-07-23 11:48:48 DEBUG : One drive root 'delta-2': Waiting for transfers to finish
2020-07-23 11:48:49 ERROR : btd.docx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:49 ERROR : btd1.pptx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:50 ERROR : Book.xlsx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:50 INFO  : There was nothing to transfer
2020-07-23 11:48:50 ERROR : Attempt 2/3 failed with 3 errors and: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:51 DEBUG : One drive root 'delta-2': Waiting for checks to finish
2020-07-23 11:48:51 DEBUG : One drive root 'delta-2': Waiting for transfers to finish
2020-07-23 11:48:51 ERROR : Book.xlsx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:51 ERROR : btd1.pptx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:51 ERROR : btd.docx: Failed to copy: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2020-07-23 11:48:51 INFO  : There was nothing to transfer
2020-07-23 11:48:51 ERROR : Attempt 3/3 failed with 3 errors and: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 3 (retrying may help)
Elapsed time:         5.2s
2020/07/23 11:48:51 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 3 (retrying may help)
Elapsed time:         5.2s

2020/07/23 11:48:51 DEBUG : 12 go routines active
2020/07/23 11:48:51 Failed to copy with 3 errors: last error was: UnknownError: {"Message":"There was an error processing the request.","StackTrace":"","ExceptionType":""}
2

hello and welcome to the forum

let's make sure that the remotes are setup correctly.

can you run these commands?
post the command and the output.

rclone lsd onedrive1:beta-2
rclone lsd onedrive2:delta-2

3

Hello @asdffdsa thank you for reply

ubuntu@ip-172-31-64-111:~$ rclone lsd onedrive1:beta-2
ubuntu@ip-172-31-64-111:~$ rclone lsd onedrive2:delta-2

there are no subdirectories.

if you meant rclone ls onedrive1:beta-2 and rclone ls onedrive2:delta-2, this the output
ubuntu@ip-172-31-64-111:~$ rclone ls onedrive1:beta-2
7939 Book.xlsx
11015 btd.docx
0 btd1.pptx

ubuntu@ip-172-31-64-111:~$ rclone ls onedrive2:delta-2
there are no files in delta-2

4

can you run the commands i shared with you?

5

Hello @asdffdsa thank you for reply

ubuntu@ip-172-31-64-111:~$ rclone lsd onedrive1:beta-2
ubuntu@ip-172-31-64-111:~$ rclone lsd onedrive2:delta-2

there are no subdirectories.

if you meant
rclone ls onedrive1:beta-2
rclone ls onedrive2:delta-2,

this the output
ubuntu@ip-172-31-64-111:~$ rclone ls onedrive1:beta-2
7939 Book.xlsx
11015 btd.docx
0 btd1.pptx

ubuntu@ip-172-31-64-111:~$ rclone ls onedrive2:delta-2
there are no files in delta-2

6

if you re-run the command, do you get the same errors on the same files?

now that we got the basics done, we have some experts in onedive, they should stop by soon.

7

Yes I getting the same errors after running the same command again.

8

when you posted, you were asked for

how many files are in the source, more then those three files?

if just those three same files generate the same error each time,
perhaps there is something wrong with just those three files.
can you open them with microsoft office?

9

rclone config contents:

[onedrive1]
type = onedrive
server_side_across_configs = true
token = {"access_token":"XXX","expiry":"XXX"}
drive_id = XXX
drive_type = business

[onedrive2]
type = onedrive
server_side_across_configs = true
token = {"access_token":"XXX","expiry":"XXX"}
drive_id = XXX
drive_type = business

There are only three files in the source and I am getting the same error each time I run the command. I am able to open them with microsoft office. Not just with those source files I am unable to copy other files as well. I am getting the same error for all files.

10

i do not know what the problem, might a rclone bug.

but in the mean time, i would try different ideas to narrow down the problem.
i would remove --onedrive-server-side-across-configs and test.

11

I tried that way but getting the same error even after removing --onedrive-server-side-across-configs

12

Do the folder must be a shared one to use server side copy?

13

That is an internal error at onedrive!

Are all the things you are trying to copy onedrive docs, rather than files you have uploaded? Maybe that is the difference.

14

Hey Nick

The files that I am trying to copy are onedrive docs in this case. But when I try to copy those files that I have uploaded, even then I get the same error.

15

Did you try without server_side_across_configs - there was a report of this not working for onedrive I think. You'll need to remove it from your config and from the command line. This will do an upload and download but it should work.

16

By trying without server-side-across-configs I am able to copy files without any issue. But I have some 100GB of data and if I try to copy without server-side-across-configs a lot of bandwidth is downloading and uploading

17

Good

I think this won't work between two different onedrive for business users

18

Nick is right. You can’t do server side copy. I suggest you to rent a VPS from DigitalOcean or Vultr then do the copy there.

19

here's a tip if you want to move files between onedrivers you can do this through Google Colab there is a notbook with rclone that you can run on github I don't remember the way but I think it's just give a search that you think there you doing for it does not consume your network. Another suggestion is to use the move platform that is owned by Microsoft, you choose the path and destination and then let it transfer.
As for the server-side transfer, I have not had any success either.