What is the problem you are having with rclone?
I tried to connect to university onedrive account, because there is no one to authorize the api access, the only way to do is to use the webdav method to connect, same as other similar situation people ask here before. But still I have no luck to connect to my onedrive account.
Below is what I have done:
- use the webdav sharepoint method to connect to my account, no luck.
- extract the required cookies(rtFA,FedAuth) from browser and connect using davfs, and then create rclone crypt volume to local path, successful but not a good solution.
- use --http-headers and --webdav-headers and --use-cookies to set cookies(rtFA,FedAuth) for every rclone command, no luck
- By looking at some of the past questions, it seems that even the webdav method need to use microsoft graph api to access, I tried to login graph api site, but it need another authorization.
By looking at the request dump, it seems that the cookies is not set at all, may I know:
- I check the source code, the rtfa and fedauth cookies should be auto generated according to rclone config user/password, but how can I confirm if it is really generated? is it stored in a file?
- Is there anyway I can just set the cookies myself, just like what I did using davfs mount?
- Can I confirm that base on the following request dump, the cookies is not set in the command?
Thanks a lot.
Run the command 'rclone version' and share the full output of the command.
rclone v1.58.0
- os/version: fedora 34 (64 bit)
- os/kernel: 5.11.12-300.fc34.x86_64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.8
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Onedrive, but use the webdav method
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone lsd HKU: -vv --dump requests
The rclone config contents with secrets removed.
[HKU]
type = webdav
url = https://connecthkuhk-my.sharepoint.com/personal/xxxxxxxxxxxxx/Documents
vendor = sharepoint
user = XXXXX
pass = XXXXX
A log from the command with the -vv flag
2022/03/28 13:44:32 DEBUG : rclone: Version "v1.58.0" starting with parameters ["rclone" "lsd" "HKU:" "-vv" "--dump" "requests"]
2022/03/28 13:44:32 DEBUG : Creating backend with remote "HKU:"
Enter configuration password:
password:
2022/03/28 13:44:36 DEBUG : Using config file from "/home/louis/.config/rclone/rclone.conf"
2022/03/28 13:44:36 DEBUG : found headers:
2022/03/28 13:44:36 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2022/03/28 13:44:36 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/28 13:44:36 DEBUG : HTTP REQUEST (req 0xc00063c500)
2022/03/28 13:44:36 DEBUG : POST /extSTS.srf HTTP/1.1
Host: login.microsoftonline.com
User-Agent: rclone/v1.58.0
Content-Length: 1384
Accept-Encoding: gzip
<s:Envelope xmlns:s="http://www.w3.org/2003/05/soap-envelope"
xmlns:a="http://www.w3.org/2005/08/addressing"
xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd">
<s:Header>
<a:Action s:mustUnderstand="1">http://schemas.xmlsoap.org/ws/2005/02/trust/RST/Issue</a:Action>
<a:ReplyTo>
<a:Address>http://www.w3.org/2005/08/addressing/anonymous</a:Address>
</a:ReplyTo>
<a:To s:mustUnderstand="1">https://login.microsoftonline.com/extSTS.srf</a:To>
<o:Security s:mustUnderstand="1"
xmlns:o="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd">
<o:UsernameToken>
<o:Username>xxxxxxxxxxxxxxxx</o:Username>
<o:Password>xxxxxxxxxxxxxxxx</o:Password>
</o:UsernameToken>
</o:Security>
</s:Header>
<s:Body>
<t:RequestSecurityToken xmlns:t="http://schemas.xmlsoap.org/ws/2005/02/trust">
<wsp:AppliesTo xmlns:wsp="http://schemas.xmlsoap.org/ws/2004/09/policy">
<a:EndpointReference>
<a:Address>https://connecthkuhk-my.sharepoint.com/personal/xxxxxxxxxxxx/Documents/</a:Address>
</a:EndpointReference>
</wsp:AppliesTo>
<t:KeyType>http://schemas.xmlsoap.org/ws/2005/05/identity/NoProofKey</t:KeyType>
<t:RequestType>http://schemas.xmlsoap.org/ws/2005/02/trust/Issue</t:RequestType>
<t:TokenType>urn:oasis:names:tc:SAML:1.0:assertion</t:TokenType>
</t:RequestSecurityToken>
</s:Body>
</s:Envelope>
2022/03/28 13:44:36 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/28 13:44:36 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/28 13:44:36 DEBUG : HTTP RESPONSE (req 0xc00063c500)
2022/03/28 13:44:36 DEBUG : HTTP/1.1 200 OK
Content-Length: 1447
Cache-Control: no-store, no-cache
Content-Type: application/soap+xml; charset=utf-8
Date: Mon, 28 Mar 2022 05:44:36 GMT
Expires: -1
P3p: CP="DSP CUR OTPi IND OTRi ONL FIN"
Pragma: no-cache
Set-Cookie: fpc=Ap8kZpqkx6hEr7hPNUX5tUJd4aY_AQAAAENC09kOAAAA; expires=Wed, 27-Apr-2022 05:44:36 GMT; path=/; secure; HttpOnly; SameSite=None
Set-Cookie: x-ms-gateway-slice=estsfd; path=/; secure; samesite=none; httponly
Set-Cookie: stsservicecookie=estsfd; path=/; secure; samesite=none; httponly
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Ms-Ests-Server: 2.1.12570.11 - SEASLR1 ProdSlices
X-Ms-Request-Id: 484ca20d-c48c-4f58-9f96-ea83dd8b4300
2022/03/28 13:44:36 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/28 13:44:36 Failed to create file system for "HKU:": wst:FailedAuthentication: Authentication Failure (AADSTS50126: Error validating credentials due to invalid username or password.)