Rclone lsf - does not print hash with onedrive

What is the problem you are having with rclone?

rclone lsf does not print hash for onedrive, personal and business.
prints out Failed to read hash: hash type not supported

based on the debug log, onedrive returns the hashes, just that rclone does not see them.
"sha1Hash":"356A192B7913B04C54574D18C28D46E6395428AB"

tho rclone check uses the hash, as expected.

Run the command 'rclone version' and share the full output of the command.

rclone v1.57.0
- os/version: Microsoft Windows 10 Pro 2009 (64 bit)
- os/kernel: 10.0.22000.556 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.17.2
- go/linking: dynamic
- go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

onedrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

%rcmd% lsf %destone% --format="ph" --dump=bodies --log-level=DEBUG --log-file=%logfile%

The rclone config contents with secrets removed.

[onedrivejojo]
type = onedrive
client_id = redacted
client_secret = redacted
region = global
token = redacted
drive_id = redacted
drive_type = personal

A log from the command with the -vv flag

2022/03/15 09:14:29 DEBUG : rclone: Version "v1.57.0" starting with parameters ["C:\\data\\rclone\\rclone.exe" "check" "onedrivejojo:zork" "D:\\test\\onedrive" "--log-level=DEBUG" "--log-file=onedrivevb.hash.test.txt"]
2022/03/15 09:14:29 DEBUG : Creating backend with remote "onedrivejojo:zork"
2022/03/15 09:14:29 DEBUG : Using config file from "C:\\data\\rclone\\rclone.conf"
2022/03/15 09:14:30 DEBUG : Creating backend with remote "D:\\test\\onedrive"
2022/03/15 09:14:30 DEBUG : fs cache: renaming cache item "D:\\test\\onedrive" to be canonical "//?/D:/test/onedrive"
2022/03/15 09:14:30 INFO  : Using sha1 for hash comparisons
2022/03/15 09:14:30 DEBUG : Local file system at //?/D:/test/onedrive: Waiting for checks to finish
2022/03/15 09:14:30 DEBUG : singlepart.txt: sha1 = 356a192b7913b04c54574d18c28d46e6395428ab OK
2022/03/15 09:14:30 DEBUG : singlepart.txt: OK
2022/03/15 09:14:30 DEBUG : multipart.txt: sha1 = 2d2997539eeada88a3d5405f1fb59c24e69ad2fd OK
2022/03/15 09:14:30 DEBUG : multipart.txt: OK
2022/03/15 09:14:30 NOTICE: Local file system at //?/D:/test/onedrive: 0 differences found
2022/03/15 09:14:30 NOTICE: Local file system at //?/D:/test/onedrive: 2 matching files
2022/03/15 09:14:30 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 2 / 2, 100%
Elapsed time:         1.2s

2022/03/15 09:14:30 DEBUG : 4 go routines active
2022/03/15 09:14:30 DEBUG : rclone: Version "v1.57.0" starting with parameters ["C:\\data\\rclone\\rclone.exe" "lsf" "onedrivejojo:zork" "--format=ph" "--dump=bodies" "--log-level=DEBUG" "--log-file=onedrivevb.hash.test.txt"]
2022/03/15 09:14:30 DEBUG : Creating backend with remote "onedrivejojo:zork"
2022/03/15 09:14:30 DEBUG : Using config file from "C:\\data\\rclone\\rclone.conf"
2022/03/15 09:14:30 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2022/03/15 09:14:30 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/15 09:14:30 DEBUG : HTTP REQUEST (req 0xc000362400)
2022/03/15 09:14:30 DEBUG : GET /v1.0/drives/d25f196fd2a305/root HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.57.0
Authorization: XXXX
Accept-Encoding: gzip

2022/03/15 09:14:30 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/15 09:14:30 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/15 09:14:30 DEBUG : HTTP RESPONSE (req 0xc000362400)
2022/03/15 09:14:30 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Cache-Control: private
Client-Request-Id: 0e2a22c4-aa78-4307-8e8b-02d7d6547aa9
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Tue, 15 Mar 2022 13:14:30 GMT
Odata-Version: 4.0
Request-Id: 0e2a22c4-aa78-4307-8e8b-02d7d6547aa9
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"North Central US","Slice":"E","Ring":"3","ScaleUnit":"004","RoleInstance":"CH01EPF00003EC9"}}

3ba
{"@odata.context":"https://graph.microsoft.com/v1.0/$metadata#drives('d25f196fd2a305')/root/$entity","createdDateTime":"2009-01-24T15:21:34.42Z","cTag":"adDpEMjVGMTk2RkQyNThBMzA1ITEwNy42Mzc4Mjk0NjUxMzA4NzAwMDA","eTag":"aRDI1RjE5NkZEMjU4QTMwNSExMDcuMTA","id":"d25f196fd2a305!107","lastModifiedDateTime":"2022-03-15T13:08:33.087Z","name":"root","size":859632166,"webUrl":"https://onedrive.live.com/?cid=d25f196fd2a305","createdBy":{"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"lastModifiedBy":{"application":{"displayName":"OneDrive website","id":"44048800"},"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"parentReference":{"driveId":"d25f196fd2a305","driveType":"personal"},"fileSystemInfo":{"createdDateTime":"2009-01-24T15:21:34.42Z","lastModifiedDateTime":"2018-02-25T20:34:20.886Z"},"folder":{"childCount":10,"view":{"viewType":"thumbnails","sortBy":"name","sortOrder":"ascending"}},"root":{}}
0

2022/03/15 09:14:30 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/15 09:14:30 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/15 09:14:30 DEBUG : HTTP REQUEST (req 0xc000362700)
2022/03/15 09:14:30 DEBUG : GET /v1.0/drives/d25f196fd2a305/items/d25f196fd2a305!107:/zork: HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.57.0
Authorization: XXXX
Accept-Encoding: gzip

2022/03/15 09:14:30 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/15 09:14:31 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/15 09:14:31 DEBUG : HTTP RESPONSE (req 0xc000362700)
2022/03/15 09:14:31 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Cache-Control: private
Client-Request-Id: f0d20f1d-6646-4b0c-88ad-191ca6f9e7b9
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Tue, 15 Mar 2022 13:14:30 GMT
Odata-Version: 4.0
Request-Id: f0d20f1d-6646-4b0c-88ad-191ca6f9e7b9
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"North Central US","Slice":"E","Ring":"3","ScaleUnit":"004","RoleInstance":"CH01EPF00003EC9"}}

40a
{"@odata.context":"https://graph.microsoft.com/v1.0/$metadata#drives('d25f196fd2a305')/items/$entity","createdDateTime":"2022-03-14T20:35:31.163Z","cTag":"adDpEMjVGMTk2RkQyNThBMzA1ITg3MTAxLjYzNzgyOTQ2NTEzMDg3MDAwMA","eTag":"aRDI1RjE5NkZEMjU4QTMwNSE4NzEwMS4w","id":"d25f196fd2a305!87101","lastModifiedDateTime":"2022-03-15T13:08:33.087Z","name":"zork","size":1048577,"webUrl":"https://1drv.ms/f/s!AAWjWNJvGV_Shag9","createdBy":{"application":{"displayName":"rclone","id":"446ede2b"},"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"lastModifiedBy":{"application":{"displayName":"rclone","id":"446ede2b"},"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"parentReference":{"driveId":"d25f196fd2a305","driveType":"personal","id":"d25f196fd2a305!107","path":"/drive/root:"},"fileSystemInfo":{"createdDateTime":"2022-03-14T20:35:31.163Z","lastModifiedDateTime":"2022-03-14T20:35:31.163Z"},"folder":{"childCount":2,"view":{"viewType":"thumbnails","sortBy":"name","sortOrder":"ascending"}}}
0

2022/03/15 09:14:31 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/15 09:14:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/15 09:14:31 DEBUG : HTTP REQUEST (req 0xc000844a00)
2022/03/15 09:14:31 DEBUG : GET /v1.0/drives/d25f196fd2a305/items/d25f196fd2a305!87101/children?$top=1000 HTTP/1.1
Host: graph.microsoft.com
User-Agent: rclone/v1.57.0
Authorization: XXXX
Accept-Encoding: gzip

2022/03/15 09:14:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2022/03/15 09:14:31 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/15 09:14:31 DEBUG : HTTP RESPONSE (req 0xc000844a00)
2022/03/15 09:14:31 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Cache-Control: no-store
Client-Request-Id: 9243cb25-cb77-48ba-a389-7323ce836bc0
Content-Type: application/json;odata.metadata=minimal;odata.streaming=true;IEEE754Compatible=false;charset=utf-8
Date: Tue, 15 Mar 2022 13:14:30 GMT
Odata-Version: 4.0
Request-Id: 9243cb25-cb77-48ba-a389-7323ce836bc0
Strict-Transport-Security: max-age=31536000
Vary: Accept-Encoding
X-Ms-Ags-Diagnostic: {"ServerInfo":{"DataCenter":"North Central US","Slice":"E","Ring":"3","ScaleUnit":"004","RoleInstance":"CH01EPF00003EC9"}}

c01
{"@odata.context":"https://graph.microsoft.com/v1.0/$metadata#drives('d25f196fd2a305')/items('d25f196fd2a305%2187101')/children","@odata.count":2,"value":[{"@microsoft.graph.downloadUrl":"https://public.bn.files.1drv.com/y4mGKhTuMqrCfX61hw4rsDSaBKxZzj3xKo3NYfeiKHgwuoeR7BjWDCQi70lOHgARs0RHXSsWkfy2y6zatgLXf3kZtJeX6tqBJWu__5K5jgMArPcn_vH-5GgQXD6G3S23fxwoOewcc_dD2wZ3QoHS4pEdj9-QSG2vSvTNESa0dSEVWYhzNT098mchIVU4FTW1orSmM4NIXKZfNOmypMYBogELrinmk_QOomhse95WjRg8Pn9kMpeKVQaOK8LiFt7xkYMJJCNJ0Hd6OXOAlT645jXLJraGf_t4gQAaY7sR2Ej8","createdDateTime":"2022-03-15T13:08:32.827Z","cTag":"aYzpEMjVGMTk2RkQyNThBMzA1ITg3MTY0LjI1Nw","eTag":"aRDI1RjE5NkZEMjU4QTMwNSE4NzE2NC4x","id":"d25f196fd2a305!87164","lastModifiedDateTime":"2022-03-15T13:08:33.087Z","name":"multipart.txt","size":1048576,"webUrl":"https://1drv.ms/t/s!AAWjWNJvGV_Shah8","reactions":{"commentCount":0},"createdBy":{"application":{"displayName":"rclone","id":"446ede2b"},"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"lastModifiedBy":{"application":{"displayName":"rclone","id":"446ede2b"},"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"parentReference":{"driveId":"d25f196fd2a305","driveType":"personal","id":"d25f196fd2a305!87101","name":"zork","path":"/drive/root:/zork"},"file":{"mimeType":"text/plain","hashes":{"quickXorHash":"GOeVvQDkReO0HruvCO2D1BC/z6A=","sha1Hash":"2D2997539EEADA88A3D5405F1FB59C24E69AD2FD","sha256Hash":"EF20C304672FF244FC0EC5B258669EEB15A7E8194F86BDF37FA51FB32796228D"}},"fileSystemInfo":{"createdDateTime":"2022-03-14T20:57:52Z","lastModifiedDateTime":"2022-03-14T20:57:52Z"}},{"@microsoft.graph.downloadUrl":"https://public.bn.files.1drv.com/y4mz2zvCEoxzGxqxKQo1nr2AQ86qPY6wMCrFJuq3assF31zXbCC4sWTrI9J2OqOEqb6iUfCAgkvhDIy4KRMAkE3i_Zn5eosJFRqlI5SCerb6UUyC_4Qk8m2t8eqfM4qV9wLnfV7DU1X78BYLITVM42g8oge-H0YmVUA5lcXQKApSWmzqoXBl9544hzyfLAddCNwQFV9PyH9HghXrIEYtJRberp6dr42_NHA_7O8Jm3rvoOfKrY0zIRTOpym1RZ6-1GHB-mMz2IqL6PqN3uSYWG82c7C0CPw3Sf01QCf7NR1g","createdDateTime":"2022-03-15T13:08:32.697Z","cTag":"aYzpEMjVGMTk2RkQyNThBMzA1ITg3MTYzLjI1Nw","eTag":"aRDI1RjE5NkZEMjU4QTMwNSE4NzE2My4x","id":"d25f196fd2a305!87163","lastModifiedDateTime":"2022-03-15T13:08:32.833Z","name":"singlepart.txt","size":1,"webUrl":"https://1drv.ms/t/s!AAWjWNJvGV_Shah7","reactions":{"commentCount":0},"createdBy":{"application":{"displayName":"rclone","id":"446ede2b"},"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"lastModifiedBy":{"application":{"displayName":"rclone","id":"446ede2b"},"user":{"displayName":"jojo jojo","id":"d25f196fd2a305"}},"parentReference":{"driveId":"d25f196fd2a305","driveType":"personal","id":"d25f196fd2a305!87101","name":"zork","path":"/drive/root:/zork"},"file":{"mimeType":"text/plain","hashes":{"quickXorHash":"MQAAAAAAAAAAAAAAAQAAAAAAAAA=","sha1Hash":"356A192B7913B04C54574D18C28D46E6395428AB","sha256Hash":"6B86B273FF34FCE19D6B804EFF5A3F5747ADA4EAA22F1D49C01E52DDB7875B4B"}},"fileSystemInfo":{"createdDateTime":"2022-03-14T22:26:34Z","lastModifiedDateTime":"2022-03-14T22:26:34Z"}}]}
0

2022/03/15 09:14:31 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2022/03/15 09:14:31 ERROR : multipart.txt: Failed to read hash: hash type not supported
2022/03/15 09:14:31 ERROR : singlepart.txt: Failed to read hash: hash type not supported
2022/03/15 09:14:31 DEBUG : 5 go routines active

Well hidden in the docs for lsf:

If you specify "h" in the format you will get the MD5 hash by default, use the "--hash" flag to change which hash you want.

So you want to use something like this:

rclone lsf OneDrive: --format=ph --hash=SHA-1

Not quite what you would intuitively expect; I might have stumpled in this too :wink:

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.