Unable to connect to the Kerberized hadoop from CDH Big Data Cluster

Help and Support
1

Using rclone v 1.69.0

in rclone config, Configured HDFS as the Source of data

gave the type as hdfs
Namenode, service_principal_name and tested the connection

rclone ls hadoop_remote:/tmp

throwing below error:

2025/02/14 11:48:52 CRITICAL: Failed to create file system for "hdfs_remote:/tmp": no available namenodes: SASL handshake: [Root cause: KDC_Error] KDC_Error: TGS Exchange Error: kerberos error response from KDC when requesting for hdfs/abcsn01.example.com@EXAMPLE.COM: KRB Error: (7) KDC_ERR_S_PRINCIPAL_UNKNOWN Server not found in Kerberos database

Using the keytab file and the service principal name, from the BDS node, we are able to connect to the hadoop

hadoop fs -ls hdfs://namenode:8020/tmp - successful.

but when we try with rclone the same is failing.

The same works with ambari cluster but not with CDH cluster.

1 Like
2

We have tried multiple versions of Rclone like 1.69, 1.68.2 and 1.66. Issue is reproducible with all 3 versions..

Rclone version is 1.68.2 on ambari hadoop cluster where it is working and able to fetch data from HDFS.

3

welcome to the forum,

please post the output of rclone config redacted

and can run the commands with -vv for debug output.

4

[hdfs@scaj52bda17 rclone-v1.69.0-linux-amd64]$ ./rclone config redacted

[hadoop]

type = hdfs
namenode = XXX
username = XXX
service_principal_name = XXX

Command output with -vv
[hdfs@ rclone-v1.69.0-linux-amd64]$ ./rclone ls hadoop:/tmp -vv

2025/02/14 06:57:55 DEBUG : rclone: Version "v1.69.0" starting with parameters ["./rclone" "ls" "hadoop:/tmp" "-vv"]

2025/02/14 06:57:55 DEBUG : Creating backend with remote "hadoop:/tmp"

2025/02/14 06:57:55 DEBUG : Using config file from "/home/hdfs/.config/rclone/rclone.conf"

2025/02/14 06:57:55 CRITICAL: Failed to create file system for "hadoop:/tmp": no available namenodes: SASL handshake: [Root cause: KDC_Error] KDC_Error: TGS Exchange Error: kerberos error response from KDC when requesting for hdfs/HOST@REALM: KRB Error: (7) KDC_ERR_S_PRINCIPAL_UNKNOWN Server not found in Kerberos database - LOOKING_UP_SERVER

5

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.