What is the problem you are having with rclone?
I am trying to read data from a Kerberized Hadoop cluster using rclone, but it is failing with no available namenodes error message. The root cause seems to be related to kerberos.
Run the command 'rclone version' and share the full output of the command.
rclone v1.60.1
- os/version: redhat 7.9 (64 bit)
- os/kernel: 3.10.0-1160.11.1.el7.x86_64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.3
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
I am using HDFS as a storage system.
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
./rclone --config=rclone.conf ls -vv remote-hdfs:<path-to-my-file>
The rclone config contents with secrets removed.
[remote-hdfs]
type = hdfs
namenode = <host>:<port>
username = <my-username>
data_transfer_protection = authentication
service_principal_name = <my-principal-name>
A log from the command with the -vv
flag
./rclone --config=rclone.conf ls -vv remote-hdfs:<path-to-my-file>
2022/11/17 18:32:57 DEBUG : rclone: Version "v1.60.1" starting with parameters ["./rclone" "--config=rclone.conf" "ls" "-vv" "remote-hdfs:<path-to-my-file>"]
2022/11/17 18:32:57 DEBUG : Creating backend with remote "remote-hdfs:<path-to-my-file>"
2022/11/17 18:32:57 DEBUG : Using config file from "/tmp/rclone.conf"
2022/11/17 18:32:57 Failed to create file system for "remote-hdfs:<path-to-my-file>": no available namenodes: SASL handshake: [Root cause: KDC_Error] KDC_Error: TGS Exchange Error: kerberos error response from KDC when requesting for <my-principal-name>: KRB Error: (7) KDC_ERR_S_PRINCIPAL_UNKNOWN Server not found in Kerberos database```