In OneFS 9.0 by default Services are not enabled by default, this also includes NFS, SMB, S3 and HDFS.
When attempting to use HDFS against an 9.0 cluster, the Hadoop client may see the following error on all HDFS access.
[cdh6-1-user1@centos-10 ~]$ hadoop fs -ls / ls: Call From centos-10.foo.com/10.246.156.21 to cdh6.foo.com:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
This is because the HDFS service is not enabled on HDFS and therefore connections are refused.
When looking at the cluster we see the Service is Disabled as by design.
# isi services -al | grep hdfs Available Services: hdfs HDFS Server Disabled
But when looking at the WebUI or the CLI, this misleading as the Service appears enabled
cascade-1# isi hdfs settings view Service: Yes Default Block Size: 128M Default Checksum Type: none Authentication Mode: simple_only Root Directory: /ifs/data WebHDFS Enabled: Yes Ambari Server: Ambari Namenode: ODP Version: Data Transfer Cipher: none Ambari Metrics Collector:
To enable the Service and allow HDFS connectivity, enable the hdfs service directly from the CLI.
# isi services hdfs enable # isi services -al | grep hdfs Available Services: hdfs HDFS Server Enabled
Now the service is Enabled, HDFS operation can occur.
[cdh6-1-user1@centos-10 ~]$ hadoop fs -ls / Found 11 items -rwxrwxrwx 3 root wheel 1 2020-02-20 11:38 /1.txt -rwxrwxrwx 3 hbase yarn 17 2020-02-20 11:31 /THIS_IS_ISILON_zone1-hadoop.txt drwxr-xr-x - hbase hbase 0 2020-05-26 14:19 /_hbase -rw-r--r-- 3 root wheel 0 2020-09-14 17:46 /cdh6_zone.txt drwxr-xr-x - hbase hbase 0 2020-08-11 11:47 /hbase -rw-r--r-- 3 root wheel 0 2020-09-14 17:46 /isilon_9.txt drwxrwxrwx - cdh6-1-user1 supergroup 0 2020-03-10 15:20 /nfs drwxrwxr-x - solr solr 0 2019-12-12 13:29 /solr drwxrwxrwt - hdfs supergroup 0 2019-12-12 13:29 /tmp drwxr-xr-x - hdfs supergroup 0 2020-01-15 12:32 /user -rw-r--r-- 3 root wheel 0 2020-09-14 17:47 /zone-3.txt
As an FYI: NFS, SMB & S3 are also Disabled by default in 9.0, but the Service checkbox/status can be managed via the WebUI Service enabled box on these services.
# isi services -al | grep smb smb SMB Service Disabled
Enable the Service via the WebUI:
# isi services -al | grep smb smb SMB Service Enabled