Database Reference
In-Depth Information
Configuring HDFS
All HDFS-related configuration is done by adding/updating the properties in the
hdfs-
site.xml
file that is found in the
conf
folder under the Hadoop installation folder.
The following are the different properties that are part of the
hdfs-site.xml
file:
•
dfs.namenode.servicerpc-address
: This specifies the unique namen-
ode RPC address in the cluster. Services/daemons such as the secondary namenode
and datanode daemons use this address to connect to the namenode daemon
whenever it needs to communicate. This property is shown in the following code
snippet:
<property>
<name>dfs.namenode.servicerpc-address</name>
<value>node1.hcluster:8022</value>
</property>
•
dfs.namenode.http-address
: This specifies the URL that can be used to
monitor the namenode daemon from a browser. This property is shown in the fol-
lowing code snippet:
<property>
<name>dfs.namenode.http-address</name>
<value>node1.hcluster:50070</value>
</property>
•
dfs.replication
: This specifies the replication factor for data block replica-
tion across the datanode daemons. The default is
3
as shown in the following code
snippet:
<property>
<name>dfs.replication</name>
<value>3</value>
</property>
•
dfs.blocksize
: This specifies the block size. In the following example, the
size is specified in bytes (134,217,728 bytes is 128 MB):
