Configuring hdfs storage

It is assumed that a Hadoop system has been configured. Information for managing this is found here.

You should copy the hdfs.properties.template to hdfs.properites, and then define the paths to the hadoop configuration xmls in the hdfs.properties file. This should look something like:

mapredsite.path = .../hadoop-0.20.205.0/conf/mapred-site.xml

coresite.path = .../hadoop-0.20.205.0/conf/core-site.xml

hdfssite.path = .../hadoop-0.20.205.0/conf/hdfs-site.xml

In order to write to HDFS, at least the HDFS node must be started, i.e. run

.../hadoop-0.20.205.0/bin/start-dfs.sh

You can confirm that HDFS is running correctly by going here:

http://localhost:50070/dfshealth.jsp