Instead of using rsa key, you can also use dsa (replace rsa with dsa in the command below).
If you are missing the above two files, then run the following command (Thanks to Ryan Rosario for pointing out this). Make sure that you have ssh private (~/.ssh/id_rsa) and public (~/.ssh/id_rsa.pub) keys already setup. Step 2.4: Add the following content in the /usr/local/Cellar/hadoop/1.0.1/libexec/conf/hdfs-site.xml Step 2.3: Add the following content in the /usr/local/Cellar/hadoop/1.0.1/libexec/conf/mapred-site.xml You don’t need to create this folder as it will be automatically created for you in the later stages. Note that we are setting the hdfs in current user’s folder and naming it as hadoop-store. Step 2.2:Add the following content in the /usr/local/Cellar/hadoop/1.0.1/libexec/conf/core-site.xml. This line is required to overcome the following error related “SCDynamicStore”, expecially “Unable to load realm info from SCDynamicStore”Įxport HADOOP_OPTS="=OX.AC.UK =kdc0.ox.ac.uk:kdc1.ox.ac.uk" Step 2.1 Add following line to /usr/local/Cellar/hadoop/1.0.1/libexec/conf/hadoop-env.sh.
Below I am using homebrew to install hadoop.
It really makes installing and uninstalling softwares effortless and keeps your machine clean of unused files. If you haven’t heard about homebrew, then you should definitely give it a try. Edit hadoop-env.sh to handle SCDyanmicStore related errors.
Please refer below mentioned references for details.
Here are some quick notes on how to set hadoop on Mac OSX Lion. Although you are likely to run hadoop on a big cluster of computers, it useful to have it locally installed for debugging and testing purpose.