在Mac OSX上运行Hadoop默认示例时遇到的问题

Question

在Mac OSX上运行Hadoop默认示例时遇到的问题

4

我使用命令brew install hadoop安装了Hadoop。

我安装的版本如下：

hadoop version
Hadoop 2.3.0
Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
Compiled by jenkins on 2014-02-11T13:40Z
Compiled with protoc 2.5.0
From source with checksum dfe46336fbc6a044bc124392ec06b85
This command was run using /usr/local/Cellar/hadoop/2.3.0/libexec/share/hadoop/common/hadoop-common-2.3.0.jar

为什么启动单节点集群失败？使用brew安装hadoop时，是安装32位还是64位版本的hadoop？我有一个64位系统...

./start-dfs.sh 
14/04/03 13:29:43 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [localhost]
localhost: ssh: connect to host localhost port 22: Connection refused
localhost: ssh: connect to host localhost port 22: Connection refused
Starting secondary namenodes [0.0.0.0]
0.0.0.0: ssh: connect to host 0.0.0.0 port 22: Connection refused
14/04/03 13:29:45 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

我的 ~/.profile 文件如下：

#Hadoop variables
echo 'Set Hadoop Variables...'
export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home
export HADOOP_HOME=/usr/local/Cellar/hadoop/2.3.0
export PATH=$PATH:$HADOOP_INSTALL/bin
export PATH=$PATH:$HADOOP_INSTALL/sbin

我应该运行哪个测试示例来验证Hadoop是否正常工作？

- Gerald

1个回答

网页内容由stack overflow 提供, 点击上面的

可以查看英文原文，
原文链接

- user987339 · Accepted Answer

请确保在系统偏好设置下打开远程登录和文件共享：

enter image description here

为了检查是否运行，请从命令行尝试jps命令。你应该会得到类似以下的结果：

43730 TaskTracker
43674 JobTracker
43730 NameNode
43582 DataNode
43611 SecondaryNameNode
43821 Jps

现在尝试一些Hadoop示例：

$ hadoop jar /usr/local/Cellar/hadoop/2.3.0/libexec/hadoop-examples-*.jar pi 10 100