设为首页 加入收藏

TOP

[Hadoop]完全分布式集群安装过程详解(二)
2014-11-23 20:06:32 来源: 作者: 【 】 浏览:90
Tags:Hadoop 完全 分布式 集群 安装 过程 详解
/hadoop
8. 在各个结点上配置hadoop环境变量
[hadoop@node01 ~]$ su - root
Password:
[root@node01 ~]# vi /etc/profile
exportHADOOP_INSTALL=/home/hadoop/hadoop-0.20.2
export PATH=$PATH:$HADOOP_INSTALL/bin
9. 格式化HDFS
[hadoop@node01 bin]$ ./hadoop namenode-format
13/01/30 00:59:04 INFO namenode.NameNode:STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = node01/192.168.231.131
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build =https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707;compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
13/01/30 00:59:04 INFO namenode.FSNamesystem:fsOwner=hadoop,root
13/01/30 00:59:04 INFOnamenode.FSNamesystem: supergroup=supergroup
13/01/30 00:59:04 INFOnamenode.FSNamesystem: isPermissionEnabled=true
13/01/30 00:59:04 INFO common.Storage:Image file of size 96 saved in 0 seconds.
13/01/30 00:59:04 INFO common.Storage:Storage directory /tmp/hadoop-hadoop/dfs/name has been successfully formatted.
13/01/30 00:59:04 INFO namenode.NameNode:SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode atnode01/192.168.231.131
************************************************************/
10.启动守护进程
注意,在启动守护进程之前,一定要先关闭防火墙(所有的结点都要),否则datanode启动失败。
[root@node04 ~]# /etc/init.d/iptables stop
iptables: Flushing firewall rules: [ OK ]
iptables: Setting chains to policy ACCEPT:filter [ OK ]
iptables: Unloading modules: [ OK ]
最好设置开机就不启动防火墙:
[root@node01 ~]# vi /etc/sysconfig/selinux
SELINUX=disable
[hadoop@node01bin]$ ./start-all.sh
startingnamenode, logging to/home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-namenode-node01.out
node03:starting datanode, logging to/home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-datanode-node03.out
node02:starting datanode, logging to/home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-datanode-node02.out
node04:starting datanode, logging to/home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-datanode-node04.out
hadoop@node01'spassword:
node01:starting secondarynamenode, logging to/home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-secondarynamenode-node01.out
startingjobtracker, logging to/home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-jobtracker-node01.out
node03:starting tasktracker, logging to /home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-tasktracker-node03.out
node02:starting tasktracker, logging to/home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-tasktracker-node02.out
node04:starting tasktracker, logging to /home/hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-tasktracker-node04.out
检测守护进程启动情况:
Master结点:
[hadoop@node01 jdk1.6.0_38]$ /usr/java/jdk1.6.0_38/bin/jps
3986 Jps
3639 NameNode
3785 SecondaryNameNode
3858 JobTracker
Slave结点(以node02为例):
[root@node02 ~]# /usr/java/jdk1.6.0_38/bin/jps
3254 TaskTracker
3175 DataNode
3382 Jps
首页 上一页 1 2 下一页 尾页 2/2/2
】【打印繁体】【投稿】【收藏】 【推荐】【举报】【评论】 【关闭】 【返回顶部
分享到: 
上一篇OCP47:155 下一篇[HBase]完全分布式安装过程详解

评论

帐  号: 密码: (新用户注册)
验 证 码:
表  情:
内  容: