軟件準備
我使用的是centos-6.6的虛擬機,主機名為repo。參考在Windows中安裝Linux虛擬機的步驟,我在該虛擬機中安裝了JDK,參考在Linux中安裝JDK的指南。此外,該虛擬機配置了免秘鑰登錄自身,參考配置各臺虛擬機之間免秘鑰登錄的設置。hadoop安裝包的下載地址為:https://www.php.cn/link/eecd2755d73701aa057cd2a32bd7b1e2。
-
將Hadoop安裝包上傳到服務器并解壓
[root@repo ~]# tar zxvf hadoop-2.6.5.tar.gz -C /opt/apps/
-
配置環境變量
# 可以直接定位到文件的最后一行 [root@repo hadoop-2.6.5]# vi + /etc/profile export HADOOP_HOME=/opt/apps/hadoop-2.6.5 export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin [root@repo hadoop-2.6.5]# . /etc/profile
-
修改 hadoop-env.sh、mapred-env.sh、yarn-env.sh 這三個配置文件,添加JAVA_HOME
-
修改 core-site.xml 和 hdfs-site.xml 配置文件,配置偽分布式相關的內容
[root@repo hadoop]# vi core-site.xml <configuration> <property> <name>fs.defaultFS</name> <value>hdfs://repo:9000</value> </property> <property> <name>hadoop.tmp.dir</name> <value>/var/hadoop/pseudo</value> </property> </configuration> [root@repo hadoop]# vi hdfs-site.xml <configuration> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>dfs.namenode.secondary.http-address</name> <value>repo:50090</value> </property> </configuration>
-
修改 slaves 配置文件,指定DataNode所在的節點
[root@repo hadoop]# vi slaves repo
-
格式化文件系統
[root@repo hadoop]# hadoop namenode --format # 成功信息 17/09/16 21:17:11 INFO common.Storage: Storage directory /var/hadoop/pseudo/dfs/name has been successfully formatted.
-
啟動HDFS和YARN
[root@repo hadoop]# start-dfs.sh Starting namenodes on [repo] repo: starting namenode, logging to /opt/apps/hadoop-2.6.5/logs/hadoop-root-namenode-repo.out repo: starting datanode, logging to /opt/apps/hadoop-2.6.5/logs/hadoop-root-datanode-repo.out Starting secondary namenodes [repo] repo: starting secondarynamenode, logging to /opt/apps/hadoop-2.6.5/logs/hadoop-root-secondarynamenode-repo.out [root@repo hadoop]# start-yarn.sh starting yarn daemons starting resourcemanager, logging to /opt/hadoop-2.7.4/logs/yarn-root-resourcemanager-repo.out repo: starting nodemanager, logging to /opt/hadoop-2.7.4/logs/yarn-root-nodemanager-repo.out [root@repo hadoop]# jps 4368 Jps 3957 ResourceManager 3512 NameNode 3641 DataNode 4058 NodeManager 3805 SecondaryNameNode
-
訪問WEB頁面
搭建成功!