hadoop2.x 將namenode 與 SecondaryNameNode 分開部署

修改方法

在hadoop namenode節點上修改hadoop2.7.7 目錄 

cd ~/hadoop-2.7.7/etc/hadoop/

配置

[hadoop@namenodeyw hadoop]$ cat masters 

datenodeyw1     #說明 SecondaryNameNode 服務將再這臺節點上啟動

[hadoop@namenodeyw hadoop]$ cat hdfs-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<!-- #紅色部門為將namenode 與  SecondaryNameNode 分開部署 -->
  <property>
     <name>dfs.http.address</name>
     <value>namenodeyw:50070</value>
     <description>
     The address and the base port where the dfs namenode web ui will listen on. If the port is 0 then the server will start on a free port.
     </description>
  </property>
  <property>
     <name>dfs.namenode.secondary.http-address</name>
     <value>datanodeyw1:50090</value>
  </property>
  <property>
     <name>dfs.name.dir</name>
     <value>/opt/hadoop/dfs/name</value>
     <description>Path on the local filesystem where theNameNode stores the namespace and transactions logs persistently.</description>
  </property>
  <property>
     <name>dfs.data.dir</name>
     <value>/opt/hadoop/dfs/data</value>
     <description>Comma separated list of paths on the localfilesystem of a DataNode where it should store its blocks.</description>
  </property>
  <property>
     <name>dfs.replication</name>
     <value>3</value>
  </property>
  <property>
    <name>dfs.permissions</name>
    <value>false</value>
    <description>need not permissions</description>
  </property>
</configuration>

[hadoop@namenodeyw hadoop]$ cat core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
   <property>
        <name>hadoop.tmp.dir</name>
        <value>/opt/hadoop/tmp</value>
        <description>Abase for other temporary directories.</description>
   </property>
   <property>
        <name>fs.default.name</name>
        <value>hdfs://namenodeyw:9000</value>
   </property>
<! -- #以下為將namenode 與  SecondaryNameNode 分開部署 -->
   <property>
       <name>fs.checkpoint.period</name>
       <value>3600</value>
       <description>The number of seconds between two periodic checkpoints.</description>
   </property>
   <property>
       <name>fs.checkpoint.size</name>
       <value>67108864</value>
   </property>
</configuration>

然后將改配置文件目錄分別同步到其他節點。

依次重啟服務。

先重啟hadoop機器  ./start-all.sh 

再重啟 zookeeper    ./zkSever.sh  start

再到配置hbase主節點上啟動habase     ./start-hbase.sh

在namenode上啟動

./start-all.sh 啟動后進程截圖

[hadoop@namenodeyw sbin]$ jps

8017 NodeManager

8389 Jps

7498 NameNode

7642 DataNode

7900 ResourceManager

[hadoop@datanodeyw1 hadoop]$ jps

16529 DataNode

16305 Main

16770 NodeManager

17238 Jps

16639 SecondaryNameNode

[hadoop@datanodeyw2 bin]$ jps

13139 DataNode

13400 Jps

13257 NodeManager

在namenode上啟動 start-yarn.sh  提示已經啟動。

[hadoop@namenodeyw sbin]$ ./start-yarn.sh

starting yarn daemons

resourcemanager running as process 7900. Stop it first.

namenodeyw: nodemanager running as process 8017. Stop it first.

datanodeyw2: nodemanager running as process 13257. Stop it first.

datanodeyw1: nodemanager running as process 16770. Stop it first.