文章
文章用户文档快讯圈子网址导航

HBase实战（2）：搭建分布式集群HBASE

释放双眼，带上耳机，听听看~！

搭建分布式集群HBASE

1，单机版本的安装请参考 https://blog.csdn.net/duan_zhihua/article/details/80622166

2，ZOOKEPER集群的安装请参考https://blog.csdn.net/duan_zhihua/article/details/70885469

2，分布式集群HBASE安装： 

  • 配置vim hbase-env.sh  



1
2
3
4
1root@master:/usr/local/hbase-1.2.0/conf# vi hbase-env.sh

2export JAVA_HOME=/usr/local/jdk1.8.0_60

3export HBASE_MANAGES_ZK=false 

4
  • 配置vim hbase-site.xml 


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
1 <configuration>  

2     

3        <property>  

4            <name>hbase.rootdir</name>  

5            <value>hdfs://master:9000/hbase</value>  

6        </property>  

7        

8        <property>  

9            <name>hbase.cluster.distributed</name>  

10            <value>true</value>  

11        </property>  

12          

13        <property>  

14            <name>hbase.zookeeper.quorum</name>  

15            <value>192.168.189.1:2181,192.168.189.2:2181,192.168.189.3:2181</value>  

16        </property>  

17    </configuration>  

18

配置regionservers
*



1
2
3
4
5
6
7
8
9
1root@master:/usr/local/hbase-1.2.0/conf# vi regionservers

2

3master

4worker1

5worker2

6worker3

7~

8~

9





1
2
1从Master复制hbase目录到从节点worker1 worker2 worker3中  

2





1
2
3
4
1scp -r /usr/local/hbase-1.2.0 worker1:/usr/local/hbase-1.2.0

2scp -r /usr/local/hbase-1.2.0 worker2:/usr/local/hbase-1.2.0

3scp -r /usr/local/hbase-1.2.0 worker3:/usr/local/hbase-1.2.0

4





1
2
1依次启动Hadoop、zookeeper、hbase

2
  • 启动hadoop


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
1root@master:~# /usr/local/hadoop-2.6.0/sbin/start-all.sh

2This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh

3SLF4J: Class path contains multiple SLF4J bindings.

4SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

5SLF4J: Found binding in [jar:file:/usr/local/alluxio-1.7.0-hadoop-2.6/client/alluxio-1.7.0-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]

6SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

7SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

8Starting namenodes on [master]

9master: starting namenode, logging to /usr/local/hadoop-2.6.0/logs/hadoop-root-namenode-master.out

10worker3: starting datanode, logging to /usr/local/hadoop-2.6.0/logs/hadoop-root-datanode-worker3.out

11worker1: starting datanode, logging to /usr/local/hadoop-2.6.0/logs/hadoop-root-datanode-worker1.out

12worker2: starting datanode, logging to /usr/local/hadoop-2.6.0/logs/hadoop-root-datanode-worker2.out

13Starting secondary namenodes [0.0.0.0]

140.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop-2.6.0/logs/hadoop-root-secondarynamenode-master.out

15SLF4J: Class path contains multiple SLF4J bindings.

16SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

17SLF4J: Found binding in [jar:file:/usr/local/alluxio-1.7.0-hadoop-2.6/client/alluxio-1.7.0-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]

18SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

19SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

20starting yarn daemons

21starting resourcemanager, logging to /usr/local/hadoop-2.6.0/logs/yarn-root-resourcemanager-master.out

22worker2: starting nodemanager, logging to /usr/local/hadoop-2.6.0/logs/yarn-root-nodemanager-worker2.out

23worker1: starting nodemanager, logging to /usr/local/hadoop-2.6.0/logs/yarn-root-nodemanager-worker1.out

24worker3: starting nodemanager, logging to /usr/local/hadoop-2.6.0/logs/yarn-root-nodemanager-worker3.out

25root@master:~# hadoop dfsadmin -safemode leave 

26DEPRECATED: Use of this script to execute hdfs command is deprecated.

27Instead use the hdfs command for it.

28

29SLF4J: Class path contains multiple SLF4J bindings.

30SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

31SLF4J: Found binding in [jar:file:/usr/local/alluxio-1.7.0-hadoop-2.6/client/alluxio-1.7.0-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]

32SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

33SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

34Safe mode is OFF

35root@master:~# 

36





1
2
3
4
5
6
7
1root@master:~# jps

22722 SecondaryNameNode

33204 Jps

42893 ResourceManager

52542 NameNode

6root@master:~# 

7





1
2
1启动zookeeper  

2





1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
1root@master:~# zkServer.sh start 

2JMX enabled by default

3Using config: /usr/local/zookeeper-3.4.6/bin/../conf/zoo.cfg

4Starting zookeeper ... STARTED

5root@master:~# zkServer.sh  status  

6JMX enabled by default

7Using config: /usr/local/zookeeper-3.4.6/bin/../conf/zoo.cfg

8Mode: follower

9root@master:~# jps

102722 SecondaryNameNode

113385 Jps

123324 QuorumPeerMain

132542 NameNode

14root@master:~# 

15





1
2
3
4
5
6
7
8
9
10
11
12
13
14
1root@worker1:/usr/local# zkServer.sh start 

2JMX enabled by default

3Using config: /usr/local/zookeeper-3.4.6/bin/../conf/zoo.cfg

4Starting zookeeper ... STARTED

5root@worker1:/usr/local# zkServer.sh  status  

6JMX enabled by default

7Using config: /usr/local/zookeeper-3.4.6/bin/../conf/zoo.cfg

8Mode: leader

9root@worker1:/usr/local# jps

102800 Jps

112530 NodeManager

122741 QuorumPeerMain

132399 DataNode

14





1
2
3
4
5
6
7
8
9
10
11
12
13
1root@worker2:~# zkServer.sh start 

2JMX enabled by default

3Using config: /usr/local/zookeeper-3.4.6/bin/../conf/zoo.cfg

4Starting zookeeper ... STARTED

5root@worker2:~# zkServer.sh  status  

6JMX enabled by default

7Using config: /usr/local/zookeeper-3.4.6/bin/../conf/zoo.cfg

8Mode: follower

9root@worker2:~# jps

102707 Jps

112654 QuorumPeerMain

122287 DataNode

13





1
2
1启动HBASE  

2





1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
1root@master:~# start-hbase.sh

2starting master, logging to /usr/local/hbase-1.2.0/logs/hbase-root-master-master.out

3Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

4Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

5worker1: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-worker1.out

6worker2: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-worker2.out

7worker3: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-worker3.out

8master: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-master.out

9worker2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

10worker2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

11worker1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

12worker1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

13worker3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

14worker3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

15master: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

16master: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

17root@master:~# jps

184002 Jps

192722 SecondaryNameNode

203687 HRegionServer

213324 QuorumPeerMain

223532 HMaster

232542 NameNode

24root@master:~# 

25





1
2
3
4
5
6
7
8
1root@worker1:/usr/local# jps

22530 NodeManager

32741 QuorumPeerMain

43035 Jps

52878 HRegionServer

62399 DataNode

7root@worker1:/usr/local# 

8





1
2
3
4
5
6
7
8
9
10
11
1root@worker2:~# jps

22707 Jps

32654 QuorumPeerMain

42287 DataNode

5root@worker2:~# jps

62792 HRegionServer

73005 Jps

82654 QuorumPeerMain

92287 DataNode

10root@worker2:~# 

11





1
2
3
4
5
6
7
8
9
10
11
1root@worker3:~# jps

22711 HRegionServer

32344 DataNode

42921 Jps

52479 NodeManager

6root@worker3:~# 

7

8

9

10

11

在hbase-site.xml中加入web的配置：



1
2
3
4
5
1<property>

2        <name>hbase.master.info.port</name>

3        <value>60010</value>

4</property>

5

hbase-site.xml复制到worker节点



1
2
3
4
5
6
7
8
1root@master:/usr/local/hbase-1.2.0/conf# scp -r /usr/local/hbase-1.2.0/conf/hbase-site.xml worker1:/usr/local/hbase-1.2.0/conf/hbase-site.xml

2hbase-site.xml                                                                                                                        100%  603     0.6KB/s   00:00    

3root@master:/usr/local/hbase-1.2.0/conf# scp -r /usr/local/hbase-1.2.0/conf/hbase-site.xml worker2:/usr/local/hbase-1.2.0/conf/hbase-site.xml

4hbase-site.xml                                                                                                                        100%  603     0.6KB/s   00:00    

5root@master:/usr/local/hbase-1.2.0/conf# scp -r /usr/local/hbase-1.2.0/conf/hbase-site.xml worker3:/usr/local/hbase-1.2.0/conf/hbase-site.xml

6hbase-site.xml                                                                                                                        100%  603     0.6KB/s   00:00    

7root@master:/usr/local/hbase-1.2.0/conf# 

8

重启hbase。



1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
1root@master:~# start-hbase.sh

2starting master, logging to /usr/local/hbase-1.2.0/logs/hbase-root-master-master.out

3Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

4Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

5worker1: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-worker1.out

6master: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-master.out

7worker3: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-worker3.out

8worker2: starting regionserver, logging to /usr/local/hbase-1.2.0/bin/../logs/hbase-root-regionserver-worker2.out

9worker1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

10worker1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

11master: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

12master: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

13worker3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

14worker3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

15worker2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0

16worker2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

17root@master:~# 

18

打开HBASE的web页面地址http://192.168.189.1:60010/master-status，部署成功！

进入hbase shell



1
2
3
4
5
6
7
8
9
10
11
12
13
1root@master:~# hbase shell

2SLF4J: Class path contains multiple SLF4J bindings.

3SLF4J: Found binding in [jar:file:/usr/local/hbase-1.2.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

4SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

5SLF4J: Found binding in [jar:file:/usr/local/alluxio-1.7.0-hadoop-2.6/client/alluxio-1.7.0-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]

6SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

7SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

8HBase Shell; enter 'help<RETURN>' for list of supported commands.

9Type "exit<RETURN>" to leave the HBase Shell

10Version 1.2.0, r25b281972df2f5b15c426c8963cbf77dd853a5ad, Thu Feb 18 23:01:49 CST 2016

11

12hbase(main):001:0> 

13

在hbase中分布式集群中操作：

在web页面检查新建的表

Related posts:

  1. mysql 集群
  2. MySQL读写分离
  3. 各种编程语言的深度学习库整理
  4. Kafka、RabbitMQ、RocketMQ等消息中间件的对比 —— 消息发送性能和区别

给TA打赏
共{{data.count}}人
人已打赏
[db:标签]分布式安装
安全运维

OpenSSH-8.7p1离线升级修复安全漏洞

2021-10-23 10:13:25

安全运维

设计模式的设计原则

2021-12-12 17:36:11

猜你喜欢

mysql 集群

010

MySQL读写分离

028
❯

解锁会员权限

开通会员

解锁海量优质VIP资源

立刻开通
个人中心
购物车
优惠劵
今日签到
有新私信 私信列表
搜索

  • 扫码打开当前页

返回顶部