hadoop生态系统学习之路（十）MR将结果输出到hbase

释放双眼，带上耳机，听听看~！

之前讲了MR将结果输出到hdfs、hive、db，今天再给大家分享一下，如何将结果输出到hbase。
首先，提一句，笔者在hadoop集群执行此MR的时候报了一个错误，是一个jar包的缘故，这个错误是hbase版本的bug，在下面笔者会为大家介绍以及如何解决这个问题。
好了，笔者将分以下几个步骤进行介绍：

一、pom依赖


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
1      &lt;!-- hbase版本 --&gt;

2      &lt;hbase.version&gt;0.96.1.1-cdh5.0.0&lt;/hbase.version&gt;

3

4      &lt;!-- habase 相关jar--&gt;

5      &lt;dependency&gt;

6        &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

7        &lt;artifactId&gt;hbase-client&lt;/artifactId&gt;

8        &lt;version&gt;${hbase.version}&lt;/version&gt;

9        &lt;exclusions&gt;

10            &lt;exclusion&gt;

11                &lt;artifactId&gt;jdk.tools&lt;/artifactId&gt;

12                &lt;groupId&gt;jdk.tools&lt;/groupId&gt;

13            &lt;/exclusion&gt;

14            &lt;exclusion&gt;

15              &lt;artifactId&gt;hbase-protocol&lt;/artifactId&gt;

16              &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

17            &lt;/exclusion&gt;

18        &lt;/exclusions&gt;

19      &lt;/dependency&gt;

20      &lt;dependency&gt;

21          &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

22          &lt;artifactId&gt;hbase-common&lt;/artifactId&gt;

23          &lt;version&gt;${hbase.version}&lt;/version&gt;

24      &lt;/dependency&gt;

25

26      &lt;dependency&gt;

27          &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

28          &lt;artifactId&gt;hbase-server&lt;/artifactId&gt;

29          &lt;version&gt;${hbase.version}&lt;/version&gt;

30          &lt;exclusions&gt;

31            &lt;exclusion&gt;

32              &lt;artifactId&gt;hbase-protocol&lt;/artifactId&gt;

33              &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

34            &lt;/exclusion&gt;

35          &lt;/exclusions&gt;

36      &lt;/dependency&gt;

37      &lt;dependency&gt;

38          &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

39          &lt;artifactId&gt;hbase-thrift&lt;/artifactId&gt;

40          &lt;version&gt;${hbase.version}&lt;/version&gt;

41          &lt;exclusions&gt;

42            &lt;exclusion&gt;

43              &lt;artifactId&gt;hbase-protocol&lt;/artifactId&gt;

44              &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

45            &lt;/exclusion&gt;

46          &lt;/exclusions&gt;

47      &lt;/dependency&gt;

48      &lt;dependency&gt;

49          &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

50          &lt;artifactId&gt;hbase-testing-util&lt;/artifactId&gt;

51          &lt;version&gt;${hbase.version}&lt;/version&gt;

52          &lt;scope&gt;test&lt;/scope&gt;

53          &lt;exclusions&gt;

54            &lt;exclusion&gt;

55              &lt;artifactId&gt;hbase-protocol&lt;/artifactId&gt;

56              &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

57            &lt;/exclusion&gt;

58          &lt;/exclusions&gt;

59      &lt;/dependency&gt;

60

61      &lt;dependency&gt;

62          &lt;groupId&gt;org.apache.hbase&lt;/groupId&gt;

63          &lt;artifactId&gt;hbase-protocol&lt;/artifactId&gt;

64          &lt;version&gt;${hbase.version}&lt;/version&gt;

65          &lt;scope&gt;compile&lt;/scope&gt;

66      &lt;/dependency&gt;

67

二、hbase表创建以及hdfs数据准备

首先，我们执行hbase shell进入命令行，然后执行：


1
2
1create &#x27;user_info&#x27;, {NAME =&gt; &#x27;info&#x27;}

2

创建user_info表，列族是info。
然后hdfs数据还是之前入hive以及db的文件，这里就不贴出来了。

三、MR代码实现

首先，我们来看主类：


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
1/**

2 * Project Name:mr-demo

3 * File Name:LoadDataToHbaseMR.java

4 * Package Name:org.qiyongkang.mr.hbasestore

5 * Date:2016年4月10日下午4:24:11

6 * Copyright (c) 2016, CANNIKIN(http://http://code.taobao.org/p/cannikin/src/) All Rights Reserved.

7 *

8*/

9

10package org.qiyongkang.mr.hbasestore;

11

12import java.io.IOException;

13

14import org.apache.hadoop.conf.Configuration;

15import org.apache.hadoop.fs.Path;

16import org.apache.hadoop.hbase.HBaseConfiguration;

17import org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil;

18import org.apache.hadoop.io.IntWritable;

19import org.apache.hadoop.io.Text;

20import org.apache.hadoop.mapreduce.Job;

21import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;

22

23/**

24 * ClassName:LoadDataToHbaseMR &lt;br/&gt;

25 * Function: TODO ADD FUNCTION. &lt;br/&gt;

26 * Reason:   TODO ADD REASON. &lt;br/&gt;

27 * Date:     2016年4月10日 下午4:24:11 &lt;br/&gt;

28 * @author   qiyongkang

29 * @version  

30 * @since    JDK 1.6

31 * @see      

32 */

33public class LoadDataToHbaseMR {

34    public static void main(String[] args) throws IOException, ClassNotFoundException, InterruptedException {

35        String tablename = &quot;user_info&quot;;

36        Configuration conf = HBaseConfiguration.create();

37        conf.set(&quot;hbase.zookeeper.quorum&quot;, &quot;172.31.25.8,172.31.25.2,172.31.25.3&quot;);

38

39        Job job = Job.getInstance(conf, &quot;hbase store&quot;);

40        job.setJarByClass(LoadDataToHbaseMR.class);

41

42        job.setMapperClass(HbaseStoreMapper.class);

43        job.setReducerClass(HbaseStoreReducer.class);

44

45        // 设置输入文件路径

46        FileInputFormat.addInputPath(job, new Path(&quot;/qiyongkang/input&quot;));

47

48        job.setNumReduceTasks(1);

49

50        TableMapReduceUtil.initTableReducerJob(tablename, HbaseStoreReducer.class, job);

51

52        job.setMapOutputKeyClass(Text.class);

53        job.setMapOutputValueClass(IntWritable.class);

54

55        System.exit(job.waitForCompletion(true) ? 0 : 1);

56    }

57}

58

59

60

然后再来看Mapper类：


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
1/**

2 * Project Name:mr-demo

3 * File Name:HbaseStoreMapper.java

4 * Package Name:org.qiyongkang.mr.hbasestore

5 * Date:2016年4月10日下午4:24:30

6 * Copyright (c) 2016, CANNIKIN(http://http://code.taobao.org/p/cannikin/src/) All Rights Reserved.

7 *

8*/

9

10package org.qiyongkang.mr.hbasestore;

11

12

13import java.io.IOException;

14

15import org.apache.hadoop.io.IntWritable;

16import org.apache.hadoop.io.Text;

17import org.apache.hadoop.mapreduce.Mapper;

18

19/**

20 * ClassName:HbaseStoreMapper &lt;br/&gt;

21 * Function: TODO ADD FUNCTION. &lt;br/&gt;

22 * Reason:   TODO ADD REASON. &lt;br/&gt;

23 * Date:     2016年4月10日 下午4:24:30 &lt;br/&gt;

24 * @author   qiyongkang

25 * @version  

26 * @since    JDK 1.6

27 * @see      

28 */

29public class HbaseStoreMapper extends Mapper&lt;Object, Text, Text, IntWritable&gt;{

30    private IntWritable one = new IntWritable(1);

31

32    @Override

33    protected void map(Object key, Text value, Mapper&lt;Object, Text, Text, IntWritable&gt;.Context context)

34            throws IOException, InterruptedException {

35        context.write(value, one);

36    }

37

38}

39

40

41

这个Mapper基本上没干啥事。
再来看看Reducer：


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
1/**

2 * Project Name:mr-demo

3 * File Name:HbaseStoreReducer.java

4 * Package Name:org.qiyongkang.mr.hbasestore

5 * Date:2016年4月10日下午5:01:56

6 * Copyright (c) 2016, CANNIKIN(http://http://code.taobao.org/p/cannikin/src/) All Rights Reserved.

7 *

8*/

9

10package org.qiyongkang.mr.hbasestore;

11

12import java.io.IOException;

13

14import org.apache.hadoop.hbase.client.Mutation;

15import org.apache.hadoop.hbase.client.Put;

16import org.apache.hadoop.hbase.mapreduce.TableReducer;

17import org.apache.hadoop.hbase.util.Bytes;

18import org.apache.hadoop.io.IntWritable;

19import org.apache.hadoop.io.Text;

20import org.apache.hadoop.io.WritableComparable;

21import org.apache.hadoop.mapreduce.Reducer;

22

23/**

24 * ClassName:HbaseStoreReducer &lt;br/&gt;

25 * Function: TODO ADD FUNCTION. &lt;br/&gt;

26 * Reason:   TODO ADD REASON. &lt;br/&gt;

27 * Date:     2016年4月10日 下午5:01:56 &lt;br/&gt;

28 * @author   qiyongkang

29 * @version  

30 * @since    JDK 1.6

31 * @see      

32 */

33public class HbaseStoreReducer extends TableReducer&lt;Text, IntWritable, WritableComparable&lt;Object&gt;&gt;{

34

35    @Override

36    protected void reduce(Text key, Iterable&lt;IntWritable&gt; values,

37            Reducer&lt;Text, IntWritable, WritableComparable&lt;Object&gt;, Mutation&gt;.Context context)

38                    throws IOException, InterruptedException {

39        // 每行以制表符分隔 id, account, name, age

40        String[] strs = key.toString().split(&quot;\t&quot;);

41

42        //id为rowKey

43        Put put = new Put(strs[0].getBytes());

44        //account

45        put.add(Bytes.toBytes(&quot;info&quot;), Bytes.toBytes(&quot;account&quot;), Bytes.toBytes(strs[1]));

46        //name

47        put.add(Bytes.toBytes(&quot;info&quot;), Bytes.toBytes(&quot;name&quot;), Bytes.toBytes(strs[2]));

48        //age

49        put.add(Bytes.toBytes(&quot;info&quot;), Bytes.toBytes(&quot;age&quot;), Bytes.toBytes(strs[3]));

50

51        context.write(null, put);

52    }

53

54}

55

56

57

我们在reducer再进行split，然后把结果写入到hbase。

四、执行以及版本bug解决方案

首先，我们打好包，直接在hadoop集群上执行，会报错如下：


1
2
3
4
116/04/10 18:34:25 INFO zookeeper.ClientCnxn: Opening socket connection to server massdata8/172.31.25.8:2181. Will not attempt to authenticate using SASL (unknown error)

2

3java.lang.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString

4

我在网上查了半天，结果发现是hbase版本的原因。
笔者公司hadoop集群所使用的hbase版本是hbase-0.96.1.1-cdh5.0.0，使用这个刚好遇到这个bug，这个bug在后面的版本已经解决。
那么，如何解决呢？大家可以参考此博客：
http://my.oschina.net/cloudcoder/blog/291486
下面，我们执行：


1
2
1HADOOP_CLASSPATH=/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar:/etc/hbase/conf hadoop jar mr-demo-0.0.1-SNAPSHOT-jar-with-dependencies.jar

2

便可执行成功，主要是这个hbase版本，会动态加载jar文件，后面的日志我们可以看到，如下：


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
1HADOOP_CLASSPATH=/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar:/etc/hbase/conf hadoop jar mr-demo-0.0.1-SNAPSHOT-jar-with-dependencies.jar 

216/04/11 12:54:17 INFO client.RMProxy: Connecting to ResourceManager at massdata8/172.31.25.8:8032

316/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.0.0--1, built on 03/28/2014 04:21 GMT

416/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:host.name=massdata8

516/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_75

616/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation

716/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/jdk1.7.0_75/jre

816/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/etc/hadoop/conf:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/hue-plugins-3.5.0-cdh5.0.0-SNAPSHOT.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/zookeeper-3.4.5-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/avro.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/junit-4.8.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-column-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-pig-bundle-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-cascading.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-encoding-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-thrift-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-avro-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-avro.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-annotations-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-thrift.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-thrift-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-generator.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop-bundle-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-common-2.3.0-cdh5.0.0-tests.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-scrooge.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-encoding-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-common.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-pig-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-cascading-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-format-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-scrooge-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-encoding.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-common-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-generator-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-column.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-test-hadoop2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-nfs.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-nfs-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-pig.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-common-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-annotations.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-common-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-cascading-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-auth-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-common.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-format-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-pig-bundle.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-format.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-avro-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-column-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop-bundle.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-auth.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-generator-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-scrooge-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-pig-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/./:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-2.3.0-cdh5.0.0-tests.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-nfs-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-guice-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/zookeeper-3.4.5-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jline-0.9.94.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/guice-3.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-client-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-tests.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-api-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-common-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-client-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-common.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-client.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-common.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-tests-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-api.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-common-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/junit-4.10.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/avro.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/guice-3.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/hamcrest-core-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-extras-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-el-1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-distcp-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//junit-4.10.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//activation-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-sls-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jsp-api-2.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-datajoin-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jetty-6.1.26.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//guava-11.0.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-rumen-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jersey-json-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archives.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archives-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//xz-1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-gridmix-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//asm-3.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jersey-core-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-digester-1.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-gridmix.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//zookeeper-3.4.5-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//xmlenc-0.52.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//metrics-core-3.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//avro.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-io-2.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-extras.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//paranamer-2.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-sls.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//log4j-1.2.17.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-codec-1.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jersey-server-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-lang-2.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jettison-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-auth-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//servlet-api-2.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jsch-0.1.42.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-streaming-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hamcrest-core-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-auth.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-net-3.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.3.0-cdh5.0.0-tests.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-cli-1.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar:/etc/hbase/conf

916/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/lib/native

1016/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp

1116/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:java.compiler=&lt;NA&gt;

1216/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux

1316/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64

1416/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-279.el6.x86_64

1516/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:user.name=hdfs

1616/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hdfs

1716/04/11 12:54:17 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/qiyongkang

1816/04/11 12:54:17 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=172.31.25.2:2181,172.31.25.8:2181,172.31.25.3:2181 sessionTimeout=60000 watcher=hconnection-0xfcc6c91, quorum=172.31.25.2:2181,172.31.25.8:2181,172.31.25.3:2181, baseZNode=/hbase

1916/04/11 12:54:17 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0xfcc6c91 connecting to ZooKeeper ensemble=172.31.25.2:2181,172.31.25.8:2181,172.31.25.3:2181

2016/04/11 12:54:17 INFO zookeeper.ClientCnxn: Opening socket connection to server massdata8/172.31.25.8:2181. Will not attempt to authenticate using SASL (unknown error)

2116/04/11 12:54:17 INFO zookeeper.ClientCnxn: Socket connection established to massdata8/172.31.25.8:2181, initiating session

2216/04/11 12:54:17 INFO zookeeper.ClientCnxn: Session establishment complete on server massdata8/172.31.25.8:2181, sessionid = 0x353975519d0d25a, negotiated timeout = 60000

2316/04/11 12:54:18 INFO mapreduce.TableOutputFormat: Created table instance for user_info

2416/04/11 12:54:18 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.

2516/04/11 12:54:21 INFO input.FileInputFormat: Total input paths to process : 1

2616/04/11 12:54:22 INFO mapreduce.JobSubmitter: number of splits:1

2716/04/11 12:54:22 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1458262657013_0989

2816/04/11 12:54:22 INFO impl.YarnClientImpl: Submitted application application_1458262657013_0989

2916/04/11 12:54:22 INFO mapreduce.Job: The url to track the job: http://massdata8:8088/proxy/application_1458262657013_0989/

3016/04/11 12:54:22 INFO mapreduce.Job: Running job: job_1458262657013_0989

3116/04/11 12:54:32 INFO mapreduce.Job: Job job_1458262657013_0989 running in uber mode : false

3216/04/11 12:54:32 INFO mapreduce.Job:  map 0% reduce 0%

3316/04/11 12:54:42 INFO mapreduce.Job:  map 100% reduce 0%

3416/04/11 12:54:51 INFO mapreduce.Job:  map 100% reduce 100%

3516/04/11 12:54:52 INFO mapreduce.Job: Job job_1458262657013_0989 completed successfully

3616/04/11 12:54:53 INFO mapreduce.Job: Counters: 49

37    File System Counters

38        FILE: Number of bytes read=182

39        FILE: Number of bytes written=230209

40        FILE: Number of read operations=0

41        FILE: Number of large read operations=0

42        FILE: Number of write operations=0

43        HDFS: Number of bytes read=259

44        HDFS: Number of bytes written=0

45        HDFS: Number of read operations=2

46        HDFS: Number of large read operations=0

47        HDFS: Number of write operations=0

48    Job Counters 

49        Launched map tasks=1

50        Launched reduce tasks=1

51        Data-local map tasks=1

52        Total time spent by all maps in occupied slots (ms)=7763

53        Total time spent by all reduces in occupied slots (ms)=8240

54        Total time spent by all map tasks (ms)=7763

55        Total time spent by all reduce tasks (ms)=8240

56        Total vcore-seconds taken by all map tasks=7763

57        Total vcore-seconds taken by all reduce tasks=8240

58        Total megabyte-seconds taken by all map tasks=7949312

59        Total megabyte-seconds taken by all reduce tasks=8437760

60    Map-Reduce Framework

61        Map input records=8

62        Map output records=8

63        Map output bytes=168

64        Map output materialized bytes=178

65        Input split bytes=117

66        Combine input records=0

67        Combine output records=0

68        Reduce input groups=8

69        Reduce shuffle bytes=178

70        Reduce input records=8

71        Reduce output records=8

72        Spilled Records=16

73        Shuffled Maps =1

74        Failed Shuffles=0

75        Merged Map outputs=1

76        GC time elapsed (ms)=70

77        CPU time spent (ms)=2560

78        Physical memory (bytes) snapshot=960487424

79        Virtual memory (bytes) snapshot=3228942336

80        Total committed heap usage (bytes)=1584398336

81    Shuffle Errors

82        BAD_ID=0

83        CONNECTION=0

84        IO_ERROR=0

85        WRONG_LENGTH=0

86        WRONG_MAP=0

87        WRONG_REDUCE=0

88    File Input Format Counters 

89        Bytes Read=142

90    File Output Format Counters 

91        Bytes Written=0

92

这样，便执行成功啦。

五、查看结果

下面，我们在hbase执行scan ‘user_info’，可以看到：
说明结果入hbase成功！

ok，就讲到这儿了，其实也可以读取hbase的表数据，大家也可以去研究一下。

{{userData.name}}已认证

hadoop生态系统学习之路（十）MR将结果输出到hbase

一、pom依赖

二、hbase表创建以及hdfs数据准备

三、MR代码实现

四、执行以及版本bug解决方案

五、查看结果

MongoDB最简单的入门教程之三使用Java代码往MongoDB里插入数据

Ubuntu上NFS的安装配置

{{userData.name}}已认证

一、pom依赖

二、hbase表创建以及hdfs数据准备

三、MR代码实现

四、执行以及版本bug解决方案

五、查看结果

Related posts:

MongoDB最简单的入门教程之三 使用Java代码往MongoDB里插入数据

Ubuntu上NFS的安装配置

Kubernetes之（十九）资源指标和集群监控

Kubernetes入门

R利剑NoSQL系列文章 之 Cassandra

nginx+nginx-rtmp-module+ffmpeg搭建流媒体服务器

MongoDB最简单的入门教程之三使用Java代码往MongoDB里插入数据

R利剑NoSQL系列文章之 Cassandra