分享

hive-1.1.0-cdh5.4.0执行hive统计hbase中记录的条数无结果返回

一曲离殇 发表于 2017-11-28 15:54:08 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 6 6702
hbase表中有数据,hive建了关联表,用hive-0.13可以查出结果,hive-1.1执行不报错就是没有结果返回

Query ID = ocetl_20171128154949_0a850e8b-fdcf-4fe2-8a8d-336eacad800b
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
Job running in-process (local Hadoop)
2017-11-28 15:49:33,776 Stage-1 map = 0%,  reduce = 0%
2017-11-28 15:49:41,872 Stage-1 map = 3%,  reduce = 0%, Cumulative CPU 25.44 sec
2017-11-28 15:49:42,881 Stage-1 map = 20%,  reduce = 0%, Cumulative CPU 158.56 sec
2017-11-28 15:49:43,887 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 158.56 sec
2017-11-28 15:49:47,922 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 160.13 sec
MapReduce Total cumulative CPU time: 2 minutes 40 seconds 130 msec
Ended Job = job_1511789650971_0017
MapReduce Jobs Launched:
Stage-Stage-1:  Cumulative CPU: 160.13 sec   HDFS Read: 8204 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 2 minutes 40 seconds 130 msec
OK
Time taken: 23.396 seconds

已有(6)人评论

跳转到指定楼层
nextuser 发表于 2017-11-28 17:12:07
2017-11-28 15:49:33,776 Stage-1 map = 0%,  reduce = 0%
2017-11-28 15:49:41,872 Stage-1 map = 3%,  reduce = 0%, Cumulative CPU 25.44 sec
2017-11-28 15:49:42,881 Stage-1 map = 20%,  reduce = 0%, Cumulative CPU 158.56 sec
2017-11-28 15:49:43,887 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 158.56 sec
2017-11-28 15:49:47,922 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 160.13 sec
MapReduce Total cumulative CPU time: 2 minutes 40 seconds 130 msec
Ended Job = job_1511789650971_0017
MapReduce Jobs Launched:
Stage-Stage-1:  Cumulative CPU: 160.13 sec   HDFS Read: 8204 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 2 minutes 40 seconds 130 msec
OK
Time taken: 23.396 seconds
###########
如上,因为写为0【空】.去看下详细运行日志。
猜测如楼主所说,可能是版本兼容问题。详细还需贴出日志

回复

使用道具 举报

一曲离殇 发表于 2017-11-30 15:37:50
nextuser 发表于 2017-11-28 17:12
2017-11-28 15:49:33,776 Stage-1 map = 0%,  reduce = 0%
2017-11-28 15:49:41,872 Stage-1 map = 3%,  r ...

hive-1.1.0与hadoop2.5.0不兼容吗,我也怀疑不兼容了
回复

使用道具 举报

nextuser 发表于 2017-11-30 16:10:11
一曲离殇 发表于 2017-11-30 15:37
hive-1.1.0与hadoop2.5.0不兼容吗,我也怀疑不兼容了

看下日志,官网给出的都是兼容的,但是很多都需要我们去验证。
回复

使用道具 举报

一曲离殇 发表于 2017-12-1 15:57:12
nextuser 发表于 2017-11-30 16:10
看下日志,官网给出的都是兼容的,但是很多都需要我们去验证。

日志信息,麻烦您帮忙分析下,非常感谢

hive.zip

3.23 KB, 下载次数: 1

回复

使用道具 举报

nextuser 发表于 2017-12-2 22:15:29
一曲离殇 发表于 2017-12-1 15:57
日志信息,麻烦您帮忙分析下,非常感谢
ERROR [main]: metastore.ObjectStore (ObjectStore.java:checkSchema(6640)) - Version information found in metastore differs 0.13.0 from expected schema version 1.1.0. Schema verififcation is disabled hive.metastore.schema.verification so setting version


because of javax.naming.CommunicationException: DNS error [Root exception is java.net.PortUnreachableException: ICMP Port Unreachable]; remaining name '9.16.188.135.in-addr.arpa'



Cannot resolve the host name for yxddn08/135.188.16.8 because of javax.naming.CommunicationException: DNS error [Root exception is java.net.PortUnreachableException: ICMP Port Unreachable]; remaining name '8.16.188.135.in-addr.arpa'


WARN  [main]: mapreduce.TableInputFormatBase (TableInputFormatBase.java:getSplits(193)) - Cannot resolve the host name for yxddn09/135.188.16.9 because of javax.naming.CommunicationException: DNS error [Root exception is java.net.PortUnreachableException: ICMP Port Unreachable]; remaining name '9.16.188.135.in-addr.arpa'

错误比较多,先解决hostname的解析问题。 yxddn08/135.188.16.8,看看是不是哪个机器漏配置了。


回复

使用道具 举报

一曲离殇 发表于 2017-12-3 11:25:36
nextuser 发表于 2017-12-2 22:15
错误比较多,先解决hostname的解析问题。 yxddn08/135.188.16.8,看看是不是哪个机器漏配置了。

hostname每台都配了
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条