分享

hive 无法查询Error during job, obtaining debugging information...

zk0521 发表于 2015-7-26 01:09:08 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 1 40409
Logging initialized using configuration in jar:file:/home/hadoop/hive-1.0.1/lib/hive-common-1.0.1.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hive-1.0.1/lib/hive-jdbc-1.0.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
hive> select count(*) from t_emp;
Query ID = root_20150725214242_eff0653f-5d14-4e97-9354-fc621788b988
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapreduce.job.reduces=<number>
Starting Job = job_1437868517038_0001, Tracking URL = http://h3:8088/proxy/application_1437868517038_0001/
Kill Command = /home/hadoop/hadoop-2.6.0/bin/hadoop job  -kill job_1437868517038_0001
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2015-07-25 21:49:50,933 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:50:53,758 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:51:54,742 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:52:57,167 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:54:16,609 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:55:16,909 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:56:18,043 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:57:19,355 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:58:20,687 Stage-1 map = 0%,  reduce = 0%
2015-07-25 21:59:25,125 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:00:25,837 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:03:37,643 Stage-1 map = 100%,  reduce = 0%
2015-07-25 22:04:54,832 Stage-1 map = 100%,  reduce = 0%
2015-07-25 22:05:55,096 Stage-1 map = 100%,  reduce = 0%
2015-07-25 22:07:30,583 Stage-1 map = 100%,  reduce = 0%
2015-07-25 22:08:35,358 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:09:59,835 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:11:02,681 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:12:22,513 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:13:24,200 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:14:52,291 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:15:34,775 Stage-1 map = 67%,  reduce = 0%, Cumulative CPU 16.6 sec
2015-07-25 22:15:47,866 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 16.6 sec
2015-07-25 22:17:10,990 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 27.18 sec
2015-07-25 22:18:39,101 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 27.18 sec
2015-07-25 22:19:41,048 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 30.62 sec
2015-07-25 22:19:46,776 Stage-1 map = 100%,  reduce = 67%, Cumulative CPU 32.92 sec
2015-07-25 22:20:48,512 Stage-1 map = 100%,  reduce = 67%, Cumulative CPU 34.85 sec
2015-07-25 22:20:58,625 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 48.89 sec
2015-07-25 22:22:32,199 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 53.19 sec
2015-07-25 22:23:43,102 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:24:44,372 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:25:55,181 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:27:06,680 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:28:07,864 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:29:10,655 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:30:12,361 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:31:40,744 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:32:40,884 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:33:42,314 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:34:43,020 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:35:44,405 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:36:59,882 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:38:00,541 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:39:06,345 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 55.29 sec
2015-07-25 22:39:37,623 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:40:42,550 Stage-1 map = 0%,  reduce = 0%
2015-07-25 22:41:42,969 Stage-1 map = 0%,  reduce = 0%
Interrupting... Be patient, this might take some time.
Press Ctrl+C again to kill JVM
killing job with: job_1437868517038_0001
MapReduce Total cumulative CPU time: 55 seconds 290 msec
Ended Job = job_1437868517038_0001 with errors
Error during job, obtaining debugging information...
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-1: Map: 1  Reduce: 1   Cumulative CPU: 55.29 sec   HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 55 seconds 290 msec

hive 可以正常数据映射,也可以查询表信息,但是无法有统计操作,select count(*) from t_emp; 这个表中只有8条数据,hive非常慢,最后Error during job, obtaining debugging information...   请大家给指教一下 是哪里的问题

已有(1)人评论

跳转到指定楼层
zhuqitian 发表于 2016-8-16 12:58:31
这个问题我也遇到了,楼主现在解决了吗或者能避免也行
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条