hive创建hbase外部表的问题

hadoop2.7.2，hive2.0.0，hbase1.1.5，hive创建hbase外部表，在cli只执行没问题，但启动hiveserver2，在beeline里执行异常：[mw_shl_code=java,true]ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Thu May 19 14:24:53 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68176: row 'testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=hadoop01,16020,1463484598367, seqNum=0

      at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:271)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:207)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
      at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:326)
      at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:301)
      at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
      at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:161)
      at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:797)
      at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602)
      at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)
      at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:403)
      at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:413)
      at org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:193)
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:717)
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:710)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:497)
      at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156)
      at com.sun.proxy.$Proxy24.createTable(Unknown Source)
      at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:777)
      at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4032)
      at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:322)
      at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:158)
      at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:101)
      at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1840)
      at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1584)
      at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1361)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1184)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1177)
      at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:175)
      at org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:73)
      at org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:228)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:422)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
      at org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:241)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68176: row 'testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=hadoop01,16020,1463484598367, seqNum=0
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
      at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
      ... 3 more
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Call to hadoop01/xx.xx.xx.xx:16020 failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to hadoop01/xx.xx.xx.xx:16020 is closing. Call id=39, waitTime=3
      at org.apache.hadoop.hbase.ipc.AbstractRpcClient.wrapException(AbstractRpcClient.java:280)
      at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1239)
      at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:222)
      at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:323)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32831)
      at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:373)
      at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:200)
      at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:360)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:334)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136)
      ... 4 more
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to hadoop01/xx.xx.xx.xx:16020 is closing. Call id=39, waitTime=3
      at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.cleanupCalls(RpcClientImpl.java:1057)
      at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.close(RpcClientImpl.java:856)
      at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:575)
)
INFO  : Completed executing command(queryId=hadoop_20160519142404_a7342c93-cfa2-470e-abec-558642752a0e); Time taken: 48.163 seconds
Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Thu May 19 14:24:53 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68176: row 'testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=hadoop01,16020,1463484598367, seqNum=0

      at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:271)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:207)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
      at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:326)
      at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:301)
      at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
      at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:161)
      at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:797)
      at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602)
      at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)
      at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:403)
      at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:413)
      at org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:193)
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:717)
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:710)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:497)
      at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156)
      at com.sun.proxy.$Proxy24.createTable(Unknown Source)
      at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:777)
      at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4032)
      at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:322)
      at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:158)
      at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:101)
      at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1840)
      at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1584)
      at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1361)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1184)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1177)
      at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:175)
      at org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:73)
      at org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:228)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:422)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
      at org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:241)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68176: row 'testtable,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=hadoop01,16020,1463484598367, seqNum=0
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
      at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
      ... 3 more
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Call to hadoop01/xx.xx.xx.xx:16020 failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to hadoop01/xx.xx.xx.xx:16020 is closing. Call id=39, waitTime=3
      at org.apache.hadoop.hbase.ipc.AbstractRpcClient.wrapException(AbstractRpcClient.java:280)
      at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1239)
      at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:222)
      at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:323)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32831)
      at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:373)
      at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:200)
      at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:360)
      at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:334)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136)
      ... 4 more
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to hadoop01/xx.xx.xx.xx:16020 is closing. Call id=39, waitTime=3
      at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.cleanupCalls(RpcClientImpl.java:1057)
      at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.close(RpcClientImpl.java:856)
      at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:575)
) (state=08S01,code=1)[/mw_shl_code]

einhep · 发表于 2016-5-19 20:14:27

贴出hosts看下hadoop01的

Fortitude · 发表于 2016-5-20 09:56:40

einhep 发表于 2016-5-19 20:14
贴出hosts看下hadoop01的

hosts文件内容如下，其中xx.xx.xx是我做了替换处理
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
xx.xx.xx.100 hadoop00
xx.xx.xx.101 hadoop01
xx.xx.xx.102 hadoop02
xx.xx.xx.103 hadoop03
xx.xx.xx.104 hadoop04
xx.xx.xx.105 hadoop05
xx.xx.xx.106 hadoop06
xx.xx.xx.107 hadoop07
xx.xx.xx.108 hadoop08

hahaxixi · 发表于 2016-5-20 10:30:15

metastore起来没？

Fortitude · 发表于 2016-5-20 10:40:11

hahaxixi 发表于 2016-5-20 10:30
metastore起来没？

起来了，cli下什么命令都没问题，hiveserver2下就执行和hbase交互的语句有问题

einhep · 发表于 2016-5-21 19:06:54

Fortitude 发表于 2016-5-20 10:40
起来了，cli下什么命令都没问题，hiveserver2下就执行和hbase交互的语句有问题

先把ip6禁用了
#::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

Fortitude · 发表于 2016-5-26 13:47:54

einhep 发表于 2016-5-21 19:06
先把ip6禁用了
#::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

禁用了还是报同样的错

Fortitude · 发表于 2016-7-4 14:52:27

哪位大神帮帮忙了

einhep · 发表于 2016-7-4 16:32:51

Fortitude 发表于 2016-7-4 14:52
哪位大神帮帮忙了

hive创建hbase外部表，在cli只执行没问题【这里执行了什么】
但启动hiveserver2，在beeline里执行异常
【原先没有启动吗？】

easthome001 · 发表于 2016-7-4 16:41:26

这里只是链接不上，具体什么原因，只能猜测。
hiveserver2应该有日志。楼主可以看下。

图文精华

hive创建hbase外部表的问题

已有(13)人评论

最佳新人

活跃会员

热心会员

推广达人

推荐 /2