我在导入的时候指定了分区的值。在最后一步load数据的时候报错如下:
这前面都是正常的。
15/09/29 14:01:37 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 40.2994 seconds (0 bytes/sec)
15/09/29 14:01:37 INFO mapreduce.ImportJobBase: Retrieved 0 records.
15/09/29 14:01:37 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `dwell_time` AS t LIMIT 1
15/09/29 14:01:37 INFO hive.HiveImport: Loading uploaded data into Hive
15/09/29 14:01:48 INFO hive.HiveImport: 15/09/29 14:01:48 WARN conf.HiveConf: HiveConf of name hive.metastore.local does not exist
15/09/29 14:01:48 INFO hive.HiveImport:
15/09/29 14:01:48 INFO hive.HiveImport: Logging initialized using configuration in file:/usr/local/hadoop/hive-1.2.1/conf/hive-log4j.properties
15/09/29 14:01:49 INFO hive.HiveImport: SLF4J: Class path contains multiple SLF4J bindings.
15/09/29 14:01:49 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/local/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
15/09/29 14:01:49 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/local/hadoop/hbase-1.1.1/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
15/09/29 14:01:49 INFO hive.HiveImport: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
15/09/29 14:01:49 INFO hive.HiveImport: SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
15/09/29 14:01:53 INFO hive.HiveImport: OK
15/09/29 14:01:53 INFO hive.HiveImport: Time taken: 2.137 seconds
15/09/29 14:01:53 INFO hive.HiveImport: FAILED: SemanticException [Error 10028]: Line 2:17 Path is not legal ''hdfs://yilinjiayuan:9000/user/root/dwell_time'': Move from: hdfs://yilinjiayuan:9000/user/root/dwell_time to: hdfs://192.168.0.26:9000/user/hive/warehouse/dwell_time/datetime=2015-07-02 is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.
15/09/29 14:01:53 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 44
at org.apache.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:389)
at org.apache.sqoop.hive.HiveImport.executeScript(HiveImport.java:339)
at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:240)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:514)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
下面三个错误:
WARN conf.HiveConf: HiveConf of name hive.metastore.local does not exist
配置文件有问题
Move from: hdfs://yilinjiayuan:9000/user/root/dwell_time to: hdfs://192.168.0.26:9000/user/hive/warehouse/dwell_time/datetime=2015-07-02 is not valid.
移动失效了。先试试这两个路径是否是有效的,可识别的
Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.