Sqoop1.99.5从mysql导入到hdfs出错！Job Failed with status:3
环境是hadoop2.6，集群中有四个节点，运行正常。Sqoop2job配置：
Job with id 1 and name Sqoopy (Enabled: true, Created by root at 5/7/15 5:26 PM, Updated by root at 5/7/15 5:26 PM)
Using link id 2 and Connector id 1
From database configuration
Schema name: rural_biz
Table name: RefundOrder
Table SQL statement:
Table column names:
Partition column name:
Null value allowed for the partition column:
Boundary query:
Throttling resources
Extractors: 2
Loaders: 2
ToJob configuration
Override null value:
Null value:
Output format: TEXT_FILE
Compression format: NONE
Custom compression format:
Output directory: /
Sqoop2 job运行状态：
2015-05-08 14:29:12 CST: RUNNING- 84.47 %
2015-05-08 14:29:22 CST: RUNNING- 84.47 %
2015-05-08 14:29:32 CST: RUNNING- 84.47 %
2015-05-08 14:29:42 CST: RUNNING- 84.47 %
2015-05-08 14:29:52 CST: RUNNING- 84.47 %
2015-05-08 14:30:02 CST: RUNNING- 84.47 %
2015-05-08 14:30:13 CST: RUNNING- 84.47 %
2015-05-08 14:30:23 CST: RUNNING- 84.47 %
2015-05-08 14:30:33 CST: RUNNING- 84.47 %
2015-05-08 14:30:43 CST: RUNNING- 84.47 %
2015-05-08 14:30:53 CST: RUNNING- 84.47 %
2015-05-08 14:31:04 CST: RUNNING- 84.47 %
2015-05-08 14:31:14 CST: RUNNING- 84.47 %
2015-05-08 14:31:24 CST: RUNNING- 84.47 %
2015-05-08 14:31:34 CST: RUNNING- 84.47 %
2015-05-08 14:31:44 CST: RUNNING- 84.47 %
2015-05-08 14:31:54 CST: RUNNING- 84.47 %
2015-05-08 14:32:04 CST: RUNNING- 84.47 %
2015-05-08 14:32:14 CST: RUNNING- 100.00 %
2015-05-08 14:32:47 CST: FAILED
Exception: Job Failed with status:3
查看Reduce Tack发现reduce一直卡在哪儿但又不会报错。yarn的运行日志没有任何问题。
sqoop.log一直显示
privilege: Privilege (Privilege resource: Resource (Resource name: 1, Resource type: JOB ), Privilege action: STATUS, Privilege with_grant_option: false )
2015-05-08 14:49:16,279 INFOdefault user=root ip=127.0.0.1 op=status obj=job objId=1
2015-05-08 14:49:16,292 DEBUG repository.JdbcRepositoryTransaction Tx count-begin: 1, rollback: false
2015-05-08 14:49:16,677 DEBUG repository.JdbcRepositoryTransaction Tx count-commit: 1, rollback: false
2015-05-08 14:49:16,677 DEBUG repository.JdbcRepositoryTransaction Tx count-close: 0, rollback: false
2015-05-08 14:49:16,677 INFOrepository.JdbcRepositoryTransaction Attempting transaction commit
2015-05-08 14:51:08,954 DEBUG driver.JobManager Updating running submissions
2015-05-08 14:51:08,993 DEBUG repository.JdbcRepositoryTransaction Tx count-begin: 1, rollback: false
2015-05-08 14:51:08,994 DEBUG repository.JdbcRepositoryTransaction Tx count-commit: 1, rollback: false
2015-05-08 14:51:08,994 DEBUG repository.JdbcRepositoryTransaction Tx count-close: 0, rollback: false
2015-05-08 14:51:08,994 INFOrepository.JdbcRepositoryTransaction Attempting transaction commit
2015-05-08 14:56:08,995 DEBUG driver.JobManager Updating running submissions
2015-05-08 14:56:09,051 DEBUG repository.JdbcRepositoryTransaction Tx count-begin: 1, rollback: false
2015-05-08 14:56:09,052 DEBUG repository.JdbcRepositoryTransaction Tx count-commit: 1, rollback: false
2015-05-08 14:56:09,061 DEBUG repository.JdbcRepositoryTransaction Tx count-close: 0, rollback: false
2015-05-08 14:56:09,061 INFOrepository.JdbcRepositoryTransaction Attempting transaction commit
2015-05-08 15:01:09,102 DEBUG driver.JobManager Updating running submissions
2015-05-08 15:01:09,654 DEBUG repository.JdbcRepositoryTransaction Tx count-begin: 1, rollback: false
2015-05-08 15:01:09,655 DEBUG repository.JdbcRepositoryTransaction Tx count-commit: 1, rollback: false
2015-05-08 15:01:09,655 DEBUG repository.JdbcRepositoryTransaction Tx count-close: 0, rollback: false
2015-05-08 15:01:09,656 INFOrepository.JdbcRepositoryTransaction Attempting transaction commit
在从节点的job日志中有失败信息显示
2015-05-08 13:59:29,274 INFO org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP
2015-05-08 13:59:29,274 INFO org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1430983821763_0004_r_000001_0: AttemptID:attempt_1430983821763_0004_r_000001_0 Timed out after 600 secs
2015-05-08 13:59:29,275 INFO org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000001_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP
015-05-08 13:59:29,304 INFO org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000000_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2015-05-08 13:59:29,305 INFO org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000001_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
跪求来人帮帮忙阿！
是不是因为数据倾斜的原因，导致变慢了。看楼主有对空值的处理
日志真看不出来，sqoop语句应该也没有问题，因为正在执行。
所以最有可能的是执行中遇到了不能处理的数据。
按理来说应该有日志，楼主可以细心找找。
贴出来的时间，有些出入。
建议清理日志，重新跑下，这样容易定位错误
页:
[1]