win7系统已经成功安装cygwin
并且也成功安装ssh,实现无密码SSH方式登录
hadoop使用ps aux 可以查看5个JAVA进程,应该也是安装成功的
但是运行wordcount提示,无法加载本地库,但是官方说hadoop本地库不支持cygwin,这下就废囖,谁给帮帮忙?
$ hadoop jar hadoop-examples-1.0.4.jar wordcount input/1 output/1
13/03/29 17:01:24 INFO input.FileInputFormat: Total input paths to process : 1
13/03/29 17:01:24 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/03/29 17:01:24 WARN snappy.LoadSnappy: Snappy native library not loaded
13/03/29 17:01:24 INFO mapred.JobClient: Running job: job_201303291655_0001
13/03/29 17:01:25 INFO mapred.JobClient: map 0% reduce 0%
13/03/29 17:01:31 INFO mapred.JobClient: Task Id : attempt_201303291655_0001_m_000002_0, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of -1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
13/03/29 17:01:31 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000002_0&filter=stdout
13/03/29 17:01:31 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000002_0&filter=stderr
13/03/29 17:01:37 INFO mapred.JobClient: Task Id : attempt_201303291655_0001_m_000002_1, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of -1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
13/03/29 17:01:37 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000002_1&filter=stdout
13/03/29 17:01:37 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000002_1&filter=stderr
13/03/29 17:01:43 INFO mapred.JobClient: Task Id : attempt_201303291655_0001_m_000002_2, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of -1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
13/03/29 17:01:43 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000002_2&filter=stdout
13/03/29 17:01:44 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000002_2&filter=stderr
13/03/29 17:01:56 INFO mapred.JobClient: Task Id : attempt_201303291655_0001_m_000001_0, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of -1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
13/03/29 17:01:56 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000001_0&filter=stdout
13/03/29 17:01:56 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000001_0&filter=stderr
13/03/29 17:02:02 INFO mapred.JobClient: Task Id : attempt_201303291655_0001_m_000001_1, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of -1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
13/03/29 17:02:02 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000001_1&filter=stdout
13/03/29 17:02:02 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000001_1&filter=stderr
13/03/29 17:02:08 INFO mapred.JobClient: Task Id : attempt_201303291655_0001_m_000001_2, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of -1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
13/03/29 17:02:08 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000001_2&filter=stdout
13/03/29 17:02:08 WARN mapred.JobClient: Error reading task outputhttp://CTU2-5MBD43X.vancloa.cn:50060/tasklog?plaintext=true&attemptid=attempt_201303291655_0001_m_000001_2&filter=stderr
13/03/29 17:02:13 INFO mapred.JobClient: Job complete: job_201303291655_0001
13/03/29 17:02:13 INFO mapred.JobClient: Counters: 4
13/03/29 17:02:13 INFO mapred.JobClient: Job Counters
13/03/29 17:02:13 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=24436
13/03/29 17:02:13 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0
13/03/29 17:02:13 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
13/03/29 17:02:13 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
hadoop
|
|