运行代码如下:
[mw_shl_code=shell,true]chen@chen-K84HR ~/hadoop-2.7.1 $ hadoop jar ~/hadoop-2.7.1/share/hadoop/tools/lib/hadoop-streaming-2.7.1.jar -jobconf mapred.reduce.tasks=4 -mapper /home/chen/mapreduce/word_count/mapper.py -reducer /home/chen/mapreduce/word_count/reduce.py -input book/* -output book-output[/mw_shl_code]
然后到到 INFO mapreduce.Job: Running job: job_1437734035333_00就不会动了!
整个运行如下:
[mw_shl_code=shell,true]15/07/24 19:20:42 WARN streaming.StreamJob: -jobconf option is deprecated, please use -D instead.
OpenJDK Server VM warning: You have loaded library /home/chen/hadoop-2.7.1/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
15/07/24 19:20:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
packageJobJar: [/tmp/hadoop-unjar4200297893364560010/] [] /tmp/streamjob3830355201014675690.jar tmpDir=null
15/07/24 19:20:43 INFO client.RMProxy: Connecting to ResourceManager at /127.0.0.1:8032
15/07/24 19:20:43 INFO client.RMProxy: Connecting to ResourceManager at /127.0.0.1:8032
15/07/24 19:20:44 INFO mapred.FileInputFormat: Total input paths to process : 1
15/07/24 19:20:44 INFO mapreduce.JobSubmitter: number of splits:2
15/07/24 19:20:44 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
15/07/24 19:20:44 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1437734035333_0003
15/07/24 19:20:45 INFO impl.YarnClientImpl: Submitted application application_1437734035333_0003
15/07/24 19:20:45 INFO mapreduce.Job: The url to track the job: http://chen-K84HR:8088/proxy/application_1437734035333_0003/
15/07/24 19:20:45 INFO mapreduce.Job: Running job: job_1437734035333_00[/mw_shl_code]
求助~求助~
|
|