reduce一直99%

select row_number() over() from test_06;
剩余一个reduce一直在跑

Counter Group	Counters
File System Counters	Name Map Reduce Total FILE: Number of bytes read 38909947431 9814823592 48724771023 FILE: Number of bytes written 59911845463 28777449870 88689295333 FILE: Number of read operations 0 0 0 FILE: Number of large read operations 0 0 0 FILE: Number of write operations 0 0 0 HDFS: Number of bytes read 9889194901 0 9889194901 HDFS: Number of bytes written 0 0 0 HDFS: Number of read operations 84 18 102 HDFS: Number of large read operations 0 0 0 HDFS: Number of write operations 0 18 18
Job Counters	Name Map Reduce Total Killed map tasks 0 0 9 Launched map tasks 0 0 19 Launched reduce tasks 0 0 11 Other local map tasks 0 0 1 Data-local map tasks 0 0 10 Rack-local map tasks 0 0 8 Total time spent by all maps in occupied slots (ms) 0 0 6765485 Total time spent by all reduces in occupied slots (ms) 0 0 8364604 Total time spent by all map tasks (ms) 0 0 6765485 Total time spent by all reduce tasks (ms) 0 0 4182302 Total vcore-seconds taken by all map tasks 0 0 6765485 Total vcore-seconds taken by all reduce tasks 0 0 4182302 Total megabyte-seconds taken by all map tasks 0 0 6927856640 Total megabyte-seconds taken by all reduce tasks 0 0 8565354496
Map-Reduce Framework	Name Map Reduce Total Map input records 1000000000 0 1000000000 Map output records 1000000000 0 1000000000 Map output bytes 19000000000 0 19000000000 Map output materialized bytes 21000000600 0 21000000600 Input split bytes 6994 0 6994 Combine input records 0 0 0 Combine output records 0 0 0 Reduce input groups 0 1 1 Reduce shuffle bytes 0 21000000600 21000000600 Reduce input records 0 467425001 467425001 Reduce output records 0 0 0 Spilled Records 2852848013 463129092 3315977105 Shuffled Maps 0 100 100 Failed Shuffles 0 0 0 Merged Map outputs 0 100 100 GC time elapsed (ms) 8036 5003 13039 CPU time spent (ms) 4512840 972910 5485750 Physical memory (bytes) snapshot 6878195712 4790050816 11668246528 Virtual memory (bytes) snapshot 24574963712 24982425600 49557389312 Total committed heap usage (bytes) 10718019584 10996416512 21714436096
Shuffle Errors	Name Map Reduce Total BAD_ID 0 0 0 CONNECTION 0 0 0 IO_ERROR 0 0 0 WRONG_LENGTH 0 0 0 WRONG_MAP 0 0 0 WRONG_REDUCE 0 0 0
org.​apache.​hadoop.​hive.​ql.​exec.​MapOperator​$Counter	Name Map Reduce Total DESERIALIZE_ERRORS 0 0 0
File Input Format Counters	Name Map Reduce Total Bytes Read 0 0 0
File Output Format Counters	Name Map Reduce Total Bytes Written 0 0 0

几个节点，数据是否分布均匀

jixianqiuxue 发表于 2015-9-16 14:47
几个节点，数据是否分布均匀

分布均匀的