hive执行的时候会打印日志,请问Cumulative CPU 256.11 sec,打印的这个是什么意思呢?我百度了一下,没有什么资料,大神们,求解答一下,这个是什么单位?用来计量什么的?是怎么算出来的?
INFO : Query ID = hive_20190109204444_13b4c9ac-0c24-4d22-afe5-2a3e60a795ed
INFO : Total jobs = 1
INFO : Launching Job 1 out of 1
INFO : Starting task [Stage-1:MAPRED] in serial mode
INFO : Number of reduce tasks not specified. Estimated from input data size: 40
INFO : In order to change the average load for a reducer (in bytes):
INFO : set hive.exec.reducers.bytes.per.reducer=<number>
INFO : In order to limit the maximum number of reducers:
INFO : set hive.exec.reducers.max=<number>
INFO : In order to set a constant number of reducers:
INFO : set mapreduce.job.reduces=<number>
INFO : Cannot run job locally: Input Size (= 2662102022) is larger than hive.exec.mode.local.auto.inputbytes.max (= 134217728)
INFO : number of splits:8
INFO : Submitting tokens for job: job_1534303666179_438922
INFO : The url to track the job: http://ycf-big0.ycf.com:8088/pro ... 34303666179_438922/
INFO : Starting Job = job_1534303666179_438922, Tracking URL = http://ycf-big0.ycf.com:8088/pro ... 34303666179_438922/
INFO : Kill Command = /opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/bin/hadoop job -kill job_1534303666179_438922
INFO : Hadoop job information for Stage-1: number of mappers: 8; number of reducers: 40
INFO : 2019-01-09 20:45:37,362 Stage-1 map = 0%, reduce = 0%
INFO : 2019-01-09 20:45:54,763 Stage-1 map = 13%, reduce = 0%, Cumulative CPU 6.35 sec
INFO : 2019-01-09 20:45:56,810 Stage-1 map = 25%, reduce = 0%, Cumulative CPU 12.94 sec
INFO : 2019-01-09 20:46:02,951 Stage-1 map = 30%, reduce = 0%, Cumulative CPU 56.62 sec
INFO : 2019-01-09 20:46:06,022 Stage-1 map = 34%, reduce = 0%, Cumulative CPU 62.49 sec
INFO : 2019-01-09 20:46:10,115 Stage-1 map = 42%, reduce = 0%, Cumulative CPU 66.11 sec
INFO : 2019-01-09 20:46:14,211 Stage-1 map = 55%, reduce = 0%, Cumulative CPU 73.04 sec
INFO : 2019-01-09 20:46:30,619 Stage-1 map = 63%, reduce = 0%, Cumulative CPU 80.26 sec
INFO : 2019-01-09 20:46:37,789 Stage-1 map = 71%, reduce = 0%, Cumulative CPU 83.53 sec
INFO : 2019-01-09 20:46:49,034 Stage-1 map = 75%, reduce = 0%, Cumulative CPU 87.42 sec
INFO : 2019-01-09 20:47:04,408 Stage-1 map = 83%, reduce = 0%, Cumulative CPU 90.86 sec
INFO : 2019-01-09 20:47:06,470 Stage-1 map = 92%, reduce = 0%, Cumulative CPU 93.32 sec
INFO : 2019-01-09 20:47:18,729 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 96.2 sec
INFO : 2019-01-09 20:47:19,753 Stage-1 map = 100%, reduce = 5%, Cumulative CPU 103.56 sec
INFO : 2019-01-09 20:47:20,772 Stage-1 map = 100%, reduce = 15%, Cumulative CPU 119.87 sec
INFO : 2019-01-09 20:47:21,804 Stage-1 map = 100%, reduce = 23%, Cumulative CPU 133.2 sec
INFO : 2019-01-09 20:47:23,868 Stage-1 map = 100%, reduce = 28%, Cumulative CPU 141.33 sec
INFO : 2019-01-09 20:47:24,896 Stage-1 map = 100%, reduce = 35%, Cumulative CPU 153.4 sec
INFO : 2019-01-09 20:47:26,941 Stage-1 map = 100%, reduce = 43%, Cumulative CPU 163.77 sec
INFO : 2019-01-09 20:47:27,964 Stage-1 map = 100%, reduce = 50%, Cumulative CPU 176.22 sec
INFO : 2019-01-09 20:47:28,985 Stage-1 map = 100%, reduce = 55%, Cumulative CPU 183.6 sec
INFO : 2019-01-09 20:47:30,007 Stage-1 map = 100%, reduce = 58%, Cumulative CPU 188.34 sec
INFO : 2019-01-09 20:47:31,031 Stage-1 map = 100%, reduce = 65%, Cumulative CPU 200.89 sec
INFO : 2019-01-09 20:47:33,074 Stage-1 map = 100%, reduce = 73%, Cumulative CPU 212.01 sec
INFO : 2019-01-09 20:47:35,118 Stage-1 map = 100%, reduce = 83%, Cumulative CPU 226.6 sec
INFO : 2019-01-09 20:47:36,141 Stage-1 map = 100%, reduce = 88%, Cumulative CPU 234.8 sec
INFO : 2019-01-09 20:47:37,162 Stage-1 map = 100%, reduce = 93%, Cumulative CPU 244.14 sec
INFO : 2019-01-09 20:47:38,197 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 256.11 sec
INFO : MapReduce Total cumulative CPU time: 4 minutes 16 seconds 110 msec
INFO : Ended Job = job_1534303666179_438922
INFO : MapReduce Jobs Launched:
INFO : Stage-Stage-1: Map: 8 Reduce: 40 Cumulative CPU: 256.11 sec HDFS Read: 55713306 HDFS Write: 916 SUCCESS
INFO : Total MapReduce CPU Time Spent: 4 minutes 16 seconds 110 msec
INFO : Completed executing command(queryId=hive_20190109204444_13b4c9ac-0c24-4d22-afe5-2a3e60a795ed); Time taken: 164.408 seconds
INFO : OK
|
|