pig2 发表于 2015-7-11 15:14:47

about云hadoop源码分析之如何获取任务名字及进度【hadoop2.7.1】


问题导读
1.你认为如何获取hadoop mapreduce任务名字?
2.你认为如何获取hadoop mapreduce?


static/image/hrline/4.gif


有很多新手经常问,该如何获取任务的进度,有没有这方面的API。
答案是有的。具体在哪各类或则接口中?
我们找到包:
package org.apache.hadoop.mapreduce;
中TaskAttemptContext接口


/**
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements.See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership.The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License.You may obtain a copy of the License at
*
*   http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/

package org.apache.hadoop.mapreduce;

import org.apache.hadoop.classification.InterfaceAudience;
import org.apache.hadoop.classification.InterfaceStability;
import org.apache.hadoop.util.Progressable;

/**
* The context for task attempts.
*/
@InterfaceAudience.Public
@InterfaceStability.Evolving
public interface TaskAttemptContext extends JobContext, Progressable {

/**
   * Get the unique name for this task attempt.
   */
public TaskAttemptID getTaskAttemptID();

/**
   * Set the current status of the task to the given string.
   */
public void setStatus(String msg);

/**
   * Get the last set status message.
   * @return the current status message
   */
public String getStatus();

/**
   * The current progress of the task attempt.
   * @return a number between 0.0 and 1.0 (inclusive) indicating the attempt's
   * progress.
   */
public abstract float getProgress();

/**
   * Get the {@link Counter} for the given <code>counterName</code>.
   * @param counterName counter name
   * @return the <code>Counter</code> for the given <code>counterName</code>
   */
public Counter getCounter(Enum<?> counterName);

/**
   * Get the {@link Counter} for the given <code>groupName</code> and
   * <code>counterName</code>.
   * @param counterName counter name
   * @return the <code>Counter</code> for the given <code>groupName</code> and
   *         <code>counterName</code>
   */
public Counter getCounter(String groupName, String counterName);

}


其中
public TaskAttemptID getTaskAttemptID();

为获取任何的名字

public abstract float getProgress();

为任务的当前进度












tang 发表于 2015-7-13 07:58:40

{:soso_e179:}
页: [1]
查看完整版本: about云hadoop源码分析之如何获取任务名字及进度【hadoop2.7.1】