About云-梭伦科技»专题 › 交流区 › 技术交流 › Cloudera系列 › 安装cdh分发parcel卡着不动

安装cdh分发parcel卡着不动

查看数: 39228 | 评论数: 9 | 收藏 0

关灯 | 提示：支持键盘翻页<-左右->

帖子模式

mjjian0

发布时间: 2017-4-30 11:08

正文摘要:

按照网上的文章安装cm，到分发parcel的时候，一直卡在那，求教啊。下面是服务日志 2017-04-30 10:32:11,414 INFO 1311775510@scm-web-4:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group ...

mjjian0 发表于 2017-5-27 17:25:18

醉半城发表于 2017-5-2 19:12
可以参考下我之前发布的一篇博文，我手机登录的，不方便直接给你链接，你可以点我图像进去看看

谢谢，不过在升级cdh的时候又遇见了这个错。http://www.aboutyun.com/thread-21840-1-1.html

mjjian0 发表于 2017-5-26 20:38:42

哎呀，终于找到原因了：
agent日志报这个错：
[26/May/2017 20:34:11 +0000] 1381 MainThread agent       ERROR Failed to handle Heartbeat Response: {u'firehoses': [], u'rm_enabled': False, u'client_configs': [], u'create_parcel_symlinks': True, u'server_managed_parcels': [u'http://master01:7180/cmf/parcel/download/CDH-5.8.4-1.cdh5.8.4.p0.5-el6.parcel'], u'extra_configs': None, u'host_collection_config_data': [{u'config_name': u'host_network_interface_collection_filter', u'config_value': u'^lo$'}, {u'config_name': u'host_disk_collection_filter', u'config_value': u'^$'}, {u'config_name': u'host_fs_collection_filter', u'config_value': u'^$'}, {u'config_name': u'host_log_tailing_config', u'config_value': u'{}\n'}, {u'config_name': u'host_dns_resolution_duration_thresholds', u'config_value': u'{"critical":"never","warning":"1000.0"}'}, {u'config_name': u'host_dns_resolution_enabled', u'config_value': u'true'}, {u'config_name': u'host_clock_offset_thresholds', u'config_value': u'{"critical":"10000.0","warning":"3000.0"}'}], u'apply_parcel_users_groups_permissions': True, u'flood_torrent_port': 7191, u'log_tailing_config': u'{}\n', u'active_parcels': {}, u'flood_rack_peers': [u'192.168.0.242:7191', u'192.168.0.241:7191', u'192.168.0.244:7191', u'192.168.0.243:7191', u'192.168.0.245:7191'], u'retain_parcels_in_cache': True, u'processes': [], u'server_manages_parcels': True, u'heartbeat_interval': 15, u'parcels_directory': u'/opt/cloudera/parcels', u'host_id': u'483a2ba6-41c0-4778-b4fa-f86459ad3d23', u'eventserver_host': None, u'enabled_metric_reporters': [u'ACCUMULO-ACCUMULO_MASTER', u'ACCUMULO_MASTER', u'ZOOKEEPER-SERVER', u'SERVER', u'SENTRY', u'SENTRY', u'SPARK-SPARK_HISTORY_SERVER', u'SPARK_HISTORY_SERVER', u'HUE-KT_RENEWER', u'KT_RENEWER', u'ISILON', u'ISILON', u'MAPREDUCE-JOBTRACKER', u'JOBTRACKER', u'SQOOP', u'SQOOP', u'HUE-BEESWAX_SERVER', u'BEESWAX_SERVER', u'KAFKA-KAFKA_BROKER', u'KAFKA_BROKER', u'HDFS-NFSGATEWAY', u'NFSGATEWAY', u'KEYTRUSTEE_SERVER-DB_ACTIVE', u'DB_ACTIVE', u'KAFKA-KAFKA_MIRROR_MAKER', u'KAFKA_MIRROR_MAKER', u'HDFS-JOURNALNODE', u'JOURNALNODE', u'HBASE-HBASETHRIFTSERVER', u'HBASETHRIFTSERVER', u'MGMT-EVENTSERVER', u'EVENTSERVER', u'HDFS-NAMENODE', u'NAMENODE', u'OOZIE', u'OOZIE', u'FLUME-AGENT', u'AGENT', u'HUE-HUE_LOAD_BALANCER', u'HUE_LOAD_BALANCER', u'KEYTRUSTEE_SERVER-DB_PASSIVE', u'DB_PASSIVE', u'ACCUMULO16-ACCUMULO16_TRACER', u'ACCUMULO16_TRACER', u'HBASE', u'HBASE', u'SENTRY-SENTRY_SERVER', u'SENTRY_SERVER', u'SQOOP-SQOOP_SERVER', u'SQOOP_SERVER', u'MGMT-REPORTSMANAGER', u'REPORTSMANAGER', u'ACCUMULO16-ACCUMULO16_TSERVER', u'ACCUMULO16_TSERVER', u'MGMT', u'MGMT', u'IMPALA-CATALOGSERVER', u'CATALOGSERVER', u'MAPREDUCE-FAILOVERCONTROLLER', u'FAILOVERCONTROLLER', u'IMPALA-LLAMA', u'LLAMA', u'IMPALA', u'IMPALA', u'HBASE-HBASERESTSERVER', u'HBASERESTSERVER', u'MGMT-ACTIVITYMONITOR', u'ACTIVITYMONITOR', u'HOST', u'MGMT-ALERTPUBLISHER', u'ALERTPUBLISHER', u'MGMT-SERVICEMONITOR', u'SERVICEMONITOR', u'MGMT-NAVIGATORMETASERVER', u'NAVIGATORMETASERVER', u'MAPREDUCE-TASKTRACKER', u'TASKTRACKER', u'SPARK', u'SPARK', u'KS_INDEXER', u'KS_INDEXER', u'MAPREDUCE', u'MAPREDUCE', u'YARN-JOBHISTORY', u'JOBHISTORY', u'SPARK-SPARK_MASTER', u'SPARK_MASTER', u'IMPALA-IMPALAD', u'IMPALAD', u'HDFS-DSSDDATANODE', u'DSSDDATANODE', u'KEYTRUSTEE_SERVER-KEYTRUSTEE_ACTIVE_SERVER', u'KEYTRUSTEE_ACTIVE_SERVER', u'SPARK-SPARK_WORKER', u'SPARK_WORKER', u'YARN', u'YARN', u'HIVE-WEBHCAT', u'WEBHCAT', u'YARN-NODEMANAGER', u'NODEMANAGER', u'HDFS-HTTPFS', u'HTTPFS', u'ACCUMULO-ACCUMULO_LOGGER', u'ACCUMULO_LOGGER', u'HDFS-SECONDARYNAMENODE', u'SECONDARYNAMENODE', u'SOLR-SOLR_SERVER', u'SOLR_SERVER', u'KMS-KMS', u'KMS', u'ACCUMULO-ACCUMULO_MONITOR', u'ACCUMULO_MONITOR', u'ACCUMULO-ACCUMULO_TSERVER', u'ACCUMULO_TSERVER', u'ACCUMULO16-ACCUMULO16_MONITOR', u'ACCUMULO16_MONITOR', u'SPARK_ON_YARN', u'SPARK_ON_YARN', u'HBASE-REGIONSERVER', u'REGIONSERVER', u'HUE-HUE_SERVER', u'HUE_SERVER', u'HIVE-HIVEMETASTORE', u'HIVEMETASTORE', u'ZOOKEEPER', u'ZOOKEEPER', u'IMPALA-STATESTORE', u'STATESTORE', u'HBASE-MASTER', u'MASTER', u'ACCUMULO16', u'ACCUMULO16', u'KAFKA', u'KAFKA', u'SQOOP_CLIENT', u'SQOOP_CLIENT', u'FLUME', u'FLUME', u'KS_INDEXER-HBASE_INDEXER', u'HBASE_INDEXER', u'KEYTRUSTEE-KMS_KEYTRUSTEE', u'KMS_KEYTRUSTEE', u'ACCUMULO-ACCUMULO_GC', u'ACCUMULO_GC', u'MGMT-NAVIGATOR', u'NAVIGATOR', u'KMS', u'KMS', u'KEYTRUSTEE_SERVER', u'KEYTRUSTEE_SERVER', u'HDFS-FAILOVERCONTROLLER', u'FAILOVERCONTROLLER', u'KEYTRUSTEE_SERVER-KEYTRUSTEE_PASSIVE_SERVER', u'KEYTRUSTEE_PASSIVE_SERVER', u'HUE', u'HUE', u'MGMT-HOSTMONITOR', u'HOSTMONITOR', u'ACCUMULO-ACCUMULO_TRACER', u'ACCUMULO_TRACER', u'SOLR', u'SOLR', u'ACCUMULO', u'ACCUMULO', u'HIVE', u'HIVE', u'HDFS', u'HDFS', u'ACCUMULO16-ACCUMULO16_GC', u'ACCUMULO16_GC', u'KEYTRUSTEE', u'KEYTRUSTEE', u'OOZIE-OOZIE_SERVER', u'OOZIE_SERVER', u'YARN-RESOURCEMANAGER', u'RESOURCEMANAGER', u'ACCUMULO16-ACCUMULO16_MASTER', u'ACCUMULO16_MASTER', u'SPARK_ON_YARN-SPARK_YARN_HISTORY_SERVER', u'SPARK_YARN_HISTORY_SERVER', u'HIVE-HIVESERVER2', u'HIVESERVER2', u'HDFS-DATANODE', u'DATANODE'], u'flood_seed_timeout': 95, u'eventserver_port': None}
Traceback (most recent call last):
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.8.4-py2.6.egg/cmf/agent.py", line 1377, in handle_heartbeat_response
self._handle_heartbeat_response(response)
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.8.4-py2.6.egg/cmf/agent.py", line 1399, in _handle_heartbeat_response
response["flood_torrent_port"])
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.8.4-py2.6.egg/cmf/agent.py", line 1816, in handle_heartbeat_flood
flood_dir)
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.8.4-py2.6.egg/cmf/downloader.py", line 179, in __init__
self.client = TorrentRPCClient(server)
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.8.4-py2.6.egg/flood/util/rpc.py", line 118, in __init__
server = resolveHostPort(server, self.DEFAULT_RPC_PORT)
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.8.4-py2.6.egg/flood/util/rpc.py", line 33, in resolveHostPort
return HostPort(socket.gethostbyname(w[0]), port)
gaierror: [Errno -2] Name or service not known

网上搜了一下说是

机器的hosts文件内容不一致！有的配置没有localhost！

把localhost这个域名添加回去：

127.0.0.1 localhost
然后立刻就可以分发了，记得当初也搜了这个错误，但是怎么就没有看到呢，看来还是因为当初比较急吧。

ledasion 发表于 2017-5-8 16:22:19