学东 发表于 2019-4-9 10:19 楼主说的对。 对于cloudera的安装,只要一步步按照步骤,一般不会出问题的。 如果是安装中出现异常,其实还是比较难搞的。 最好最粗暴的办法就是卸载干净重新安装。 如果想详细知道错误等,那就是十分耗时间了,而且可能还解决不掉。 |
这个问题上周搞定了,同事卸载重装的、然后chmod 777 -R /opt 这一类问题就没有了。 重装卸载一定要卸干净。 |
学东 发表于 2019-4-3 22:07 需要找到error 可以通过下面命令过滤日志中的错误。 [mw_shl_code=bash,true]cat 日志|grep ERROR[/mw_shl_code] |
yaojiank 发表于 2019-4-3 17:56 agent : [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO First time to activate the process [70-cloudera-mgmt-SERVICEMONITOR]. [03/Apr/2019 22:02:03 +0000] 30031 MainThread agent INFO Created /opt/cm-5.14.2/run/cloudera-scm-agent/process/70-cloudera-mgmt-SERVICEMONITOR [03/Apr/2019 22:02:03 +0000] 30031 MainThread agent INFO Chowning /opt/cm-5.14.2/run/cloudera-scm-agent/process/70-cloudera-mgmt-SERVICEMONITOR to cloudera-scm (987) cloudera-scm (982) [03/Apr/2019 22:02:03 +0000] 30031 MainThread agent INFO Chmod'ing /opt/cm-5.14.2/run/cloudera-scm-agent/process/70-cloudera-mgmt-SERVICEMONITOR to 0751 [03/Apr/2019 22:02:03 +0000] 30031 MainThread agent INFO Created /opt/cm-5.14.2/run/cloudera-scm-agent/process/70-cloudera-mgmt-SERVICEMONITOR/logs [03/Apr/2019 22:02:03 +0000] 30031 MainThread agent INFO Chowning /opt/cm-5.14.2/run/cloudera-scm-agent/process/70-cloudera-mgmt-SERVICEMONITOR/logs to cloudera-scm (987) cloudera-scm (982) [03/Apr/2019 22:02:03 +0000] 30031 MainThread agent INFO Chmod'ing /opt/cm-5.14.2/run/cloudera-scm-agent/process/70-cloudera-mgmt-SERVICEMONITOR/logs to 0751 [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO [70-cloudera-mgmt-SERVICEMONITOR] Refreshing process files: None [03/Apr/2019 22:02:03 +0000] 30031 MainThread parcel INFO prepare_environment begin: {u'CDH': u'5.14.2-1.cdh5.14.2.p0.3'}, [], [] [03/Apr/2019 22:02:03 +0000] 30031 MainThread parcel INFO Service does not request any parcels [03/Apr/2019 22:02:03 +0000] 30031 MainThread __init__ INFO Extracted 12 files and 0 dirs to /opt/cm-5.14.2/run/cloudera-scm-agent/process/70-cloudera-mgmt-SERVICEMONITOR. [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO [70-cloudera-mgmt-SERVICEMONITOR] Evaluating resource: {u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': True, u'rlimits': None, u'install': None, u'file': None, u'memory': None, u'directory': {u'path': u'/var/log/cloudera-scm-firehose/stacks', u'bytes_free_warning_threshhold_bytes': 0, u'group': u'cloudera-scm', u'user': u'cloudera-scm', u'mode': 493}, u'cpu': None, u'contents': None} [03/Apr/2019 22:02:03 +0000] 30031 MainThread os_ops WARNING Expected mode 0755 for /var/log/cloudera-scm-firehose/stacks but was 0775 [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO reading limits: {u'limit_memlock': None, u'limit_fds': None} [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO [70-cloudera-mgmt-SERVICEMONITOR] Launching process. one-off False, command mgmt/mgmt.sh, args [u'firehose', u'--pipeline-type', u'SERVICE_MONITORING'] [03/Apr/2019 22:02:03 +0000] 30031 MainThread agent INFO Triggering supervisord update. [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO Begin audit plugin refresh [03/Apr/2019 22:02:03 +0000] 30031 MainThread navigator_plugin INFO Scheduling a refresh for Audit Plugin for cloudera-mgmt-SERVICEMONITOR with pipelines [] [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO Begin metadata plugin refresh [03/Apr/2019 22:02:03 +0000] 30031 MainThread navigator_plugin INFO Scheduling a refresh for Metadata Plugin for cloudera-mgmt-SERVICEMONITOR with pipelines [] [03/Apr/2019 22:02:03 +0000] 30031 MainThread __init__ INFO Instantiating generic monitor for service MGMT and role SERVICEMONITOR [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO Begin monitor refresh. [03/Apr/2019 22:02:03 +0000] 30031 MainThread abstract_monitor INFO Refreshing GenericMonitor MGMT-SERVICEMONITOR for None [03/Apr/2019 22:02:03 +0000] 30031 MainThread __init__ INFO New monitor: (<cmf.monitor.generic.GenericMonitor object at 0x2fdab50>,) [03/Apr/2019 22:02:03 +0000] 30031 MainThread process INFO Daemon refresh complete for process 70-cloudera-mgmt-SERVICEMONITOR. [03/Apr/2019 22:02:06 +0000] 30031 Metadata-Plugin navigator_plugin INFO Refreshing Metadata Plugin for cloudera-mgmt-SERVICEMONITOR with pipelines [] [03/Apr/2019 22:02:06 +0000] 30031 Metadata-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-SERVICEMONITOR (log dir: None) [03/Apr/2019 22:02:06 +0000] 30031 Audit-Plugin navigator_plugin INFO Refreshing Audit Plugin for cloudera-mgmt-SERVICEMONITOR with pipelines [] [03/Apr/2019 22:02:06 +0000] 30031 Audit-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-SERVICEMONITOR (log dir: None) [03/Apr/2019 22:02:26 +0000] 30031 MainThread process INFO [70-cloudera-mgmt-SERVICEMONITOR] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)} [03/Apr/2019 22:02:26 +0000] 30031 MainThread process INFO Deactivating process 70-cloudera-mgmt-SERVICEMONITOR [03/Apr/2019 22:02:31 +0000] 30031 Metadata-Plugin navigator_plugin INFO stopping Metadata Plugin for cloudera-mgmt-SERVICEMONITOR with pipelines [] [03/Apr/2019 22:02:31 +0000] 30031 Metadata-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-SERVICEMONITOR (log dir: None) [03/Apr/2019 22:02:31 +0000] 30031 Audit-Plugin navigator_plugin INFO stopping Audit Plugin for cloudera-mgmt-SERVICEMONITOR with pipelines [] [03/Apr/2019 22:02:31 +0000] 30031 Audit-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-SERVICEMONITOR (log dir: None) [03/Apr/2019 22:03:03 +0000] 30031 MonitorDaemon-Scheduler __init__ INFO Monitor expired: ('GenericMonitor MGMT-SERVICEMONITOR for mgmt-SERVICEMONITOR-9087569f37dce8f46af56b79189cf761',) |
上面有两处有价值的错误信息: EACCESsupervisor: child process was not spawned 这一处错误太过广泛,意思是不能生成子进程,但是不能生成子进程的原因太多了 org.apache.avro.AvroRemoteException: java.net.ConnectException: Connection refused (Connection refused) 这一处的错误是链接错误。也就是说上面错误的原因是因为这里被链接拒绝造成的,也就是说这里成为了关键。但是这个链接拒绝又有很多原因。比如端口被暂用,防火墙未关闭,ntp未同步时间等等,各种原因都可能造成。所以楼主还需要更详细的信息 |