[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent/supervis
or/include
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent ERROR Failed to connect to previous supervisor.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1636, in find_or_start_supervisor
self.get_supervisor_process_info()
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1845, in get_supervisor_process_info
self.identifier = self.supervisor_client.supervisor.getIdentification()
File "/usr/lib64/python2.6/xmlrpclib.py", line 1199, in __call__
return self.__send(self.__name, args)
File "/usr/lib64/python2.6/xmlrpclib.py", line 1489, in __request
verbose=self.__verbose
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/xmlrpc.py", line 460, in request
self.connection.request('POST', handler, request_body, self.headers)
File "/usr/lib64/python2.6/httplib.py", line 973, in request
self._send_request(method, url, body, headers)
File "/usr/lib64/python2.6/httplib.py", line 1010, in _send_request
self.endheaders()
File "/usr/lib64/python2.6/httplib.py", line 967, in endheaders
self._send_output()
File "/usr/lib64/python2.6/httplib.py", line 831, in _send_output
self.send(msg)
File "/usr/lib64/python2.6/httplib.py", line 790, in send
self.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:57:50 +0000] 3361 MainThread tmpfs INFO Reusing mounted tmpfs at /opt/cm-5.5.0/run/cloudera-scm-agent/process
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Trying to connect to newly launched supervisor (Attempt 1)
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Supervisor version: 3.0
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Successfully connected to supervisor
[22/Nov/2018 18:57:53 +0000] 3361 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes.
[22/Nov/2018 18:57:53 +0000] 3361 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes.
[22/Nov/2018 18:57:53 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:53] ENGINE Bus STARTING
[22/Nov/2018 18:57:53 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:53] ENGINE Started monitor thread '_TimeoutMonitor'.
[22/Nov/2018 18:57:54 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:54] ENGINE Serving on CentOS165:9000
[22/Nov/2018 18:57:54 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:54] ENGINE Bus STARTED
[22/Nov/2018 18:57:54 +0000] 3361 MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x2cfb3d0>,)
[22/Nov/2018 18:57:54 +0000] 3361 MainThread agent INFO Setting default socket timeout to 30
[22/Nov/2018 18:57:54 +0000] 3361 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor network_interfaces INFO NIC iface eth0 doesn't support ETHTOOL (95)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor network_interfaces INFO NIC iface pan0 doesn't support ETHTOOL (95)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cm-5.5.0/log/clouder
a-scm-agent
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/dir_monitor.py", line 90, in _get_directory_attributes
name = pwd.getpwuid(uid)[0]
KeyError: 'getpwuid(): uid not found: 1106'
[22/Nov/2018 18:57:54 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:58:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:59:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:00:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcels to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcels to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcel-cache to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcel-cache to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread parcel INFO Agent does create users/groups and apply file permissions
[22/Nov/2018 19:01:54 +0000] 3361 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:54 +0000] 3361 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[22/Nov/2018 19:01:56 +0000] 3361 MainThread agent INFO Active parcel list updated; recalculating component info.
[22/Nov/2018 19:02:24 +0000] 3361 DnsResolutionMonitor throttling_logger INFO Using java location: '/usr/local/jdk1.7/bin/java'.
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Timeout with args ['ntpdc', '-np']
None
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Failed to collect NTP metrics
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 37, in collect
result, stdout, stderr = self._subprocess_with_timeout(args, self._timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 30, in _subprocess_with_timeout
return subprocess_with_timeout(args, timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/subprocess_timeout.py", line 94, in subprocess_with_timeout
raise Exception("timeout with args %s" % args)
Exception: timeout with args ['ntpdc', '-np']
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]# more cloudera-scm-agent.log
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO SCM Agent Version: 5.5.0
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Agent Protocol Version: 4
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Using Host ID: 78441a1b-4d95-4f6c-8e91-f5b12fbc27cd
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Using directory: /opt/cm-5.5.0/run/cloudera-scm-agent
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Using supervisor binary path: /opt/cm-5.5.0/lib64/cmf/agent/src/cmf/../../buil
d/env/bin/supervisord
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing va
lidation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate val
idation.
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Agent Logging Level: INFO
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO No command line vars
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you
're not using this database type)
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if yo
u're not using this database type)
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Found database jar: /opt/cm-5.5.0/share/cmf/lib/postgresql-9.0-801.jdbc4.jar
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Agent starting as pid 3361 user root(0) group root(0).
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: cpu
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: cpuacct
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: memory
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: blkio
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/memory
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/cpu
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/cpuacct
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/blkio
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_byte
s': -1, 'default_memory_soft_limit_in_bytes': -1, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'defau
lt_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_cpuacct': True, 'has_blkio': True}
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Setting up supervisord event monitor.
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Using timeout of 2.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Using join timeout of 0.100000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Using tolerance of 60.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4']
[22/Nov/2018 18:57:47 +0000] 3361 MainThread kt_renewer INFO Agent wide credential cache set to /opt/cm-5.5.0/run/cloudera-scm-agent/krb5cc
_cm_agent_0
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Using max_collection_wait_seconds of 10.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread metrics INFO Importing tasktracker metric schema from file /opt/cm-5.5.0/lib64/cmf/agent/sr
c/cmf/monitor/tasktracker/schema.json
[22/Nov/2018 18:57:47 +0000] 3361 MainThread ntp_monitor INFO Using timeout of 2.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread dns_names INFO Using timeout of 30.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread __init__ INFO Created DNS monitor.
[22/Nov/2018 18:57:47 +0000] 3361 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
[22/Nov/2018 18:57:47 +0000] 3361 MainThread __init__ INFO Importing metric schema from file /opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monito
r/schema.json
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent ERROR Failed to connect to previous supervisor.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1636, in find_or_start_supervisor
self.get_supervisor_process_info()
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1845, in get_supervisor_process_info
self.identifier = self.supervisor_client.supervisor.getIdentification()
File "/usr/lib64/python2.6/xmlrpclib.py", line 1199, in __call__
return self.__send(self.__name, args)
File "/usr/lib64/python2.6/xmlrpclib.py", line 1489, in __request
verbose=self.__verbose
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/xmlrpc.py", line 460, in request
self.connection.request('POST', handler, request_body, self.headers)
File "/usr/lib64/python2.6/httplib.py", line 973, in request
self._send_request(method, url, body, headers)
File "/usr/lib64/python2.6/httplib.py", line 1010, in _send_request
self.endheaders()
File "/usr/lib64/python2.6/httplib.py", line 967, in endheaders
self._send_output()
File "/usr/lib64/python2.6/httplib.py", line 831, in _send_output
self.send(msg)
File "/usr/lib64/python2.6/httplib.py", line 790, in send
self.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:57:50 +0000] 3361 MainThread tmpfs INFO Reusing mounted tmpfs at /opt/cm-5.5.0/run/cloudera-scm-agent/process
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cm-5.5.0/log/clouder
a-scm-agent
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/dir_monitor.py", line 90, in _get_directory_attributes
name = pwd.getpwuid(uid)[0]
KeyError: 'getpwuid(): uid not found: 1106'
[22/Nov/2018 18:57:54 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:58:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:59:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:00:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcels to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcels to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcel-cache to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcel-cache to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread parcel INFO Agent does create users/groups and apply file permissions
[22/Nov/2018 19:01:54 +0000] 3361 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:54 +0000] 3361 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[22/Nov/2018 19:01:56 +0000] 3361 MainThread agent INFO Active parcel list updated; recalculating component info.
[22/Nov/2018 19:02:24 +0000] 3361 DnsResolutionMonitor throttling_logger INFO Using java location: '/usr/local/jdk1.7/bin/java'.
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Timeout with args ['ntpdc', '-np']
None
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Failed to collect NTP metrics
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 37, in collect
result, stdout, stderr = self._subprocess_with_timeout(args, self._timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 30, in _subprocess_with_timeout
return subprocess_with_timeout(args, timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/subprocess_timeout.py", line 94, in subprocess_with_timeout
raise Exception("timeout with args %s" % args)
Exception: timeout with args ['ntpdc', '-np'][22/Nov/2018 18:57:50 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent/supervis
or/include
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent ERROR Failed to connect to previous supervisor.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1636, in find_or_start_supervisor
self.get_supervisor_process_info()
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1845, in get_supervisor_process_info
self.identifier = self.supervisor_client.supervisor.getIdentification()
File "/usr/lib64/python2.6/xmlrpclib.py", line 1199, in __call__
return self.__send(self.__name, args)
File "/usr/lib64/python2.6/xmlrpclib.py", line 1489, in __request
verbose=self.__verbose
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/xmlrpc.py", line 460, in request
self.connection.request('POST', handler, request_body, self.headers)
File "/usr/lib64/python2.6/httplib.py", line 973, in request
self._send_request(method, url, body, headers)
File "/usr/lib64/python2.6/httplib.py", line 1010, in _send_request
self.endheaders()
File "/usr/lib64/python2.6/httplib.py", line 967, in endheaders
self._send_output()
File "/usr/lib64/python2.6/httplib.py", line 831, in _send_output
self.send(msg)
File "/usr/lib64/python2.6/httplib.py", line 790, in send
self.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:57:50 +0000] 3361 MainThread tmpfs INFO Reusing mounted tmpfs at /opt/cm-5.5.0/run/cloudera-scm-agent/process
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Trying to connect to newly launched supervisor (Attempt 1)
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Supervisor version: 3.0
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Successfully connected to supervisor
[22/Nov/2018 18:57:53 +0000] 3361 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes.
[22/Nov/2018 18:57:53 +0000] 3361 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes.
[22/Nov/2018 18:57:53 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:53] ENGINE Bus STARTING
[22/Nov/2018 18:57:53 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:53] ENGINE Started monitor thread '_TimeoutMonitor'.
[22/Nov/2018 18:57:54 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:54] ENGINE Serving on CentOS165:9000
[22/Nov/2018 18:57:54 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:54] ENGINE Bus STARTED
[22/Nov/2018 18:57:54 +0000] 3361 MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x2cfb3d0>,)
[22/Nov/2018 18:57:54 +0000] 3361 MainThread agent INFO Setting default socket timeout to 30
[22/Nov/2018 18:57:54 +0000] 3361 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor network_interfaces INFO NIC iface eth0 doesn't support ETHTOOL (95)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor network_interfaces INFO NIC iface pan0 doesn't support ETHTOOL (95)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cm-5.5.0/log/clouder
a-scm-agent
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/dir_monitor.py", line 90, in _get_directory_attributes
name = pwd.getpwuid(uid)[0]
KeyError: 'getpwuid(): uid not found: 1106'
[22/Nov/2018 18:57:54 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:58:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:59:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:00:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcels to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcels to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcel-cache to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcel-cache to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread parcel INFO Agent does create users/groups and apply file permissions
[22/Nov/2018 19:01:54 +0000] 3361 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:54 +0000] 3361 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[22/Nov/2018 19:01:56 +0000] 3361 MainThread agent INFO Active parcel list updated; recalculating component info.
[22/Nov/2018 19:02:24 +0000] 3361 DnsResolutionMonitor throttling_logger INFO Using java location: '/usr/local/jdk1.7/bin/java'.
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Timeout with args ['ntpdc', '-np']
None
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Failed to collect NTP metrics
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 37, in collect
result, stdout, stderr = self._subprocess_with_timeout(args, self._timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 30, in _subprocess_with_timeout
return subprocess_with_timeout(args, timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/subprocess_timeout.py", line 94, in subprocess_with_timeout
raise Exception("timeout with args %s" % args)
Exception: timeout with args ['ntpdc', '-np']
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]#
[root@CentOS165 cloudera-scm-agent]# more cloudera-scm-agent.log
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO SCM Agent Version: 5.5.0
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Agent Protocol Version: 4
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Using Host ID: 78441a1b-4d95-4f6c-8e91-f5b12fbc27cd
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Using directory: /opt/cm-5.5.0/run/cloudera-scm-agent
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Using supervisor binary path: /opt/cm-5.5.0/lib64/cmf/agent/src/cmf/../../buil
d/env/bin/supervisord
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing va
lidation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate val
idation.
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Agent Logging Level: INFO
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO No command line vars
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you
're not using this database type)
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if yo
u're not using this database type)
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Found database jar: /opt/cm-5.5.0/share/cmf/lib/postgresql-9.0-801.jdbc4.jar
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Agent starting as pid 3361 user root(0) group root(0).
[22/Nov/2018 18:57:45 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: cpu
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: cpuacct
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: memory
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Found cgroups subsystem: blkio
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/memory
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/cpu
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/cpuacct
[22/Nov/2018 18:57:47 +0000] 3361 MainThread cgroups INFO Reusing /opt/cm-5.5.0/run/cloudera-scm-agent/cgroups/blkio
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_byte
s': -1, 'default_memory_soft_limit_in_bytes': -1, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'defau
lt_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_cpuacct': True, 'has_blkio': True}
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Setting up supervisord event monitor.
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Using timeout of 2.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Using join timeout of 0.100000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Using tolerance of 60.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4']
[22/Nov/2018 18:57:47 +0000] 3361 MainThread kt_renewer INFO Agent wide credential cache set to /opt/cm-5.5.0/run/cloudera-scm-agent/krb5cc
_cm_agent_0
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread agent INFO Using max_collection_wait_seconds of 10.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread metrics INFO Importing tasktracker metric schema from file /opt/cm-5.5.0/lib64/cmf/agent/sr
c/cmf/monitor/tasktracker/schema.json
[22/Nov/2018 18:57:47 +0000] 3361 MainThread ntp_monitor INFO Using timeout of 2.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread dns_names INFO Using timeout of 30.000000
[22/Nov/2018 18:57:47 +0000] 3361 MainThread __init__ INFO Created DNS monitor.
[22/Nov/2018 18:57:47 +0000] 3361 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
[22/Nov/2018 18:57:47 +0000] 3361 MainThread __init__ INFO Importing metric schema from file /opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monito
r/schema.json
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent INFO Supervised processes will add the following to their environment (in addition
to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/opt/cm-5.5.0/li
b64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cm-5.5.0/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HO
ME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/
hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_S
TANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.
jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce',
'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cm-5.5.0/share/cmf/lib/postgresql-9.0-801.jdbc4
.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/et
c/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/
usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_M
R1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry
', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'ROOT': '/opt/cm-5.5.0
/lib64/cmf', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME':
'/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environme
nt variables for CDH locations are not used when CDH is installed from parcels.
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent/process
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent/supervis
or
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.5.0/run/cloudera-scm-agent/supervis
or/include
[22/Nov/2018 18:57:50 +0000] 3361 MainThread agent ERROR Failed to connect to previous supervisor.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1636, in find_or_start_supervisor
self.get_supervisor_process_info()
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1845, in get_supervisor_process_info
self.identifier = self.supervisor_client.supervisor.getIdentification()
File "/usr/lib64/python2.6/xmlrpclib.py", line 1199, in __call__
return self.__send(self.__name, args)
File "/usr/lib64/python2.6/xmlrpclib.py", line 1489, in __request
verbose=self.__verbose
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/xmlrpc.py", line 460, in request
self.connection.request('POST', handler, request_body, self.headers)
File "/usr/lib64/python2.6/httplib.py", line 973, in request
self._send_request(method, url, body, headers)
File "/usr/lib64/python2.6/httplib.py", line 1010, in _send_request
self.endheaders()
File "/usr/lib64/python2.6/httplib.py", line 967, in endheaders
self._send_output()
File "/usr/lib64/python2.6/httplib.py", line 831, in _send_output
self.send(msg)
File "/usr/lib64/python2.6/httplib.py", line 790, in send
self.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:57:50 +0000] 3361 MainThread tmpfs INFO Reusing mounted tmpfs at /opt/cm-5.5.0/run/cloudera-scm-agent/process
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Trying to connect to newly launched supervisor (Attempt 1)
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Supervisor version: 3.0
[22/Nov/2018 18:57:53 +0000] 3361 MainThread agent INFO Successfully connected to supervisor
[22/Nov/2018 18:57:53 +0000] 3361 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes.
[22/Nov/2018 18:57:53 +0000] 3361 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes.
[22/Nov/2018 18:57:53 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:53] ENGINE Bus STARTING
[22/Nov/2018 18:57:53 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:53] ENGINE Started monitor thread '_TimeoutMonitor'.
[22/Nov/2018 18:57:54 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:54] ENGINE Serving on CentOS165:9000
[22/Nov/2018 18:57:54 +0000] 3361 MainThread _cplogging INFO [22/Nov/2018:18:57:54] ENGINE Bus STARTED
[22/Nov/2018 18:57:54 +0000] 3361 MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x2cfb3d0>,)
[22/Nov/2018 18:57:54 +0000] 3361 MainThread agent INFO Setting default socket timeout to 30
[22/Nov/2018 18:57:54 +0000] 3361 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor network_interfaces INFO NIC iface eth0 doesn't support ETHTOOL (95)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor network_interfaces INFO NIC iface pan0 doesn't support ETHTOOL (95)
[22/Nov/2018 18:57:54 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cm-5.5.0/log/clouder
a-scm-agent
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/dir_monitor.py", line 90, in _get_directory_attributes
name = pwd.getpwuid(uid)[0]
KeyError: 'getpwuid(): uid not found: 1106'
[22/Nov/2018 18:57:54 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:58:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 18:59:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:00:55 +0000] 3361 MainThread agent ERROR Heartbeating to CentOS165:7182 failed.
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/agent.py", line 1062, in send_heartbeat
self.master_port)
File "/opt/cm-5.5.0/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcels
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcels to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcels to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Created /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chowning /opt/cloudera/parcel-cache to root (0) root (0)
[22/Nov/2018 19:01:53 +0000] 3361 MainThread agent INFO Chmod'ing /opt/cloudera/parcel-cache to 0755
[22/Nov/2018 19:01:53 +0000] 3361 MainThread parcel INFO Agent does create users/groups and apply file permissions
[22/Nov/2018 19:01:54 +0000] 3361 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[22/Nov/2018 19:01:54 +0000] 3361 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[22/Nov/2018 19:01:56 +0000] 3361 MainThread agent INFO Active parcel list updated; recalculating component info.
[22/Nov/2018 19:02:24 +0000] 3361 DnsResolutionMonitor throttling_logger INFO Using java location: '/usr/local/jdk1.7/bin/java'.
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Timeout with args ['ntpdc', '-np']
None
[22/Nov/2018 19:02:56 +0000] 3361 Monitor-HostMonitor throttling_logger ERROR Failed to collect NTP metrics
Traceback (most recent call last):
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 37, in collect
result, stdout, stderr = self._subprocess_with_timeout(args, self._timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/monitor/host/ntp_monitor.py", line 30, in _subprocess_with_timeout
return subprocess_with_timeout(args, timeout)
File "/opt/cm-5.5.0/lib64/cmf/agent/src/cmf/subprocess_timeout.py", line 94, in subprocess_with_timeout
raise Exception("timeout with args %s" % args)
Exception: timeout with args ['ntpdc', '-np']
|
|