检查服务:#nova服务正常
[root@acai1 ~(keystone_admin)]# nova service-list
+----+------------------+-------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+-------+----------+---------+-------+----------------------------+-----------------+
| 3 | nova-cert | acai1 | internal | enabled | up | 2016-09-09T01:46:11.000000 | - |
| 4 | nova-consoleauth | acai1 | internal | enabled | up | 2016-09-09T01:46:11.000000 | - |
| 5 | nova-scheduler | acai1 | internal | enabled | up | 2016-09-09T01:46:11.000000 | - |
| 6 | nova-conductor | acai1 | internal | enabled | up | 2016-09-09T01:46:11.000000 | - |
| 7 | nova-compute | acai2 | nova | enabled | up | 2016-09-09T01:46:08.000000 | - |
+----+------------------+-------+----------+---------+-------+----------------------------+-----------------+
#neutron服务正常
[root@acai1 ~(keystone_admin)]# neutron agent-list
+--------------------------------------+--------------------+-------+-------------------+-------+----------------+---------------------------+
| id | agent_type | host | availability_zone | alive | admin_state_up | binary |
+--------------------------------------+--------------------+-------+-------------------+-------+----------------+---------------------------+
| 10a1f206-3a1b-4781-9960-60722b4f10ae | DHCP agent | acai3 | nova | :-) | True | neutron-dhcp-agent |
| 66084c78-b062-43da-bfbc-45d43583da1d | Metering agent | acai3 | | :-) | True | neutron-metering-agent |
| b91f81eb-bf5b-4873-8469-997c1ef77517 | L3 agent | acai3 | nova | :-) | True | neutron-l3-agent |
| ec8c26b1-33d9-489a-9129-3cff1c47caa9 | Open vSwitch agent | acai2 | | :-) | True | neutron-openvswitch-agent |
| efebe2db-9ab6-4340-887c-3e2aa235f46a | Metadata agent | acai3 | | :-) | True | neutron-metadata-agent |
| fb02043e-226e-4b86-b38e-23454e6fdfee | Open vSwitch agent | acai3 | | :-) | True | neutron-openvswitch-agent |
+--------------------------------------+--------------------+-------+-------------------+-------+----------------+---------------------------+
排查思路:
1.云主机没有获取到ip地址(应该是neutron的问题)
#查看nova-compute日志
ERROR nova.compute.manager [instance: ea91e020-a08c-4b95-89dc-f79d062a2b34] PortBindingFailed: Binding failed for port 9d7eb475-824d-4738-a43d-4543eda6391b, please check neutron logs for more information.
#排查计算节点openvswtich日志(看到ovs有错误)
2016-09-08 21:22:05.866 2086 INFO neutron.agent.securitygroups_rpc [req-6f95a49e-c183-4f83-b1f7-35aa9c7c0b34 6b0e73f3056d4456a3ebc966aab12f5c 9802c4fbfb5c43a1a5f527cad8162b91 - - -] Security group member updated [u'a1bcc4eb-000c-4d46-b41f-b1a1f782d939']
2016-09-08 21:22:06.386 2086 INFO neutron.agent.securitygroups_rpc [req-afdafcd6-49fd-4a0c-9058-2f66358aa535 6b0e73f3056d4456a3ebc966aab12f5c 9802c4fbfb5c43a1a5f527cad8162b91 - - -] Security group member updated [u'a1bcc4eb-000c-4d46-b41f-b1a1f782d939']
2016-09-08 21:22:07.040 2086 INFO neutron.agent.common.ovs_lib [req-a369417f-7046-4cd0-bbf1-24eb5701830d - - - - -] Port b7d70ebc-5e64-4206-a936-ab545f449300 not present in bridge br-int
2016-09-08 21:22:07.040 2086 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-a369417f-7046-4cd0-bbf1-24eb5701830d - - - - -] port_unbound(): net_uuid None not in local_vlan_map
2016-09-08 21:22:07.041 2086 INFO neutron.agent.securitygroups_rpc [req-a369417f-7046-4cd0-bbf1-24eb5701830d - - - - -] Remove device filter for [u'b7d70ebc-5e64-4206-a936-ab545f449300']
2016-09-08 21:48:22.240 2086 INFO neutron.agent.securitygroups_rpc [req-5ae37a7f-63b3-4a48-9709-af688cfc5ad0 6b0e73f3056d4456a3ebc966aab12f5c 9802c4fbfb5c43a1a5f527cad8162b91 - - -] Security group member updated [u'a1bcc4eb-000c-4d46-b41f-b1a1f782d939']
2016-09-08 21:48:22.766 2086 INFO neutron.agent.securitygroups_rpc [req-40ae5822-a106-42db-89ac-79e030441a19 6b0e73f3056d4456a3ebc966aab12f5c 9802c4fbfb5c43a1a5f527cad8162b91 - - -] Security group member updated [u'a1bcc4eb-000c-4d46-b41f-b1a1f782d939']
2016-09-08 21:48:23.208 2086 INFO neutron.agent.common.ovs_lib [req-a369417f-7046-4cd0-bbf1-24eb5701830d - - - - -] Port 9d7eb475-824d-4738-a43d-4543eda6391b not present in bridge br-int
2016-09-08 21:48:23.208 2086 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-a369417f-7046-4cd0-bbf1-24eb5701830d - - - - -] port_unbound(): net_uuid None not in local_vlan_map
2016-09-08 21:48:23.208 2086 INFO neutron.agent.securitygroups_rpc [req-a369417f-7046-4cd0-bbf1-24eb5701830d - - - - -] Remove device filter for [u'9d7eb475-824d-4738-a43d-4543eda6391b']
#删除计算节点和neutron节点的br-int和br-ex网桥
neutron节点:
[root@acai3 ~]# ovs-vsctl del-br br-ex
[root@acai3 ~]# ovs-vsctl del-br br-int
[root@acai3 ~]# ovs-vsctl add-br br-ex
[root@acai3 ~]# ovs-vsctl add-port br-ex eth2
compute节点:
[root@acai2 ~]# ovs-vsctl del-br br-int
#重启neutron节点和compute节点的服务
openstack-service restart
#查看桥接网卡状态都是DOWN
compute节点:
[root@acai2 ~]# ip a|grep DOWN
4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
5: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noqueue state DOWN
6: br-vlan: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
neutron节点:
[root@acai3 ~]# ip a|grep DOWN
5: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
6: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
7: br-vlan: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
8: br-ex: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
#手动启动桥接网卡
compute节点:
for i in `ip a|grep DOWN|awk -F ":" '{print $2}'`;do ifconfig $i up;done
neutron节点:
for i in `ip a|grep DOWN|awk -F ":" '{print $2}'`;do ifconfig $i up;done
#创建云主机测试继续在云主机孵化报错
#再次查看compute节点openvswtich日志还是之前的报错(这里有个报错,需要将原来的admin-net网络删除重新创建)
[root@acai3 neutron]# cat openvswitch-agent.log
2016-09-08 22:28:40.763 2068 INFO neutron.agent.securitygroups_rpc [req-ee77fa3f-3d24-450a-86fb-5b4c3e23480f 6b0e73f3056d4456a3ebc966aab12f5c 9802c4fbfb5c43a1a5f527cad8162b91 - - -] Security group member updated [u'a1bcc4eb-000c-4d46-b41f-b1a1f782d939']
2016-09-08 22:28:41.219 2068 INFO neutron.agent.securitygroups_rpc [req-66580a9b-e123-4679-8b79-f1c51fd25bc3 6b0e73f3056d4456a3ebc966aab12f5c 9802c4fbfb5c43a1a5f527cad8162b91 - - -] Security group member updated [u'a1bcc4eb-000c-4d46-b41f-b1a1f782d939']
2016-09-08 22:28:41.695 2068 INFO neutron.agent.common.ovs_lib [req-c49cfb25-3069-47f8-a73d-8fe14bf8f157 - - - - -] Port 77f6b585-4dc7-4198-a39b-c8e8949f0c31 not present in bridge br-int
2016-09-08 22:28:41.695 2068 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-c49cfb25-3069-47f8-a73d-8fe14bf8f157 - - - - -] port_unbound(): net_uuid None not in local_vlan_map
2016-09-08 22:28:41.695 2068 INFO neutron.agent.securitygroups_rpc [req-c49cfb25-3069-47f8-a73d-8fe14bf8f157 - - - - -] Remove device filter for [u'77f6b585-4dc7-4198-a39b-c8e8949f0c31']
#再次测试成功创建实例
补充内容 (2017-1-16 13:58):
删除租户网络,重建网络可恢复正常 |