2026-04-20 03:15:34,993 - INFO - Domain Default found not creating 2026-04-20 03:15:35,182 - INFO - Project ctest-TestSvcHC-80183260 not found, creating it 2026-04-20 03:15:35,777 - INFO - Created Project:ctest-TestSvcHC-80183260, ID : 6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:37,286 - INFO - ================================================================================ 2026-04-20 03:15:37,286 - INFO - STARTING TEST : test_svc_hc_basic 2026-04-20 03:15:38,557 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.65': {'10.20.0.25': '0', '10.20.0.129': '1'}} with 2026-04-20 03:15:38,557 - INFO - Initial checks done. Running the testcase now 2026-04-20 03:15:38,557 - INFO - 2026-04-20 03:15:39,202 - DEBUG - Response for create_network : {'network': {'id': 'a43c2402-f919-4689-abe1-0df69dcc987d', 'name': 'ctest-mgmt_vn-83198579', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-mgmt_vn-83198579'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:39,552 - DEBUG - Response for create_subnet : {'subnet': {'id': '2ed61c36-2483-40ea-98f4-eda4260fc2aa', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': 'a43c2402-f919-4689-abe1-0df69dcc987d', 'ip_version': 4, 'cidr': '28.244.75.0/26', 'allocation_pools': [{'start': '28.244.75.2', 'end': '28.244.75.62'}], 'gateway_ip': '28.244.75.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '28.244.75.2', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:39,578 - INFO - Created VN ctest-mgmt_vn-83198579 2026-04-20 03:15:39,592 - DEBUG - VN ctest-mgmt_vn-83198579 UUID is a43c2402-f919-4689-abe1-0df69dcc987d 2026-04-20 03:15:39,674 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:39,990 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:40,032 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:40,048 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:40,157 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a43c2402-f919-4689-abe1-0df69dcc987d 2026-04-20 03:15:40,173 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a43c2402-f919-4689-abe1-0df69dcc987d 2026-04-20 03:15:40,184 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2202c83c-3728-4516-9460-32a4467e9da8 2026-04-20 03:15:40,193 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2202c83c-3728-4516-9460-32a4467e9da8 2026-04-20 03:15:40,202 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/743e0250-a2fa-45d1-87b1-1a2616ee4085 2026-04-20 03:15:40,210 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:40,210 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a43c2402-f919-4689-abe1-0df69dcc987d 2026-04-20 03:15:40,221 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2202c83c-3728-4516-9460-32a4467e9da8 2026-04-20 03:15:40,238 - INFO - Verified VN network id 17 for VN a43c2402-f919-4689-abe1-0df69dcc987d 2026-04-20 03:15:40,238 - INFO - Verifications in API Server for VN ctest-mgmt_vn-83198579 passed 2026-04-20 03:15:40,238 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a43c2402-f919-4689-abe1-0df69dcc987d 2026-04-20 03:15:40,252 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2202c83c-3728-4516-9460-32a4467e9da8 2026-04-20 03:15:40,261 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2202c83c-3728-4516-9460-32a4467e9da8 2026-04-20 03:15:40,271 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/743e0250-a2fa-45d1-87b1-1a2616ee4085 2026-04-20 03:15:40,287 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11834373516010538633', 'uuid-lslong': '12385195803106121853'}, 'enable': 'true', 'created': '2026-04-20T03:15:39', 'last-modified': '2026-04-20T03:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.812699'} 2026-04-20 03:15:40,295 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:40,302 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11834373516010538633', 'uuid-lslong': '12385195803106121853'}, 'enable': 'true', 'created': '2026-04-20T03:15:39', 'last-modified': '2026-04-20T03:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.828674'} 2026-04-20 03:15:40,309 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:40,314 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11834373516010538633', 'uuid-lslong': '12385195803106121853'}, 'enable': 'true', 'created': '2026-04-20T03:15:39', 'last-modified': '2026-04-20T03:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.842609'} 2026-04-20 03:15:40,320 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:40,320 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-83198579 passed 2026-04-20 03:15:40,321 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-83198579 in API_Server ====== 2026-04-20 03:15:40,321 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:40,328 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:40,341 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:40,445 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a43c2402-f919-4689-abe1-0df69dcc987d 2026-04-20 03:15:40,456 - DEBUG - =>VN ctest-mgmt_vn-83198579 has no policy to be verified 2026-04-20 03:15:40,456 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:40,456 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:40,456 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:40,776 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:40,858 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579?flat'} 2026-04-20 03:15:40,858 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:40,858 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:41,165 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:41,228 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579?flat'} 2026-04-20 03:15:41,228 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:41,228 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:41,531 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:41,603 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579?flat'} 2026-04-20 03:15:41,603 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-83198579 is found in opserver 2026-04-20 03:15:41,627 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:41,638 - DEBUG - VRF ids for VN ctest-mgmt_vn-83198579: {} 2026-04-20 03:15:41,902 - DEBUG - Response for create_network : {'network': {'id': '36b11ee8-6ef6-4054-9b6c-3d6e092d9c86', 'name': 'ctest-left_vn-77333917', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-left_vn-77333917'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:42,123 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ffefa808-b277-4cb8-bdf4-7a3c4525ecd3', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': '36b11ee8-6ef6-4054-9b6c-3d6e092d9c86', 'ip_version': 4, 'cidr': '41.199.173.64/26', 'allocation_pools': [{'start': '41.199.173.66', 'end': '41.199.173.126'}], 'gateway_ip': '41.199.173.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.199.173.66', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:42,145 - INFO - Created VN ctest-left_vn-77333917 2026-04-20 03:15:42,155 - DEBUG - VN ctest-left_vn-77333917 UUID is 36b11ee8-6ef6-4054-9b6c-3d6e092d9c86 2026-04-20 03:15:42,238 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:42,246 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:42,261 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:42,363 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/36b11ee8-6ef6-4054-9b6c-3d6e092d9c86 2026-04-20 03:15:42,376 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/36b11ee8-6ef6-4054-9b6c-3d6e092d9c86 2026-04-20 03:15:42,389 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5c7564c4-e81d-4aae-ae63-96020dff5706 2026-04-20 03:15:42,396 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5c7564c4-e81d-4aae-ae63-96020dff5706 2026-04-20 03:15:42,403 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1d31bbf6-70d7-466e-a2b0-d0172cd985f4 2026-04-20 03:15:42,410 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:42,410 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/36b11ee8-6ef6-4054-9b6c-3d6e092d9c86 2026-04-20 03:15:42,419 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5c7564c4-e81d-4aae-ae63-96020dff5706 2026-04-20 03:15:42,435 - INFO - Verified VN network id 18 for VN 36b11ee8-6ef6-4054-9b6c-3d6e092d9c86 2026-04-20 03:15:42,435 - INFO - Verifications in API Server for VN ctest-left_vn-77333917 passed 2026-04-20 03:15:42,435 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/36b11ee8-6ef6-4054-9b6c-3d6e092d9c86 2026-04-20 03:15:42,446 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5c7564c4-e81d-4aae-ae63-96020dff5706 2026-04-20 03:15:42,456 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5c7564c4-e81d-4aae-ae63-96020dff5706 2026-04-20 03:15:42,471 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1d31bbf6-70d7-466e-a2b0-d0172cd985f4 2026-04-20 03:15:42,482 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3940965132568772692', 'uuid-lslong': '11199393916173261958'}, 'enable': 'true', 'created': '2026-04-20T03:15:41', 'last-modified': '2026-04-20T03:15:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418164'} 2026-04-20 03:15:42,489 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:42,494 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3940965132568772692', 'uuid-lslong': '11199393916173261958'}, 'enable': 'true', 'created': '2026-04-20T03:15:41', 'last-modified': '2026-04-20T03:15:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428129'} 2026-04-20 03:15:42,500 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:42,505 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3940965132568772692', 'uuid-lslong': '11199393916173261958'}, 'enable': 'true', 'created': '2026-04-20T03:15:41', 'last-modified': '2026-04-20T03:15:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437910'} 2026-04-20 03:15:42,511 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:42,512 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-77333917 passed 2026-04-20 03:15:42,513 - DEBUG - ====Verifying policy data for ctest-left_vn-77333917 in API_Server ====== 2026-04-20 03:15:42,513 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:42,519 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:42,531 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:42,624 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/36b11ee8-6ef6-4054-9b6c-3d6e092d9c86 2026-04-20 03:15:42,636 - DEBUG - =>VN ctest-left_vn-77333917 has no policy to be verified 2026-04-20 03:15:42,636 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:42,636 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:42,636 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:42,702 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917?flat'} 2026-04-20 03:15:42,702 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:42,702 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:42,761 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917?flat'} 2026-04-20 03:15:42,761 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:42,761 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:42,830 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917?flat'} 2026-04-20 03:15:42,830 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-77333917 is found in opserver 2026-04-20 03:15:42,853 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:42,865 - DEBUG - VRF ids for VN ctest-left_vn-77333917: {} 2026-04-20 03:15:43,176 - DEBUG - Response for create_network : {'network': {'id': 'cfee9382-f6cc-46f9-b835-a7c8971b11d3', 'name': 'ctest-right_vn-61658505', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-right_vn-61658505'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:43,476 - DEBUG - Response for create_subnet : {'subnet': {'id': '7689918e-b0c9-498f-943c-7046bff9a511', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': 'cfee9382-f6cc-46f9-b835-a7c8971b11d3', 'ip_version': 4, 'cidr': '96.45.178.192/26', 'allocation_pools': [{'start': '96.45.178.194', 'end': '96.45.178.254'}], 'gateway_ip': '96.45.178.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '96.45.178.194', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:43,517 - INFO - Created VN ctest-right_vn-61658505 2026-04-20 03:15:43,536 - DEBUG - VN ctest-right_vn-61658505 UUID is cfee9382-f6cc-46f9-b835-a7c8971b11d3 2026-04-20 03:15:43,608 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:43,614 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:43,627 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:43,721 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfee9382-f6cc-46f9-b835-a7c8971b11d3 2026-04-20 03:15:43,739 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfee9382-f6cc-46f9-b835-a7c8971b11d3 2026-04-20 03:15:43,752 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ef5c501b-fef0-4b17-9d2c-844d46309163 2026-04-20 03:15:43,762 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ef5c501b-fef0-4b17-9d2c-844d46309163 2026-04-20 03:15:43,768 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/0dc0343e-ea1b-4891-9525-e9b1a7b87980 2026-04-20 03:15:43,775 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:43,775 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfee9382-f6cc-46f9-b835-a7c8971b11d3 2026-04-20 03:15:43,782 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ef5c501b-fef0-4b17-9d2c-844d46309163 2026-04-20 03:15:43,797 - INFO - Verified VN network id 19 for VN cfee9382-f6cc-46f9-b835-a7c8971b11d3 2026-04-20 03:15:43,797 - INFO - Verifications in API Server for VN ctest-right_vn-61658505 passed 2026-04-20 03:15:43,797 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfee9382-f6cc-46f9-b835-a7c8971b11d3 2026-04-20 03:15:43,815 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ef5c501b-fef0-4b17-9d2c-844d46309163 2026-04-20 03:15:43,824 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ef5c501b-fef0-4b17-9d2c-844d46309163 2026-04-20 03:15:43,831 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/0dc0343e-ea1b-4891-9525-e9b1a7b87980 2026-04-20 03:15:43,842 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14983075201003833081', 'uuid-lslong': '13273699956714836435'}, 'enable': 'true', 'created': '2026-04-20T03:15:43', 'last-modified': '2026-04-20T03:15:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446842'} 2026-04-20 03:15:43,846 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:43,852 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14983075201003833081', 'uuid-lslong': '13273699956714836435'}, 'enable': 'true', 'created': '2026-04-20T03:15:43', 'last-modified': '2026-04-20T03:15:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.456783'} 2026-04-20 03:15:43,858 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:43,863 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14983075201003833081', 'uuid-lslong': '13273699956714836435'}, 'enable': 'true', 'created': '2026-04-20T03:15:43', 'last-modified': '2026-04-20T03:15:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.468325'} 2026-04-20 03:15:43,868 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:43,868 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-61658505 passed 2026-04-20 03:15:43,869 - DEBUG - ====Verifying policy data for ctest-right_vn-61658505 in API_Server ====== 2026-04-20 03:15:43,869 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:43,876 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:43,887 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:44,009 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfee9382-f6cc-46f9-b835-a7c8971b11d3 2026-04-20 03:15:44,020 - DEBUG - =>VN ctest-right_vn-61658505 has no policy to be verified 2026-04-20 03:15:44,020 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:44,020 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:44,020 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:44,080 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505?flat'} 2026-04-20 03:15:44,080 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:44,080 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:44,141 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505?flat'} 2026-04-20 03:15:44,141 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:44,141 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:44,207 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505?flat'} 2026-04-20 03:15:44,207 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-61658505 is found in opserver 2026-04-20 03:15:44,238 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:44,251 - DEBUG - VRF ids for VN ctest-right_vn-61658505: {} 2026-04-20 03:15:44,471 - DEBUG - Services list from nova: [, , , ] 2026-04-20 03:15:45,623 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-2) 2026-04-20 03:15:47,077 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-1) 2026-04-20 03:15:47,077 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-05931005'] 2026-04-20 03:15:47,366 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-05931005'] created succesfully 2026-04-20 03:15:47,762 - DEBUG - Image by name tiny_nat_fw not found 2026-04-20 03:15:47,762 - DEBUG - Installing image tiny_nat_fw 2026-04-20 03:15:47,762 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-04-20 03:15:47,763 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-04-20 03:15:47,763 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-04-20 03:15:47,763 - DEBUG - Unzip image 2026-04-20 03:15:47,763 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-04-20 03:15:47,780 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-04-20 03:15:47,781 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-05931005'] 2026-04-20 03:15:47,908 - INFO - Service template: ['default-domain', 'ctest-service_template_1-05931005'] deleted successfully. 2026-04-20 03:15:47,908 - INFO - Skip interface_detach for VM ctest-right_vm-31513164 in state BUILD 2026-04-20 03:15:47,908 - INFO - Deleting VM ctest-right_vm-31513164 2026-04-20 03:15:47,933 - ERROR - VM ctest-right_vm-31513164 has failed to come up 2026-04-20 03:15:47,933 - ERROR - Nova failed to get host of the VM 2026-04-20 03:15:47,933 - ERROR - VM ctest-right_vm-31513164 has failed to come up 2026-04-20 03:15:47,934 - ERROR - Nova failed to get host of the VM 2026-04-20 03:15:48,010 - INFO - Skip interface_detach for VM ctest-left_vm-53633261 in state BUILD 2026-04-20 03:15:48,010 - INFO - Deleting VM ctest-left_vm-53633261 2026-04-20 03:15:48,011 - ERROR - VM ctest-left_vm-53633261 has failed to come up 2026-04-20 03:15:48,011 - ERROR - Nova failed to get host of the VM 2026-04-20 03:15:48,011 - ERROR - VM ctest-left_vm-53633261 has failed to come up 2026-04-20 03:15:48,011 - ERROR - Nova failed to get host of the VM 2026-04-20 03:15:48,090 - INFO - Deleting VN ctest-right_vn-61658505 2026-04-20 03:15:48,132 - DEBUG - VN cfee9382-f6cc-46f9-b835-a7c8971b11d3 still in use: Unable to complete operation on network cfee9382-f6cc-46f9-b835-a7c8971b11d3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1b401992-f7bb-4089-b34d-3825b5fa3797'] 2026-04-20 03:15:48,132 - WARNING - Deleting VN ctest-right_vn-61658505 failed..Will retry 2026-04-20 03:15:50,283 - DEBUG - Response for deleting network () 2026-04-20 03:15:50,283 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ef5c501b-fef0-4b17-9d2c-844d46309163 2026-04-20 03:15:50,297 - DEBUG - Response Code: 404 2026-04-20 03:15:50,297 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:50,305 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:50,322 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:50,414 - INFO - Validated that VN ctest-right_vn-61658505 is not found in API Server 2026-04-20 03:15:50,427 - DEBUG - VN ctest-right_vn-61658505 is not present in Agent 10.0.0.240 2026-04-20 03:15:50,439 - DEBUG - VN ctest-right_vn-61658505 is not present in Agent 10.0.0.65 2026-04-20 03:15:50,440 - INFO - Validated that VN ctest-right_vn-61658505 is not in any agent 2026-04-20 03:15:50,469 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-61658505 info 2026-04-20 03:15:50,469 - INFO - Deleting VN ctest-left_vn-77333917 2026-04-20 03:15:50,620 - DEBUG - Response for deleting network () 2026-04-20 03:15:50,621 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5c7564c4-e81d-4aae-ae63-96020dff5706 2026-04-20 03:15:50,626 - DEBUG - Response Code: 404 2026-04-20 03:15:50,627 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:50,633 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:50,651 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:50,740 - INFO - Validated that VN ctest-left_vn-77333917 is not found in API Server 2026-04-20 03:15:50,752 - DEBUG - VN ctest-left_vn-77333917 is not present in Agent 10.0.0.240 2026-04-20 03:15:50,764 - DEBUG - VN ctest-left_vn-77333917 is not present in Agent 10.0.0.65 2026-04-20 03:15:50,764 - INFO - Validated that VN ctest-left_vn-77333917 is not in any agent 2026-04-20 03:15:50,792 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-77333917 info 2026-04-20 03:15:50,792 - INFO - Deleting VN ctest-mgmt_vn-83198579 2026-04-20 03:15:50,950 - DEBUG - Response for deleting network () 2026-04-20 03:15:50,950 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2202c83c-3728-4516-9460-32a4467e9da8 2026-04-20 03:15:50,963 - DEBUG - Response Code: 404 2026-04-20 03:15:50,963 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:50,972 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:51,032 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:51,150 - INFO - Validated that VN ctest-mgmt_vn-83198579 is not found in API Server 2026-04-20 03:15:51,164 - DEBUG - VN ctest-mgmt_vn-83198579 is not present in Agent 10.0.0.240 2026-04-20 03:15:51,179 - DEBUG - VN ctest-mgmt_vn-83198579 is not present in Agent 10.0.0.65 2026-04-20 03:15:51,179 - INFO - Validated that VN ctest-mgmt_vn-83198579 is not in any agent 2026-04-20 03:15:51,217 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-83198579 info 2026-04-20 03:15:52,510 - DEBUG - No XMPP flaps were noticed during the test 2026-04-20 03:15:52,510 - INFO - 2026-04-20 03:15:52,510 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2026-04-20 03:15:52,510 - INFO - -------------------------------------------------------------------------------- 2026-04-20 03:15:52,514 - INFO - ================================================================================ 2026-04-20 03:15:52,515 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-04-20 03:15:53,813 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.65': {'10.20.0.25': '0', '10.20.0.129': '1'}} with 2026-04-20 03:15:53,813 - INFO - Initial checks done. Running the testcase now 2026-04-20 03:15:53,813 - INFO - 2026-04-20 03:15:54,060 - DEBUG - Response for create_network : {'network': {'id': 'bb57151e-f788-40fa-8458-37d95c266dd9', 'name': 'ctest-mgmt_vn-51235304', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-mgmt_vn-51235304'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:54,277 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a428bc26-a76d-4efa-8de2-7dd12c9d550e', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': 'bb57151e-f788-40fa-8458-37d95c266dd9', 'ip_version': 4, 'cidr': '192.104.103.0/26', 'allocation_pools': [{'start': '192.104.103.2', 'end': '192.104.103.62'}], 'gateway_ip': '192.104.103.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '192.104.103.2', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:54,299 - INFO - Created VN ctest-mgmt_vn-51235304 2026-04-20 03:15:54,310 - DEBUG - VN ctest-mgmt_vn-51235304 UUID is bb57151e-f788-40fa-8458-37d95c266dd9 2026-04-20 03:15:54,381 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:54,387 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:54,399 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:54,486 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bb57151e-f788-40fa-8458-37d95c266dd9 2026-04-20 03:15:54,497 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bb57151e-f788-40fa-8458-37d95c266dd9 2026-04-20 03:15:54,506 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c3fe2ade-4cf8-48ce-bda0-4ff7cf6d9cf0 2026-04-20 03:15:54,515 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c3fe2ade-4cf8-48ce-bda0-4ff7cf6d9cf0 2026-04-20 03:15:54,522 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/12c6ebfe-ca20-47b0-a730-d59a0369ee27 2026-04-20 03:15:54,529 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:54,529 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bb57151e-f788-40fa-8458-37d95c266dd9 2026-04-20 03:15:54,539 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c3fe2ade-4cf8-48ce-bda0-4ff7cf6d9cf0 2026-04-20 03:15:54,556 - INFO - Verified VN network id 17 for VN bb57151e-f788-40fa-8458-37d95c266dd9 2026-04-20 03:15:54,556 - INFO - Verifications in API Server for VN ctest-mgmt_vn-51235304 passed 2026-04-20 03:15:54,556 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bb57151e-f788-40fa-8458-37d95c266dd9 2026-04-20 03:15:54,567 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c3fe2ade-4cf8-48ce-bda0-4ff7cf6d9cf0 2026-04-20 03:15:54,575 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c3fe2ade-4cf8-48ce-bda0-4ff7cf6d9cf0 2026-04-20 03:15:54,582 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/12c6ebfe-ca20-47b0-a730-d59a0369ee27 2026-04-20 03:15:54,596 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13499281630812455162', 'uuid-lslong': '9536433617650478553'}, 'enable': 'true', 'created': '2026-04-20T03:15:54', 'last-modified': '2026-04-20T03:15:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364738'} 2026-04-20 03:15:54,606 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:54,612 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13499281630812455162', 'uuid-lslong': '9536433617650478553'}, 'enable': 'true', 'created': '2026-04-20T03:15:54', 'last-modified': '2026-04-20T03:15:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.378217'} 2026-04-20 03:15:54,619 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:54,627 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13499281630812455162', 'uuid-lslong': '9536433617650478553'}, 'enable': 'true', 'created': '2026-04-20T03:15:54', 'last-modified': '2026-04-20T03:15:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.394027'} 2026-04-20 03:15:54,634 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:15:54,634 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-51235304 passed 2026-04-20 03:15:54,634 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-51235304 in API_Server ====== 2026-04-20 03:15:54,634 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:54,641 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:54,655 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:54,763 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bb57151e-f788-40fa-8458-37d95c266dd9 2026-04-20 03:15:54,776 - DEBUG - =>VN ctest-mgmt_vn-51235304 has no policy to be verified 2026-04-20 03:15:54,776 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:54,777 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:54,777 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:54,789 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304?flat'} 2026-04-20 03:15:54,789 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:54,789 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:54,803 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304?flat'} 2026-04-20 03:15:54,803 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:54,803 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:54,816 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304?flat'} 2026-04-20 03:15:54,817 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-mgmt_vn-51235304 is found in opserver 2026-04-20 03:15:54,842 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:54,853 - DEBUG - VRF ids for VN ctest-mgmt_vn-51235304: {} 2026-04-20 03:15:55,132 - DEBUG - Response for create_network : {'network': {'id': '1f273fec-0db3-48e7-8862-8cd2ab46a51d', 'name': 'ctest-left_vn-78896534', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-left_vn-78896534'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:55,412 - DEBUG - Response for create_subnet : {'subnet': {'id': 'eebca5de-4055-4f26-985d-e23ec6705a0b', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': '1f273fec-0db3-48e7-8862-8cd2ab46a51d', 'ip_version': 4, 'cidr': '30.74.158.128/26', 'allocation_pools': [{'start': '30.74.158.130', 'end': '30.74.158.190'}], 'gateway_ip': '30.74.158.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.74.158.130', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:55,438 - INFO - Created VN ctest-left_vn-78896534 2026-04-20 03:15:55,452 - DEBUG - VN ctest-left_vn-78896534 UUID is 1f273fec-0db3-48e7-8862-8cd2ab46a51d 2026-04-20 03:15:55,517 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:55,523 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:55,534 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:55,637 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1f273fec-0db3-48e7-8862-8cd2ab46a51d 2026-04-20 03:15:55,650 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1f273fec-0db3-48e7-8862-8cd2ab46a51d 2026-04-20 03:15:55,660 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/75bbde6d-ba94-49ce-a460-b6f8820f64a0 2026-04-20 03:15:55,668 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/75bbde6d-ba94-49ce-a460-b6f8820f64a0 2026-04-20 03:15:55,676 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1d84c457-3032-40b1-89f4-a6fdc4be00f5 2026-04-20 03:15:55,683 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:55,683 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1f273fec-0db3-48e7-8862-8cd2ab46a51d 2026-04-20 03:15:55,694 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/75bbde6d-ba94-49ce-a460-b6f8820f64a0 2026-04-20 03:15:55,711 - INFO - Verified VN network id 18 for VN 1f273fec-0db3-48e7-8862-8cd2ab46a51d 2026-04-20 03:15:55,711 - INFO - Verifications in API Server for VN ctest-left_vn-78896534 passed 2026-04-20 03:15:55,711 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1f273fec-0db3-48e7-8862-8cd2ab46a51d 2026-04-20 03:15:55,723 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/75bbde6d-ba94-49ce-a460-b6f8820f64a0 2026-04-20 03:15:55,730 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/75bbde6d-ba94-49ce-a460-b6f8820f64a0 2026-04-20 03:15:55,738 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1d84c457-3032-40b1-89f4-a6fdc4be00f5 2026-04-20 03:15:55,755 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2244833222342166759', 'uuid-lslong': '9827572173320398109'}, 'enable': 'true', 'created': '2026-04-20T03:15:55', 'last-modified': '2026-04-20T03:15:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396631'} 2026-04-20 03:15:55,764 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:55,770 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2244833222342166759', 'uuid-lslong': '9827572173320398109'}, 'enable': 'true', 'created': '2026-04-20T03:15:55', 'last-modified': '2026-04-20T03:15:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416234'} 2026-04-20 03:15:55,777 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:55,784 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2244833222342166759', 'uuid-lslong': '9827572173320398109'}, 'enable': 'true', 'created': '2026-04-20T03:15:55', 'last-modified': '2026-04-20T03:15:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428220'} 2026-04-20 03:15:55,791 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:15:55,791 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-78896534 passed 2026-04-20 03:15:55,792 - DEBUG - ====Verifying policy data for ctest-left_vn-78896534 in API_Server ====== 2026-04-20 03:15:55,792 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:55,799 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:55,814 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:55,918 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1f273fec-0db3-48e7-8862-8cd2ab46a51d 2026-04-20 03:15:55,939 - DEBUG - =>VN ctest-left_vn-78896534 has no policy to be verified 2026-04-20 03:15:55,939 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:55,939 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:55,939 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:55,952 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534?flat'} 2026-04-20 03:15:55,952 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:55,952 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:55,965 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534?flat'} 2026-04-20 03:15:55,965 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:55,965 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:55,976 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534?flat'} 2026-04-20 03:15:55,976 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-left_vn-78896534 is found in opserver 2026-04-20 03:15:55,996 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:56,007 - DEBUG - VRF ids for VN ctest-left_vn-78896534: {} 2026-04-20 03:15:56,270 - DEBUG - Response for create_network : {'network': {'id': 'e9a01876-776e-4328-9a89-4629130ed678', 'name': 'ctest-right_vn-46785916', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-right_vn-46785916'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:56,488 - DEBUG - Response for create_subnet : {'subnet': {'id': '8e85a631-3dcc-451c-8779-e25bc4a2ddef', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': 'e9a01876-776e-4328-9a89-4629130ed678', 'ip_version': 4, 'cidr': '215.202.11.64/26', 'allocation_pools': [{'start': '215.202.11.66', 'end': '215.202.11.126'}], 'gateway_ip': '215.202.11.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '215.202.11.66', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:56,515 - INFO - Created VN ctest-right_vn-46785916 2026-04-20 03:15:56,525 - DEBUG - VN ctest-right_vn-46785916 UUID is e9a01876-776e-4328-9a89-4629130ed678 2026-04-20 03:15:56,607 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:56,613 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:56,625 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:56,721 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e9a01876-776e-4328-9a89-4629130ed678 2026-04-20 03:15:56,732 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e9a01876-776e-4328-9a89-4629130ed678 2026-04-20 03:15:56,741 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/a1e0a481-ed0a-45e6-ab91-d33f385dc886 2026-04-20 03:15:56,751 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/a1e0a481-ed0a-45e6-ab91-d33f385dc886 2026-04-20 03:15:56,758 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/3bab1d40-f324-49ca-8223-b47544522eab 2026-04-20 03:15:56,765 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:56,765 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e9a01876-776e-4328-9a89-4629130ed678 2026-04-20 03:15:56,774 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/a1e0a481-ed0a-45e6-ab91-d33f385dc886 2026-04-20 03:15:56,788 - INFO - Verified VN network id 19 for VN e9a01876-776e-4328-9a89-4629130ed678 2026-04-20 03:15:56,788 - INFO - Verifications in API Server for VN ctest-right_vn-46785916 passed 2026-04-20 03:15:56,788 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e9a01876-776e-4328-9a89-4629130ed678 2026-04-20 03:15:56,799 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/a1e0a481-ed0a-45e6-ab91-d33f385dc886 2026-04-20 03:15:56,818 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/a1e0a481-ed0a-45e6-ab91-d33f385dc886 2026-04-20 03:15:56,826 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/3bab1d40-f324-49ca-8223-b47544522eab 2026-04-20 03:15:56,840 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16834482304199836456', 'uuid-lslong': '11135508695877604984'}, 'enable': 'true', 'created': '2026-04-20T03:15:56', 'last-modified': '2026-04-20T03:15:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400564'} 2026-04-20 03:15:56,850 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:56,855 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16834482304199836456', 'uuid-lslong': '11135508695877604984'}, 'enable': 'true', 'created': '2026-04-20T03:15:56', 'last-modified': '2026-04-20T03:15:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416205'} 2026-04-20 03:15:56,863 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:56,869 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16834482304199836456', 'uuid-lslong': '11135508695877604984'}, 'enable': 'true', 'created': '2026-04-20T03:15:56', 'last-modified': '2026-04-20T03:15:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440062'} 2026-04-20 03:15:56,876 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:15:56,876 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-46785916 passed 2026-04-20 03:15:56,876 - DEBUG - ====Verifying policy data for ctest-right_vn-46785916 in API_Server ====== 2026-04-20 03:15:56,876 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:56,884 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:56,897 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:56,992 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e9a01876-776e-4328-9a89-4629130ed678 2026-04-20 03:15:57,002 - DEBUG - =>VN ctest-right_vn-46785916 has no policy to be verified 2026-04-20 03:15:57,002 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:57,002 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:57,002 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:57,015 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916?flat'} 2026-04-20 03:15:57,015 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:57,015 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:57,029 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916?flat'} 2026-04-20 03:15:57,029 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:57,029 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:57,041 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916?flat'} 2026-04-20 03:15:57,041 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-right_vn-46785916 is found in opserver 2026-04-20 03:15:57,069 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:57,080 - DEBUG - VRF ids for VN ctest-right_vn-46785916: {} 2026-04-20 03:15:57,369 - DEBUG - Response for create_network : {'network': {'id': 'fc445f9d-1355-467e-b611-a1b983f36ec1', 'name': 'ctest-trans_left_vn-32543040', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-trans_left_vn-32543040'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:57,581 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e6d64c48-ab51-4420-9f0c-78f3b2d9e722', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': 'fc445f9d-1355-467e-b611-a1b983f36ec1', 'ip_version': 4, 'cidr': '57.185.21.0/26', 'allocation_pools': [{'start': '57.185.21.2', 'end': '57.185.21.62'}], 'gateway_ip': '57.185.21.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '57.185.21.2', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:57,632 - INFO - Created VN ctest-trans_left_vn-32543040 2026-04-20 03:15:57,647 - DEBUG - VN ctest-trans_left_vn-32543040 UUID is fc445f9d-1355-467e-b611-a1b983f36ec1 2026-04-20 03:15:57,746 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:57,753 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:57,770 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:57,866 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/fc445f9d-1355-467e-b611-a1b983f36ec1 2026-04-20 03:15:57,882 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/fc445f9d-1355-467e-b611-a1b983f36ec1 2026-04-20 03:15:57,892 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab8286c7-2eab-426a-863e-4bae958c9cf8 2026-04-20 03:15:57,902 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab8286c7-2eab-426a-863e-4bae958c9cf8 2026-04-20 03:15:57,912 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/a3e93263-0e60-4a8e-aa13-b4fca44269a8 2026-04-20 03:15:57,920 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:15:57,920 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/fc445f9d-1355-467e-b611-a1b983f36ec1 2026-04-20 03:15:57,933 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab8286c7-2eab-426a-863e-4bae958c9cf8 2026-04-20 03:15:57,947 - INFO - Verified VN network id 20 for VN fc445f9d-1355-467e-b611-a1b983f36ec1 2026-04-20 03:15:57,948 - INFO - Verifications in API Server for VN ctest-trans_left_vn-32543040 passed 2026-04-20 03:15:57,948 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/fc445f9d-1355-467e-b611-a1b983f36ec1 2026-04-20 03:15:57,958 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab8286c7-2eab-426a-863e-4bae958c9cf8 2026-04-20 03:15:57,967 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab8286c7-2eab-426a-863e-4bae958c9cf8 2026-04-20 03:15:57,977 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/a3e93263-0e60-4a8e-aa13-b4fca44269a8 2026-04-20 03:15:57,992 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18177759124213024382', 'uuid-lslong': '13119445007661756097'}, 'enable': 'true', 'created': '2026-04-20T03:15:57', 'last-modified': '2026-04-20T03:15:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454890'} 2026-04-20 03:15:57,998 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:15:58,005 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18177759124213024382', 'uuid-lslong': '13119445007661756097'}, 'enable': 'true', 'created': '2026-04-20T03:15:57', 'last-modified': '2026-04-20T03:15:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466340'} 2026-04-20 03:15:58,026 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:15:58,032 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18177759124213024382', 'uuid-lslong': '13119445007661756097'}, 'enable': 'true', 'created': '2026-04-20T03:15:57', 'last-modified': '2026-04-20T03:15:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.497794'} 2026-04-20 03:15:58,039 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:15:58,039 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-32543040 passed 2026-04-20 03:15:58,039 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-32543040 in API_Server ====== 2026-04-20 03:15:58,039 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:58,048 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:58,063 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:58,154 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/fc445f9d-1355-467e-b611-a1b983f36ec1 2026-04-20 03:15:58,166 - DEBUG - =>VN ctest-trans_left_vn-32543040 has no policy to be verified 2026-04-20 03:15:58,166 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:58,166 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:58,166 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:58,178 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040?flat'} 2026-04-20 03:15:58,178 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:58,179 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:58,193 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040?flat'} 2026-04-20 03:15:58,193 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:58,193 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:58,205 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040?flat'} 2026-04-20 03:15:58,205 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-trans_left_vn-32543040 is found in opserver 2026-04-20 03:15:58,232 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:58,246 - DEBUG - VRF ids for VN ctest-trans_left_vn-32543040: {} 2026-04-20 03:15:58,515 - DEBUG - Response for create_network : {'network': {'id': '741e6bf2-662f-433e-97b3-e06b8c7c2b26', 'name': 'ctest-trans_right_vn-36345919', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'project_id': '6d29b3b311b349dd8420551df1b56e19', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-80183260', 'ctest-trans_right_vn-36345919'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:15:58,760 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bcbd4d96-8833-4b74-8d6c-174d017fe3dd', 'name': '', 'tenant_id': '6d29b3b311b349dd8420551df1b56e19', 'network_id': '741e6bf2-662f-433e-97b3-e06b8c7c2b26', 'ip_version': 4, 'cidr': '26.233.69.64/26', 'allocation_pools': [{'start': '26.233.69.66', 'end': '26.233.69.126'}], 'gateway_ip': '26.233.69.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '26.233.69.66', 'tags': [], 'project_id': '6d29b3b311b349dd8420551df1b56e19'}} 2026-04-20 03:15:58,782 - INFO - Created VN ctest-trans_right_vn-36345919 2026-04-20 03:15:58,794 - DEBUG - VN ctest-trans_right_vn-36345919 UUID is 741e6bf2-662f-433e-97b3-e06b8c7c2b26 2026-04-20 03:15:58,869 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:58,875 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:58,886 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:58,972 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/741e6bf2-662f-433e-97b3-e06b8c7c2b26 2026-04-20 03:15:58,983 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/741e6bf2-662f-433e-97b3-e06b8c7c2b26 2026-04-20 03:15:58,990 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/cd17aa1d-03da-4a28-aa84-2d24bf0e372a 2026-04-20 03:15:58,996 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/cd17aa1d-03da-4a28-aa84-2d24bf0e372a 2026-04-20 03:15:59,003 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/6920a948-6b0d-49b6-b69b-c839264a4688 2026-04-20 03:15:59,008 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:15:59,009 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/741e6bf2-662f-433e-97b3-e06b8c7c2b26 2026-04-20 03:15:59,017 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/cd17aa1d-03da-4a28-aa84-2d24bf0e372a 2026-04-20 03:15:59,033 - INFO - Verified VN network id 21 for VN 741e6bf2-662f-433e-97b3-e06b8c7c2b26 2026-04-20 03:15:59,033 - INFO - Verifications in API Server for VN ctest-trans_right_vn-36345919 passed 2026-04-20 03:15:59,033 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/741e6bf2-662f-433e-97b3-e06b8c7c2b26 2026-04-20 03:15:59,043 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/cd17aa1d-03da-4a28-aa84-2d24bf0e372a 2026-04-20 03:15:59,051 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/cd17aa1d-03da-4a28-aa84-2d24bf0e372a 2026-04-20 03:15:59,059 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/6920a948-6b0d-49b6-b69b-c839264a4688 2026-04-20 03:15:59,071 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8367243846541591358', 'uuid-lslong': '10931327473081396006'}, 'enable': 'true', 'created': '2026-04-20T03:15:58', 'last-modified': '2026-04-20T03:15:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.350300'} 2026-04-20 03:15:59,077 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:15:59,083 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8367243846541591358', 'uuid-lslong': '10931327473081396006'}, 'enable': 'true', 'created': '2026-04-20T03:15:58', 'last-modified': '2026-04-20T03:15:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.362420'} 2026-04-20 03:15:59,089 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:15:59,094 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-80183260', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8367243846541591358', 'uuid-lslong': '10931327473081396006'}, 'enable': 'true', 'created': '2026-04-20T03:15:58', 'last-modified': '2026-04-20T03:15:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384883'} 2026-04-20 03:15:59,099 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:15:59,099 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-36345919 passed 2026-04-20 03:15:59,099 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-36345919 in API_Server ====== 2026-04-20 03:15:59,099 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:15:59,105 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:15:59,115 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:15:59,207 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/741e6bf2-662f-433e-97b3-e06b8c7c2b26 2026-04-20 03:15:59,219 - DEBUG - =>VN ctest-trans_right_vn-36345919 has no policy to be verified 2026-04-20 03:15:59,219 - DEBUG - Verifying the vn in opserver 2026-04-20 03:15:59,219 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919 virtual network link through opserver 10.0.0.38 2026-04-20 03:15:59,219 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:15:59,231 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919?flat'} 2026-04-20 03:15:59,231 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919 virtual network link through opserver 10.0.0.27 2026-04-20 03:15:59,231 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:15:59,246 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919?flat'} 2026-04-20 03:15:59,246 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919 virtual network link through opserver 10.0.0.23 2026-04-20 03:15:59,246 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:15:59,258 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919?flat'} 2026-04-20 03:15:59,258 - INFO - Validated that VN default-domain:ctest-TestSvcHC-80183260:ctest-trans_right_vn-36345919 is found in opserver 2026-04-20 03:15:59,278 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:15:59,289 - DEBUG - VRF ids for VN ctest-trans_right_vn-36345919: {} 2026-04-20 03:16:00,491 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-1) 2026-04-20 03:16:01,831 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-2) 2026-04-20 03:16:01,831 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-07813462'] 2026-04-20 03:16:02,131 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-07813462'] created succesfully 2026-04-20 03:16:02,539 - DEBUG - Image by name tiny_trans_fw not found 2026-04-20 03:16:02,539 - DEBUG - Installing image tiny_trans_fw 2026-04-20 03:16:02,539 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-04-20 03:16:02,540 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-04-20 03:16:02,540 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-04-20 03:16:02,540 - DEBUG - Unzip image 2026-04-20 03:16:02,540 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-04-20 03:16:02,561 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-04-20 03:16:02,561 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-07813462'] 2026-04-20 03:16:02,648 - INFO - Service template: ['default-domain', 'ctest-service_template_1-07813462'] deleted successfully. 2026-04-20 03:16:02,648 - INFO - Skip interface_detach for VM ctest-right_vm-42641291 in state BUILD 2026-04-20 03:16:02,648 - INFO - Deleting VM ctest-right_vm-42641291 2026-04-20 03:16:02,648 - ERROR - VM ctest-right_vm-42641291 has failed to come up 2026-04-20 03:16:02,648 - ERROR - Nova failed to get host of the VM 2026-04-20 03:16:02,649 - ERROR - VM ctest-right_vm-42641291 has failed to come up 2026-04-20 03:16:02,649 - ERROR - Nova failed to get host of the VM 2026-04-20 03:16:02,758 - INFO - Skip interface_detach for VM ctest-left_vm-44451681 in state BUILD 2026-04-20 03:16:02,758 - INFO - Deleting VM ctest-left_vm-44451681 2026-04-20 03:16:02,758 - ERROR - VM ctest-left_vm-44451681 has failed to come up 2026-04-20 03:16:02,758 - ERROR - Nova failed to get host of the VM 2026-04-20 03:16:02,758 - ERROR - VM ctest-left_vm-44451681 has failed to come up 2026-04-20 03:16:02,758 - ERROR - Nova failed to get host of the VM 2026-04-20 03:16:02,859 - INFO - Deleting VN ctest-trans_right_vn-36345919 2026-04-20 03:16:03,030 - DEBUG - Response for deleting network () 2026-04-20 03:16:03,031 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/cd17aa1d-03da-4a28-aa84-2d24bf0e372a 2026-04-20 03:16:03,045 - DEBUG - Response Code: 404 2026-04-20 03:16:03,045 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:03,053 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:03,078 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:16:03,162 - INFO - Validated that VN ctest-trans_right_vn-36345919 is not found in API Server 2026-04-20 03:16:03,174 - DEBUG - VN ctest-trans_right_vn-36345919 is not present in Agent 10.0.0.240 2026-04-20 03:16:03,183 - DEBUG - VN ctest-trans_right_vn-36345919 is not present in Agent 10.0.0.65 2026-04-20 03:16:03,183 - INFO - Validated that VN ctest-trans_right_vn-36345919 is not in any agent 2026-04-20 03:16:03,211 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-36345919 info 2026-04-20 03:16:03,212 - INFO - Deleting VN ctest-trans_left_vn-32543040 2026-04-20 03:16:03,377 - DEBUG - Response for deleting network () 2026-04-20 03:16:03,377 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab8286c7-2eab-426a-863e-4bae958c9cf8 2026-04-20 03:16:03,389 - DEBUG - Response Code: 404 2026-04-20 03:16:03,390 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:03,399 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:03,416 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:16:03,507 - INFO - Validated that VN ctest-trans_left_vn-32543040 is not found in API Server 2026-04-20 03:16:03,519 - DEBUG - VN ctest-trans_left_vn-32543040 is not present in Agent 10.0.0.240 2026-04-20 03:16:03,535 - DEBUG - VN ctest-trans_left_vn-32543040 is not present in Agent 10.0.0.65 2026-04-20 03:16:03,535 - INFO - Validated that VN ctest-trans_left_vn-32543040 is not in any agent 2026-04-20 03:16:03,608 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-32543040 info 2026-04-20 03:16:03,608 - INFO - Deleting VN ctest-right_vn-46785916 2026-04-20 03:16:03,685 - DEBUG - VN e9a01876-776e-4328-9a89-4629130ed678 still in use: Unable to complete operation on network e9a01876-776e-4328-9a89-4629130ed678. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-21d5b0b2-fc79-416a-9778-503cca37240e'] 2026-04-20 03:16:03,685 - WARNING - Deleting VN ctest-right_vn-46785916 failed..Will retry 2026-04-20 03:16:05,846 - DEBUG - Response for deleting network () 2026-04-20 03:16:05,846 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/a1e0a481-ed0a-45e6-ab91-d33f385dc886 2026-04-20 03:16:05,852 - DEBUG - Response Code: 404 2026-04-20 03:16:05,852 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:05,862 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:05,882 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:16:05,983 - INFO - Validated that VN ctest-right_vn-46785916 is not found in API Server 2026-04-20 03:16:05,994 - DEBUG - VN ctest-right_vn-46785916 is not present in Agent 10.0.0.240 2026-04-20 03:16:06,006 - DEBUG - VN ctest-right_vn-46785916 is not present in Agent 10.0.0.65 2026-04-20 03:16:06,006 - INFO - Validated that VN ctest-right_vn-46785916 is not in any agent 2026-04-20 03:16:06,039 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-46785916 info 2026-04-20 03:16:06,040 - INFO - Deleting VN ctest-left_vn-78896534 2026-04-20 03:16:06,215 - DEBUG - Response for deleting network () 2026-04-20 03:16:06,215 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/75bbde6d-ba94-49ce-a460-b6f8820f64a0 2026-04-20 03:16:06,221 - DEBUG - Response Code: 404 2026-04-20 03:16:06,221 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:06,238 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:06,293 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:16:06,394 - INFO - Validated that VN ctest-left_vn-78896534 is not found in API Server 2026-04-20 03:16:06,407 - DEBUG - VN ctest-left_vn-78896534 is not present in Agent 10.0.0.240 2026-04-20 03:16:06,417 - DEBUG - VN ctest-left_vn-78896534 is not present in Agent 10.0.0.65 2026-04-20 03:16:06,417 - INFO - Validated that VN ctest-left_vn-78896534 is not in any agent 2026-04-20 03:16:06,450 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-78896534 info 2026-04-20 03:16:06,450 - INFO - Deleting VN ctest-mgmt_vn-51235304 2026-04-20 03:16:06,604 - DEBUG - Response for deleting network () 2026-04-20 03:16:06,604 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c3fe2ade-4cf8-48ce-bda0-4ff7cf6d9cf0 2026-04-20 03:16:06,610 - DEBUG - Response Code: 404 2026-04-20 03:16:06,610 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:06,617 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:06,637 - DEBUG - Requesting: http://10.0.0.38:8082/project/6d29b3b3-11b3-49dd-8420-551df1b56e19 2026-04-20 03:16:06,734 - INFO - Validated that VN ctest-mgmt_vn-51235304 is not found in API Server 2026-04-20 03:16:06,749 - DEBUG - VN ctest-mgmt_vn-51235304 is not present in Agent 10.0.0.240 2026-04-20 03:16:06,761 - DEBUG - VN ctest-mgmt_vn-51235304 is not present in Agent 10.0.0.65 2026-04-20 03:16:06,761 - INFO - Validated that VN ctest-mgmt_vn-51235304 is not in any agent 2026-04-20 03:16:06,797 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-51235304 info 2026-04-20 03:16:08,083 - DEBUG - No XMPP flaps were noticed during the test 2026-04-20 03:16:08,083 - INFO - 2026-04-20 03:16:08,083 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2026-04-20 03:16:08,083 - INFO - -------------------------------------------------------------------------------- 2026-04-20 03:16:08,880 - INFO - Deleted project: ctest-TestSvcHC-80183260, ID : 6d29b3b3-11b3-49dd-8420-551df1b56e19