]) created on node: (an-jenkins-deploy-platform-ansible-os-6324-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6324-1)
2026-09-28 02:47:35,876 - INFO - ================================================================================
2026-09-28 02:47:35,876 - INFO - STARTING TEST : test_svc_fate_sharing_basic
2026-09-28 02:47:35,879 - INFO - TEST DESCRIPTION :
Description: Basic test to validate fate sharing in a multi inline service chain with 2 SIs, 1 SVM each.
Test steps:
1.Creating vm's - vm1 and vm2 in networks vn1 and vn2.
2.Creating 2 inline service instances SI1 and SI2.
3.Creating a service chain by applying the 2 service instances in a policy between t
he VNs.
4.Associate an HC instance with right intf of one of the SVMs
5.Bring down the intf in the step 4
6.Verify that all the re-origined routes(ServiceChain) are deleted from all the RIs of all the SIs
7.Verify the step 6 in both control node and agent
8.Bring up the intf in the step 5
8.Verify that the routes should be re-originated again, and the traffic also starts flowing
Pass criteria: Ping/Route deletion/Route addition should be successful.
Maintainer : ankitja@juniper.net
2026-09-28 02:47:36,624 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.254': '0', '10.20.0.25': '0'}, '10.0.0.162': {'10.20.0.25': '0', '10.20.0.254': '0'}} with
2026-09-28 02:47:36,624 - INFO - Initial checks done. Running the testcase now
2026-09-28 02:47:36,624 - INFO -
2026-09-28 02:47:36,625 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6324-2', 'an-jenkins-deploy-platform-ansible-os-6324-1']}
2026-09-28 02:47:36,625 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-12875529']
2026-09-28 02:47:36,957 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-12875529'] created succesfully
2026-09-28 02:47:37,257 - DEBUG - Image by name tiny_in_net not found
2026-09-28 02:47:37,258 - DEBUG - Installing image tiny_in_net
2026-09-28 02:47:37,258 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"}
2026-09-28 02:47:37,258 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz
2026-09-28 02:47:37,258 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz
2026-09-28 02:47:37,258 - DEBUG - Unzip image
2026-09-28 02:47:37,258 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz
2026-09-28 02:47:37,282 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found
2026-09-28 02:47:37,282 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-12875529']
2026-09-28 02:47:37,397 - INFO - Service template: ['default-domain', 'ctest-service_template_1-12875529'] deleted successfully.
2026-09-28 02:47:38,096 - DEBUG - No XMPP flaps were noticed during the test
2026-09-28 02:47:38,096 - INFO -
2026-09-28 02:47:38,096 - INFO - END TEST : test_svc_fate_sharing_basic : SKIPPED[0:00:03]
2026-09-28 02:47:38,096 - INFO - --------------------------------------------------------------------------------
2026-09-28 02:47:38,103 - INFO - ================================================================================
2026-09-28 02:47:38,103 - INFO - STARTING TEST : test_three_stage_v2_SC
2026-09-28 02:47:38,103 - INFO - TEST DESCRIPTION :
Description: Validate multi-Inline SVC version 2.
Test steps:
1.Creating vm's - vm1 and vm2 in networks vn1 and vn2.
2.Creating 3 service instances.
3.Creating a service chain by applying the 3 service instances in a policy between t
he VNs.
4.There should be no traffic loss.
Pass criteria: Ping between the VMs should be successful.
Maintainer : ganeshahv@juniper.net
2026-09-28 02:47:38,815 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.254': '0', '10.20.0.25': '0'}, '10.0.0.162': {'10.20.0.25': '0', '10.20.0.254': '0'}} with
2026-09-28 02:47:38,815 - INFO - Initial checks done. Running the testcase now
2026-09-28 02:47:38,815 - INFO -
2026-09-28 02:47:38,816 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6324-2', 'an-jenkins-deploy-platform-ansible-os-6324-1']}
2026-09-28 02:47:38,816 - INFO - Skipped as test requires at least 3 nodes, but only 2 found
2026-09-28 02:47:39,498 - DEBUG - No XMPP flaps were noticed during the test
2026-09-28 02:47:39,498 - INFO -
2026-09-28 02:47:39,498 - INFO - END TEST : test_three_stage_v2_SC : SKIPPED[0:00:01]
2026-09-28 02:47:39,498 - INFO - --------------------------------------------------------------------------------
2026-09-28 02:47:39,500 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestMultiInlineSVC-30329822-95637071 in state BUILD
2026-09-28 02:47:39,501 - INFO - Deleting VM ctest-right_vm_ctest-TestMultiInlineSVC-30329822-95637071
2026-09-28 02:47:39,542 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVC-30329822-95637071 has failed to come up
2026-09-28 02:47:39,542 - ERROR - Nova failed to get host of the VM
2026-09-28 02:47:39,543 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVC-30329822-95637071 has failed to come up
2026-09-28 02:47:39,543 - ERROR - Nova failed to get host of the VM
2026-09-28 02:47:39,720 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestMultiInlineSVC-30329822-14518422 in state BUILD
2026-09-28 02:47:39,721 - INFO - Deleting VM ctest-left_vm_ctest-TestMultiInlineSVC-30329822-14518422
2026-09-28 02:47:39,721 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVC-30329822-14518422 has failed to come up
2026-09-28 02:47:39,721 - ERROR - Nova failed to get host of the VM
2026-09-28 02:47:39,721 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVC-30329822-14518422 has failed to come up
2026-09-28 02:47:39,722 - ERROR - Nova failed to get host of the VM
2026-09-28 02:47:40,133 - INFO - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671
2026-09-28 02:47:40,225 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-cdfb0f03-b7f6-47f4-a66e-0124103573b6']
2026-09-28 02:47:40,225 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:42,279 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-8224c427-6b69-4088-a9ce-0419f5f7561d']
2026-09-28 02:47:42,279 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:44,329 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f1753a8e-ef27-481f-842c-1b72dece4c15']
2026-09-28 02:47:44,329 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:46,382 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f1563a57-16ae-45aa-a40f-c1d17f05f78f']
2026-09-28 02:47:46,382 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:48,436 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-c111014e-a1eb-45e2-a981-709c9dbb49b2']
2026-09-28 02:47:48,436 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:50,484 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-a0f99158-92a9-4c7a-85cc-c94b8e01dbed']
2026-09-28 02:47:50,485 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:52,534 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9c7130f2-2d5d-45eb-912f-953651676e26']
2026-09-28 02:47:52,535 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:54,585 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d62afb6e-1e19-4a5e-935c-77b8e1e7b510']
2026-09-28 02:47:54,585 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:56,630 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-62f2a6de-e691-4ba8-8e4d-52098abeaf63']
2026-09-28 02:47:56,630 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:47:58,683 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-4d51d78d-0b09-404c-976a-0be177228b2f']
2026-09-28 02:47:58,683 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:48:00,748 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7e32faa4-8536-40a1-b31f-74219f6f8a50']
2026-09-28 02:48:00,748 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:48:02,799 - DEBUG - VN f93e8d94-34b0-4b6b-9b2f-2a8f8413662c still in use: Unable to complete operation on network f93e8d94-34b0-4b6b-9b2f-2a8f8413662c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d41b94b9-8c71-42ab-a1b2-7a83a6648fe5']
2026-09-28 02:48:02,799 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-30329822-27269671 failed..Will retry
2026-09-28 02:48:05,015 - DEBUG - Response for deleting network ()
2026-09-28 02:48:05,015 - INFO - Deleting VN ctest-right_ctest-TestMultiInlineSVC-30329822-39058762
2026-09-28 02:48:05,084 - DEBUG - VN 29962e0f-1bd1-428a-902e-ab57567151d4 still in use: Unable to complete operation on network 29962e0f-1bd1-428a-902e-ab57567151d4. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7caac03b-45b9-429f-b587-e1be750d7f37']
2026-09-28 02:48:05,084 - WARNING - Deleting VN ctest-right_ctest-TestMultiInlineSVC-30329822-39058762 failed..Will retry
2026-09-28 02:48:07,324 - DEBUG - Response for deleting network ()
2026-09-28 02:48:07,324 - INFO - Deleting VN ctest-mgmt_ctest-TestMultiInlineSVC-30329822-15709088
2026-09-28 02:48:07,518 - DEBUG - Response for deleting network ()
2026-09-28 02:48:08,479 - INFO - Deleted project: ctest-TestMultiInlineSVC-30329822, ID : 620b8027-8131-4945-b5bf-5c9ff13d8651