2026-04-20 01:52:36,466 - INFO - Using existing project ['default-domain', 'k8s-default'](ae8083bf-0e07-4014-b4f0-37a0db06043a) 2026-04-20 01:52:36,486 - DEBUG - Namespace ctest-new-default-64204504 not present 2026-04-20 01:52:36,501 - INFO - Created namespace ctest-new-default-64204504 2026-04-20 01:52:39,504 - DEBUG - Namespace ctest-non-default-71044942 not present 2026-04-20 01:52:39,513 - INFO - Created namespace ctest-non-default-71044942 2026-04-20 01:52:42,530 - DEBUG - Pod ctest-pod-93178753 not present 2026-04-20 01:52:42,530 - INFO - Creating Pod ctest-pod-93178753 2026-04-20 01:52:42,569 - DEBUG - Pod : ctest-pod-93178753 UUID is 0dcdcd31-809a-40e1-a1d8-9032c4c022af 2026-04-20 01:52:42,575 - DEBUG - Pod ctest-pod-52138584 not present 2026-04-20 01:52:42,575 - INFO - Creating Pod ctest-pod-52138584 2026-04-20 01:52:42,599 - DEBUG - Pod : ctest-pod-52138584 UUID is 19a1a35a-a8b9-4209-81e9-f694c4d2920d 2026-04-20 01:52:42,602 - DEBUG - Pod ctest-pod-77560170 not present 2026-04-20 01:52:42,603 - INFO - Creating Pod ctest-pod-77560170 2026-04-20 01:52:42,662 - DEBUG - Pod : ctest-pod-77560170 UUID is 037cde93-ee69-4264-b978-8ea48e8da28d 2026-04-20 01:52:42,665 - DEBUG - Pod ctest-pod-59946328 not present 2026-04-20 01:52:42,665 - INFO - Creating Pod ctest-pod-59946328 2026-04-20 01:52:42,689 - DEBUG - Pod : ctest-pod-59946328 UUID is eb7fbdba-4120-4cdb-ac46-bdcda3361f05 2026-04-20 01:52:42,691 - DEBUG - Pod ctest-pod-28247758 not present 2026-04-20 01:52:42,691 - INFO - Creating Pod ctest-pod-28247758 2026-04-20 01:52:42,709 - DEBUG - Pod : ctest-pod-28247758 UUID is 40460bbf-554e-4796-a826-412e5cea5039 2026-04-20 01:52:42,710 - DEBUG - Pod ctest-pod-15119937 not present 2026-04-20 01:52:42,711 - INFO - Creating Pod ctest-pod-15119937 2026-04-20 01:52:42,729 - DEBUG - Pod : ctest-pod-15119937 UUID is 86ef506e-2810-4607-8677-7c7f66c20851 2026-04-20 01:52:42,732 - DEBUG - Pod ctest-pod-04563316 not present 2026-04-20 01:52:42,733 - INFO - Creating Pod ctest-pod-04563316 2026-04-20 01:52:42,760 - DEBUG - Pod : ctest-pod-04563316 UUID is d1867651-a242-406a-bc4e-b6e68b5e6473 2026-04-20 01:52:42,762 - DEBUG - Pod ctest-pod-95281319 not present 2026-04-20 01:52:42,762 - INFO - Creating Pod ctest-pod-95281319 2026-04-20 01:52:42,779 - DEBUG - Pod : ctest-pod-95281319 UUID is 3dff4115-a6ba-4374-b1be-8f4bf3164c98 2026-04-20 01:52:43,007 - INFO - Project default-domain:k8s-ctest-new-default-64204504 for Namespace ctest-new-default-64204504 is seen in contrail-api 2026-04-20 01:52:43,007 - DEBUG - Project uuid in Contrail is b46295b3-04d2-4bb7-9604-97bbc5a369d9 2026-04-20 01:52:43,158 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=53a58048-c7bd-4320-bc28-41ae4479d10a 2026-04-20 01:52:43,163 - INFO - Namespace ctest-new-default-64204504 with uuid 53a58048-c7bd-4320-bc28-41ae4479d10a found in kube manager 2026-04-20 01:52:43,163 - INFO - Namespace ctest-new-default-64204504 verification passed 2026-04-20 01:52:43,307 - INFO - Project default-domain:k8s-ctest-non-default-71044942 for Namespace ctest-non-default-71044942 is seen in contrail-api 2026-04-20 01:52:43,307 - DEBUG - Project uuid in Contrail is b58a872c-eb0f-4181-8e21-fc755d395557 2026-04-20 01:52:43,307 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=36050ae1-569b-49a9-9b0d-bc81e11a7f61 2026-04-20 01:52:43,311 - INFO - Namespace ctest-non-default-71044942 with uuid 36050ae1-569b-49a9-9b0d-bc81e11a7f61 found in kube manager 2026-04-20 01:52:43,311 - INFO - Namespace ctest-non-default-71044942 verification passed 2026-04-20 01:52:43,317 - DEBUG - Pod ctest-pod-93178753 not in running state.Currently in Pending 2026-04-20 01:52:48,325 - DEBUG - Pod ctest-pod-93178753 not in running state.Currently in Pending 2026-04-20 01:52:53,332 - INFO - Pod ctest-pod-93178753 is in running state.Got IP 10.47.255.251 2026-04-20 01:52:53,383 - DEBUG - Pod ctest-pod-93178753 has vmi 9f7b411e-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:52:53,384 - INFO - Verified pod ctest-pod-93178753 in contrail-api 2026-04-20 01:52:53,393 - DEBUG - VMI 9f7b411e-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:52:53,393 - INFO - Verified Pod ctest-pod-93178753 in agent 10.0.0.241 2026-04-20 01:52:53,393 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=0dcdcd31-809a-40e1-a1d8-9032c4c022af 2026-04-20 01:52:53,396 - INFO - Pod ctest-pod-93178753 with uuid 0dcdcd31-809a-40e1-a1d8-9032c4c022af found in kube manager 2026-04-20 01:52:53,396 - INFO - Pod ctest-pod-93178753 verification passed 2026-04-20 01:52:53,402 - DEBUG - Pod ctest-pod-52138584 not in running state.Currently in Pending 2026-04-20 01:52:58,409 - INFO - Pod ctest-pod-52138584 is in running state.Got IP 10.47.255.250 2026-04-20 01:52:58,420 - DEBUG - Pod ctest-pod-52138584 has vmi 9fe6ecc0-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:52:58,420 - INFO - Verified pod ctest-pod-52138584 in contrail-api 2026-04-20 01:52:58,434 - DEBUG - VMI 9fe6ecc0-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:52:58,434 - INFO - Verified Pod ctest-pod-52138584 in agent 10.0.0.241 2026-04-20 01:52:58,434 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=19a1a35a-a8b9-4209-81e9-f694c4d2920d 2026-04-20 01:52:58,438 - INFO - Pod ctest-pod-52138584 with uuid 19a1a35a-a8b9-4209-81e9-f694c4d2920d found in kube manager 2026-04-20 01:52:58,438 - INFO - Pod ctest-pod-52138584 verification passed 2026-04-20 01:52:58,444 - INFO - Pod ctest-pod-77560170 is in running state.Got IP 10.47.255.249 2026-04-20 01:52:58,455 - DEBUG - Pod ctest-pod-77560170 has vmi a06af916-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:52:58,455 - INFO - Verified pod ctest-pod-77560170 in contrail-api 2026-04-20 01:52:58,468 - DEBUG - VMI a06af916-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:52:58,468 - INFO - Verified Pod ctest-pod-77560170 in agent 10.0.0.241 2026-04-20 01:52:58,468 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=037cde93-ee69-4264-b978-8ea48e8da28d 2026-04-20 01:52:58,471 - INFO - Pod ctest-pod-77560170 with uuid 037cde93-ee69-4264-b978-8ea48e8da28d found in kube manager 2026-04-20 01:52:58,472 - INFO - Pod ctest-pod-77560170 verification passed 2026-04-20 01:52:58,477 - INFO - Pod ctest-pod-59946328 is in running state.Got IP 10.47.255.248 2026-04-20 01:52:58,530 - DEBUG - Pod ctest-pod-59946328 has vmi a0db59e0-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:52:58,530 - INFO - Verified pod ctest-pod-59946328 in contrail-api 2026-04-20 01:52:58,543 - DEBUG - VMI a0db59e0-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:52:58,543 - INFO - Verified Pod ctest-pod-59946328 in agent 10.0.0.241 2026-04-20 01:52:58,543 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=eb7fbdba-4120-4cdb-ac46-bdcda3361f05 2026-04-20 01:52:58,546 - INFO - Pod ctest-pod-59946328 with uuid eb7fbdba-4120-4cdb-ac46-bdcda3361f05 found in kube manager 2026-04-20 01:52:58,546 - INFO - Pod ctest-pod-59946328 verification passed 2026-04-20 01:52:58,552 - DEBUG - Pod ctest-pod-28247758 not in running state.Currently in Pending 2026-04-20 01:53:03,559 - INFO - Pod ctest-pod-28247758 is in running state.Got IP 10.47.255.247 2026-04-20 01:53:03,570 - DEBUG - Pod ctest-pod-28247758 has vmi a15b8f98-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:53:03,570 - INFO - Verified pod ctest-pod-28247758 in contrail-api 2026-04-20 01:53:03,581 - DEBUG - VMI a15b8f98-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:53:03,582 - INFO - Verified Pod ctest-pod-28247758 in agent 10.0.0.241 2026-04-20 01:53:03,582 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=40460bbf-554e-4796-a826-412e5cea5039 2026-04-20 01:53:03,586 - INFO - Pod ctest-pod-28247758 with uuid 40460bbf-554e-4796-a826-412e5cea5039 found in kube manager 2026-04-20 01:53:03,586 - INFO - Pod ctest-pod-28247758 verification passed 2026-04-20 01:53:03,591 - INFO - Pod ctest-pod-04563316 is in running state.Got IP 10.47.255.245 2026-04-20 01:53:03,650 - DEBUG - Pod ctest-pod-04563316 has vmi a221cf32-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:53:03,650 - INFO - Verified pod ctest-pod-04563316 in contrail-api 2026-04-20 01:53:03,661 - DEBUG - VMI a221cf32-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:53:03,661 - INFO - Verified Pod ctest-pod-04563316 in agent 10.0.0.241 2026-04-20 01:53:03,661 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=d1867651-a242-406a-bc4e-b6e68b5e6473 2026-04-20 01:53:03,665 - INFO - Pod ctest-pod-04563316 with uuid d1867651-a242-406a-bc4e-b6e68b5e6473 found in kube manager 2026-04-20 01:53:03,665 - INFO - Pod ctest-pod-04563316 verification passed 2026-04-20 01:53:03,671 - INFO - Pod ctest-pod-15119937 is in running state.Got IP 10.47.255.246 2026-04-20 01:53:03,723 - DEBUG - Pod ctest-pod-15119937 has vmi a1bac238-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:53:03,724 - INFO - Verified pod ctest-pod-15119937 in contrail-api 2026-04-20 01:53:03,734 - DEBUG - VMI a1bac238-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:53:03,734 - INFO - Verified Pod ctest-pod-15119937 in agent 10.0.0.241 2026-04-20 01:53:03,734 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=86ef506e-2810-4607-8677-7c7f66c20851 2026-04-20 01:53:03,738 - INFO - Pod ctest-pod-15119937 with uuid 86ef506e-2810-4607-8677-7c7f66c20851 found in kube manager 2026-04-20 01:53:03,738 - INFO - Pod ctest-pod-15119937 verification passed 2026-04-20 01:53:03,744 - INFO - Pod ctest-pod-95281319 is in running state.Got IP 10.47.255.244 2026-04-20 01:53:03,754 - DEBUG - Pod ctest-pod-95281319 has vmi a281a3c6-3c5b-11f1-b697-fa163e875db9 2026-04-20 01:53:03,754 - INFO - Verified pod ctest-pod-95281319 in contrail-api 2026-04-20 01:53:03,767 - DEBUG - VMI a281a3c6-3c5b-11f1-b697-fa163e875db9 is active in agent 10.0.0.241 2026-04-20 01:53:03,767 - INFO - Verified Pod ctest-pod-95281319 in agent 10.0.0.241 2026-04-20 01:53:03,767 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=3dff4115-a6ba-4374-b1be-8f4bf3164c98 2026-04-20 01:53:03,770 - INFO - Pod ctest-pod-95281319 with uuid 3dff4115-a6ba-4374-b1be-8f4bf3164c98 found in kube manager 2026-04-20 01:53:03,770 - INFO - Pod ctest-pod-95281319 verification passed 2026-04-20 01:53:03,770 - INFO - ================================================================================ 2026-04-20 01:53:03,770 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-04-20 01:53:03,771 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-04-20 01:53:04,001 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.0.0.19': '0'}} with 2026-04-20 01:53:04,001 - INFO - Initial checks done. Running the testcase now 2026-04-20 01:53:04,001 - INFO - 2026-04-20 01:53:04,058 - DEBUG - [Pod ctest-pod-93178753] Cmd: echo ctest-pod-93178753 > /usr/share/nginx/html/index.html, Output: 2026-04-20 01:53:04,115 - DEBUG - [Pod ctest-pod-52138584] Cmd: echo ctest-pod-52138584 > /usr/share/nginx/html/index.html, Output: 2026-04-20 01:53:04,183 - DEBUG - [Pod ctest-pod-77560170] Cmd: echo ctest-pod-77560170 > /usr/share/nginx/html/index.html, Output: 2026-04-20 01:53:04,243 - DEBUG - [Pod ctest-pod-59946328] Cmd: echo ctest-pod-59946328 > /usr/share/nginx/html/index.html, Output: 2026-04-20 01:53:04,249 - DEBUG - Service ctest-nginx-svc-69291308 not present 2026-04-20 01:53:04,249 - INFO - Creating service ctest-nginx-svc-69291308 2026-04-20 01:53:04,266 - INFO - Created Service ctest-nginx-svc-69291308 2026-04-20 01:53:04,284 - WARNING - Service UUID ea4e678c-9d7e-4464-b55d-3c6ac579a2b9 not yet found in contrail-api 2026-04-20 01:53:05,298 - INFO - Validated that Service ctest-nginx-svc-69291308 is seen in contrail-api 2026-04-20 01:53:05,298 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=ea4e678c-9d7e-4464-b55d-3c6ac579a2b9 2026-04-20 01:53:05,302 - INFO - Service ctest-nginx-svc-69291308 with uuid ea4e678c-9d7e-4464-b55d-3c6ac579a2b9 found in kube manager 2026-04-20 01:53:05,302 - INFO - Service ctest-nginx-svc-69291308 verification passed 2026-04-20 01:53:06,379 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52138584 2026-04-20 01:53:06,379 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:53:06,379 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52138584 2026-04-20 01:53:06,434 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) ctest-pod-93178753 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:06,434 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:53:06,434 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) ctest-pod-93178753 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:06,434 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93178753': 1, 'ctest-pod-52138584': 1} 2026-04-20 01:53:06,494 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:06,494 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:53:06,494 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:06,548 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-93178753 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:06,548 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:53:06,548 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: ctest-pod-93178753 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:06,548 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93178753': 1, 'ctest-pod-52138584': 1} 2026-04-20 01:53:06,552 - DEBUG - Network policy ingress-on-service not present 2026-04-20 01:53:06,553 - INFO - Creating Network Policy ingress-on-service 2026-04-20 01:53:06,569 - INFO - Network policy found in k8s 2026-04-20 01:53:06,569 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d32fcf87-b7fa-4d4b-94cb-7d7a7dc3a13b 2026-04-20 01:53:06,573 - INFO - Network Policy ingress-on-service with uuid d32fcf87-b7fa-4d4b-94cb-7d7a7dc3a13b found in kube manager 2026-04-20 01:53:06,601 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-04-20 01:53:06,602 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-04-20 01:53:06,602 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d32fcf87-b7fa-4d4b-94cb-7d7a7dc3a13b 2026-04-20 01:53:06,629 - WARNING - Network policy with name ingress-on-service not found in agent 2026-04-20 01:53:08,631 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d32fcf87-b7fa-4d4b-94cb-7d7a7dc3a13b 2026-04-20 01:53:08,654 - INFO - Network policy with name ingress-on-service found in agent 2026-04-20 01:53:08,655 - INFO - Network Policy ingress-on-service verification passed 2026-04-20 01:53:13,725 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:13,725 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:13,725 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:18,777 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:18,777 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:18,777 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:23,830 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:23,830 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:23,830 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:28,889 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:28,889 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:28,889 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:33,950 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:33,950 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:33,950 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:39,001 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:39,001 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:39,001 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:44,060 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:44,060 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:44,060 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:49,109 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:49,109 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:49,109 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:54,156 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:54,156 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:54,157 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:59,206 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:59,206 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:53:59,206 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:53:59,206 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93178753': 0, 'ctest-pod-52138584': 0} 2026-04-20 01:53:59,270 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:59,270 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:53:59,270 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:53:59,323 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93178753 2026-04-20 01:53:59,323 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:53:59,323 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93178753 2026-04-20 01:53:59,323 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93178753': 1, 'ctest-pod-52138584': 1} 2026-04-20 01:54:04,379 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:04,379 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:04,379 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:09,429 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:09,429 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:09,429 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:14,489 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:14,490 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:14,490 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:19,541 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:19,541 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:19,541 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:24,593 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:24,593 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:24,593 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:29,649 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:29,649 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:29,649 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:34,697 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:34,697 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:34,697 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:39,751 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:39,751 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:39,751 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:44,801 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:44,801 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:44,801 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:49,850 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:49,850 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:54:49,850 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:54:49,850 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93178753': 0, 'ctest-pod-52138584': 0} 2026-04-20 01:54:51,903 - DEBUG - [Pod ctest-pod-15119937] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.171 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.103 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.451/1.171 ms 2026-04-20 01:54:51,904 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-15119937 with expectation True passed 2026-04-20 01:54:53,960 - DEBUG - [Pod ctest-pod-28247758] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.039 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.407/1.039 ms 2026-04-20 01:54:53,961 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28247758 with expectation True passed 2026-04-20 01:54:56,013 - DEBUG - [Pod ctest-pod-04563316] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.803 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.325/0.803 ms 2026-04-20 01:54:56,013 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04563316 with expectation True passed 2026-04-20 01:54:56,068 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-93178753 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:54:56,068 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-04-20 01:54:56,068 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-93178753 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:54:56,068 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15119937 passed 2026-04-20 01:54:56,131 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52138584 2026-04-20 01:54:56,132 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-04-20 01:54:56,132 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52138584 2026-04-20 01:54:56,132 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15119937 passed 2026-04-20 01:55:01,188 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-04-20 01:55:01,188 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-04-20 01:55:01,188 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-04-20 01:55:01,188 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28247758 passed 2026-04-20 01:55:06,242 - DEBUG - [Pod ctest-pod-95281319] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-04-20 01:55:06,243 - DEBUG - [Pod Pod ctest-pod-95281319] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed. 2026-04-20 01:55:06,243 - DEBUG - [Pod Pod ctest-pod-95281319] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-04-20 01:55:06,243 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95281319 passed 2026-04-20 01:55:06,251 - INFO - Updating Network Policy ingress-on-service 2026-04-20 01:55:11,314 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:11,314 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:11,314 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:16,371 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:16,371 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:16,371 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:21,428 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:21,428 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:21,428 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:26,474 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:26,475 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:26,475 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:31,525 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:31,526 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:31,526 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:36,585 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:36,585 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:36,585 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:41,637 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:41,638 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:41,638 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:46,703 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:46,703 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:46,703 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:51,761 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:51,761 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:51,761 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:56,816 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:56,817 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 failed. 2026-04-20 01:55:56,817 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) wget: download timed out 2026-04-20 01:55:56,817 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93178753': 0, 'ctest-pod-52138584': 0} 2026-04-20 01:55:56,872 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:56,872 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:56,872 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:56,935 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:56,935 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:56,935 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:56,985 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:56,985 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:56,985 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,039 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,039 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,039 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,096 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-93178753 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,096 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,096 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-93178753 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,096 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93178753': 1, 'ctest-pod-52138584': 4} 2026-04-20 01:55:57,161 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,161 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,161 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,226 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,226 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,226 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,280 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,280 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,280 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,336 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52138584 2026-04-20 01:55:57,336 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,336 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52138584 2026-04-20 01:55:57,394 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,394 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,394 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: ctest-pod-52138584 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,454 - DEBUG - [Pod ctest-pod-04563316] Cmd: wget http://10.110.72.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-93178753 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,454 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd wget http://10.110.72.43:80/ -O - -T 5 -t 1 passed 2026-04-20 01:55:57,454 - DEBUG - [Pod Pod ctest-pod-04563316] Cmd output: ctest-pod-93178753 Connecting to 10.110.72.43:80 (10.110.72.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:55:57,454 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93178753': 1, 'ctest-pod-52138584': 5} 2026-04-20 01:55:59,518 - DEBUG - [Pod ctest-pod-15119937] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.304 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.110 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.098/0.504/1.304 ms 2026-04-20 01:55:59,518 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-15119937 with expectation True passed 2026-04-20 01:56:01,583 - DEBUG - [Pod ctest-pod-28247758] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.587 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.586/1.587 ms 2026-04-20 01:56:01,583 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28247758 with expectation True passed 2026-04-20 01:56:03,638 - DEBUG - [Pod ctest-pod-04563316] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.762 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.314/0.762 ms 2026-04-20 01:56:03,638 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04563316 with expectation True passed 2026-04-20 01:56:03,691 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93178753 2026-04-20 01:56:03,691 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-04-20 01:56:03,691 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93178753 2026-04-20 01:56:03,691 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15119937 passed 2026-04-20 01:56:03,752 - DEBUG - [Pod ctest-pod-15119937] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-52138584 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:56:03,752 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-04-20 01:56:03,752 - DEBUG - [Pod Pod ctest-pod-15119937] Cmd output: ctest-pod-52138584 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:56:03,752 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15119937 passed 2026-04-20 01:56:05,200 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2026-04-20 01:56:15,261 - DEBUG - [Pod ctest-pod-28247758] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-04-20 01:56:15,261 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-04-20 01:56:15,261 - DEBUG - [Pod Pod ctest-pod-28247758] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-04-20 01:56:15,261 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28247758 passed 2026-04-20 01:56:15,315 - DEBUG - [Pod ctest-pod-95281319] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-93178753 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:56:15,315 - DEBUG - [Pod Pod ctest-pod-95281319] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-04-20 01:56:15,315 - DEBUG - [Pod Pod ctest-pod-95281319] Cmd output: ctest-pod-93178753 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-04-20 01:56:15,315 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95281319 passed 2026-04-20 01:56:15,315 - INFO - Deleting Network Policy : ingress-on-service 2026-04-20 01:56:15,315 - INFO - Deleting service : ctest-nginx-svc-69291308 2026-04-20 01:56:15,580 - DEBUG - No XMPP flaps were noticed during the test