2026-04-20 02:23:51,210 - INFO - Domain Default found not creating
2026-04-20 02:23:51,366 - INFO - Project ctest-TestRouters-35627001 not found, creating it
2026-04-20 02:23:51,927 - INFO - Created Project:ctest-TestRouters-35627001, ID : 230236ac-a7aa-495b-96a6-5115dd7122cb
2026-04-20 02:23:53,577 - INFO - ================================================================================
2026-04-20 02:23:53,577 - INFO - STARTING TEST : test_basic_router_behavior
2026-04-20 02:23:53,577 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-04-20 02:23:54,858 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.65': {'10.20.0.25': '0', '10.20.0.129': '0'}} with
2026-04-20 02:23:54,858 - INFO - Initial checks done. Running the testcase now
2026-04-20 02:23:54,859 - INFO -
2026-04-20 02:23:55,555 - DEBUG - Response for create_network : {'network': {'id': '03595b82-7873-4aef-8dee-8771729fef75', 'name': 'ctest-vn1-01723385', 'tenant_id': '230236aca7aa495b96a65115dd7122cb', 'project_id': '230236aca7aa495b96a65115dd7122cb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-35627001', 'ctest-vn1-01723385'], 'port_security_enabled': True, 'description': ''}}
2026-04-20 02:23:55,877 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e7f1fce9-cd3e-46a1-9e4d-4af7b407b70b', 'name': '', 'tenant_id': '230236aca7aa495b96a65115dd7122cb', 'network_id': '03595b82-7873-4aef-8dee-8771729fef75', 'ip_version': 4, 'cidr': '130.46.203.64/26', 'allocation_pools': [{'start': '130.46.203.66', 'end': '130.46.203.126'}], 'gateway_ip': '130.46.203.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '130.46.203.66', 'tags': [], 'project_id': '230236aca7aa495b96a65115dd7122cb'}}
2026-04-20 02:23:55,900 - INFO - Created VN ctest-vn1-01723385
2026-04-20 02:23:55,911 - DEBUG - VN ctest-vn1-01723385 UUID is 03595b82-7873-4aef-8dee-8771729fef75
2026-04-20 02:23:56,277 - DEBUG - Response for create_network : {'network': {'id': '4917626d-ee88-44d4-b500-5221d6eb4a26', 'name': 'ctest-vn2-84284301', 'tenant_id': '230236aca7aa495b96a65115dd7122cb', 'project_id': '230236aca7aa495b96a65115dd7122cb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-35627001', 'ctest-vn2-84284301'], 'port_security_enabled': True, 'description': ''}}
2026-04-20 02:23:56,542 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bbbd7daa-53fd-45dc-98e2-2236c2c1d7c6', 'name': '', 'tenant_id': '230236aca7aa495b96a65115dd7122cb', 'network_id': '4917626d-ee88-44d4-b500-5221d6eb4a26', 'ip_version': 4, 'cidr': '217.152.150.128/26', 'allocation_pools': [{'start': '217.152.150.130', 'end': '217.152.150.190'}], 'gateway_ip': '217.152.150.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '217.152.150.130', 'tags': [], 'project_id': '230236aca7aa495b96a65115dd7122cb'}}
2026-04-20 02:23:56,561 - INFO - Created VN ctest-vn2-84284301
2026-04-20 02:23:56,571 - DEBUG - VN ctest-vn2-84284301 UUID is 4917626d-ee88-44d4-b500-5221d6eb4a26
2026-04-20 02:23:56,736 - DEBUG - Services list from nova: [, , , ]
2026-04-20 02:23:57,868 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-2)
2026-04-20 02:23:59,261 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-1)
2026-04-20 02:23:59,406 - INFO - Adding interface with subnet_id e7f1fce9-cd3e-46a1-9e4d-4af7b407b70b, port_id None to router 9ea1c01d-9a0a-41a8-986f-90aae7bba95a
2026-04-20 02:23:59,742 - INFO - Waiting for VM ctest-vn1-vm1-58571176 to be up..
2026-04-20 02:23:59,896 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-04-20 02:24:05,028 - DEBUG - VM is in ACTIVE state now
2026-04-20 02:24:05,029 - INFO - VM name : ctest-vn1-vm1-58571176
2026-04-20 02:24:05,138 - DEBUG - VM ctest-vn1-vm1-58571176 ID is 7427d9a5-5c66-4e35-ad40-0450fccabc44
2026-04-20 02:24:05,180 - DEBUG - VM ctest-vn1-vm1-58571176 launched on Node an-jenkins-deploy-platform-ansible-os-5644-2
2026-04-20 02:24:05,305 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/7427d9a5-5c66-4e35-ad40-0450fccabc44
2026-04-20 02:24:05,640 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/7427d9a5-5c66-4e35-ad40-0450fccabc44
2026-04-20 02:24:05,683 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/fad0eca0-9221-40ab-badf-4ba200669438
2026-04-20 02:24:08,892 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms')
2026-04-20 02:24:08,893 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-58571176 failed!
2026-04-20 02:24:08,908 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-35627001:ctest-vn1-01723385 is 130.46.203.65 and allocation pool is NOT set
2026-04-20 02:24:10,990 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=11.3 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.22 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.220/7.250/11.281/4.030 ms')
2026-04-20 02:24:10,990 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-58571176 passed
2026-04-20 02:24:11,059 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-20 02:24:11,059 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-58571176, IP 130.46.203.67, Port 22
2026-04-20 02:24:11,132 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-20 02:24:11,222 - DEBUG - VM ctest-vn1-vm1-58571176 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-20 02:24:16,223 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-20 02:24:16,223 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-58571176, IP 130.46.203.67, Port 22
2026-04-20 02:24:16,395 - DEBUG - VM ctest-vn1-vm1-58571176 is ready for SSH connections
2026-04-20 02:24:16,395 - INFO - Waiting for VM ctest-vn2-vm1-67845952 to be up..
2026-04-20 02:24:16,487 - DEBUG - VM is in ACTIVE state now
2026-04-20 02:24:16,488 - INFO - VM name : ctest-vn2-vm1-67845952
2026-04-20 02:24:16,583 - DEBUG - VM ctest-vn2-vm1-67845952 ID is 4081a999-d036-4b21-ba22-7014e5f27ae1
2026-04-20 02:24:16,583 - DEBUG - VM ctest-vn2-vm1-67845952 launched on Node an-jenkins-deploy-platform-ansible-os-5644-1
2026-04-20 02:24:16,680 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4081a999-d036-4b21-ba22-7014e5f27ae1
2026-04-20 02:24:16,691 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/98d61e64-f98d-4e40-a71e-6c1b169b3a3e
2026-04-20 02:24:17,860 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.63 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.368 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.368/1.498/2.629/1.130 ms')
2026-04-20 02:24:17,860 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-67845952 passed
2026-04-20 02:24:17,928 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-20 02:24:17,928 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-67845952, IP 217.152.150.131, Port 22
2026-04-20 02:24:18,111 - DEBUG - VM ctest-vn2-vm1-67845952 is ready for SSH connections
2026-04-20 02:24:18,111 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-20 02:24:18,112 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 217.152.150.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-04-20 02:24:18,112 - DEBUG - ping -s 56 -c 3 -W 1 217.152.150.131
2026-04-20 02:24:22,065 - DEBUG - PING 217.152.150.131 (217.152.150.131): 56 data bytes
--- 217.152.150.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-04-20 02:24:22,065 - WARNING - Ping to IP 217.152.150.131 from VM ctest-vn1-vm1-58571176 failed
2026-04-20 02:24:22,065 - INFO - Adding interface with subnet_id bbbd7daa-53fd-45dc-98e2-2236c2c1d7c6, port_id None to router 9ea1c01d-9a0a-41a8-986f-90aae7bba95a
2026-04-20 02:24:22,467 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-20 02:24:22,468 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 217.152.150.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-04-20 02:24:22,468 - DEBUG - ping -s 56 -c 3 -W 1 217.152.150.131
2026-04-20 02:24:25,681 - DEBUG - PING 217.152.150.131 (217.152.150.131): 56 data bytes
64 bytes from 217.152.150.131: seq=1 ttl=63 time=5.062 ms
64 bytes from 217.152.150.131: seq=2 ttl=63 time=1.276 ms
--- 217.152.150.131 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.276/3.169/5.062 ms
2026-04-20 02:24:25,681 - WARNING - Ping to IP 217.152.150.131 from VM ctest-vn1-vm1-58571176 failed
2026-04-20 02:24:26,681 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 217.152.150.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-04-20 02:24:26,682 - DEBUG - ping -s 56 -c 3 -W 1 217.152.150.131
2026-04-20 02:24:28,880 - DEBUG - PING 217.152.150.131 (217.152.150.131): 56 data bytes
64 bytes from 217.152.150.131: seq=0 ttl=63 time=3.470 ms
64 bytes from 217.152.150.131: seq=1 ttl=63 time=1.465 ms
64 bytes from 217.152.150.131: seq=2 ttl=63 time=1.320 ms
--- 217.152.150.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.320/2.085/3.470 ms
2026-04-20 02:24:28,881 - INFO - Ping to IP 217.152.150.131 from VM ctest-vn1-vm1-58571176 passed
2026-04-20 02:24:28,881 - INFO - Deleting interface with subnet_id e7f1fce9-cd3e-46a1-9e4d-4af7b407b70b, port_id None from router 9ea1c01d-9a0a-41a8-986f-90aae7bba95a
2026-04-20 02:24:29,094 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-20 02:24:29,095 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 217.152.150.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-04-20 02:24:29,095 - DEBUG - ping -s 56 -c 3 -W 1 217.152.150.131
2026-04-20 02:24:32,292 - DEBUG - PING 217.152.150.131 (217.152.150.131): 56 data bytes
--- 217.152.150.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-04-20 02:24:32,293 - WARNING - Ping to IP 217.152.150.131 from VM ctest-vn1-vm1-58571176 failed
2026-04-20 02:24:32,293 - INFO - Adding interface with subnet_id e7f1fce9-cd3e-46a1-9e4d-4af7b407b70b, port_id None to router 9ea1c01d-9a0a-41a8-986f-90aae7bba95a
2026-04-20 02:24:32,623 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-20 02:24:32,623 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 217.152.150.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-04-20 02:24:32,623 - DEBUG - ping -s 56 -c 3 -W 1 217.152.150.131
2026-04-20 02:24:34,815 - DEBUG - PING 217.152.150.131 (217.152.150.131): 56 data bytes
64 bytes from 217.152.150.131: seq=0 ttl=63 time=2.942 ms
64 bytes from 217.152.150.131: seq=1 ttl=63 time=1.968 ms
64 bytes from 217.152.150.131: seq=2 ttl=63 time=1.569 ms
--- 217.152.150.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.569/2.159/2.942 ms
2026-04-20 02:24:34,816 - INFO - Ping to IP 217.152.150.131 from VM ctest-vn1-vm1-58571176 passed
2026-04-20 02:24:34,816 - INFO - Deleting interface with subnet_id bbbd7daa-53fd-45dc-98e2-2236c2c1d7c6, port_id None from router 9ea1c01d-9a0a-41a8-986f-90aae7bba95a
2026-04-20 02:24:35,111 - INFO - Deleting interface with subnet_id e7f1fce9-cd3e-46a1-9e4d-4af7b407b70b, port_id None from router 9ea1c01d-9a0a-41a8-986f-90aae7bba95a
2026-04-20 02:24:35,411 - INFO - Deleting VM ctest-vn2-vm1-67845952
2026-04-20 02:24:35,506 - INFO - Deleting VM ctest-vn1-vm1-58571176
2026-04-20 02:24:35,583 - INFO - Deleting VN ctest-vn2-84284301
2026-04-20 02:24:35,628 - DEBUG - VN 4917626d-ee88-44d4-b500-5221d6eb4a26 still in use: Unable to complete operation on network 4917626d-ee88-44d4-b500-5221d6eb4a26. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-23f26fc2-9181-4038-beff-f18dc136f76c']
2026-04-20 02:24:35,628 - WARNING - Deleting VN ctest-vn2-84284301 failed..Will retry
2026-04-20 02:24:37,809 - DEBUG - Response for deleting network ()
2026-04-20 02:24:37,810 - INFO - Deleting VN ctest-vn1-01723385
2026-04-20 02:24:38,027 - DEBUG - Response for deleting network ()
2026-04-20 02:24:39,318 - DEBUG - No XMPP flaps were noticed during the test
2026-04-20 02:24:39,318 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:46]
2026-04-20 02:24:39,319 - INFO - --------------------------------------------------------------------------------
2026-04-20 02:24:40,044 - INFO - Deleted project: ctest-TestRouters-35627001, ID : 230236ac-a7aa-495b-96a6-5115dd7122cb