2025-12-11 Thu 02:02:20:588.381 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-11 00:10:34.361562", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13006-1.novalocal", "build-id": "v0+nightly", "build-number": "202512110009"}]} src/contrail-common/base/misc_utils.cc 39 2025-12-11 Thu 02:02:20:588.459 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: ROLE : Generator 2025-12-11 Thu 02:02:20:588.467 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: MODULE : contrail-dns 2025-12-11 Thu 02:02:20:588.472 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-4881-1 2025-12-11 Thu 02:02:20:588.477 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: NODE TYPE : Control 2025-12-11 Thu 02:02:20:588.482 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: INSTANCE ID : 0 2025-12-11 Thu 02:02:20:588.487 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: HTTP SERVER PORT : 8092 2025-12-11 Thu 02:02:20:588.493 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-12-11 Thu 02:02:20:590.945 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: HTTP Introspect Init 2025-12-11 Thu 02:02:20:592.388 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-12-11 Thu 02:02:20:592.473 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: Sandesh Http Server Port: 8092 2025-12-11 Thu 02:02:20:592.546 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.68488.http_port 2025-12-11 Thu 02:02:20:592.554 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: CONNECT TO COLLECTOR: 1 2025-12-11 Thu 02:02:20:592.881 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: Idle 2025-12-11 Thu 02:02:20:593.119 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: No Client: 1765418540593049 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:20:593.238 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: Logging: DISABLED -> ENABLED 2025-12-11 Thu 02:02:20:593.252 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-12-11 Thu 02:02:20:593.490 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Processing scm::EvStart in state Idle 2025-12-11 Thu 02:02:20:593.566 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Disconnect 2025-12-11 Thu 02:02:20:594.055 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Processing scm::EvCollectorUpdate in state Disconnect 2025-12-11 Thu 02:02:20:594.371 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Connect : Start Connect timer 10.0.0.57:8086 2025-12-11 Thu 02:02:20:594.428 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:594.492 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: SANDESH: Send FAILED: 1765418540594038 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:20:594.508 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:20:594.516 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:594.563 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: SANDESH: Send FAILED: 1765418540594228 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:20:594.572 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:20:594.582 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:594.620 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: SANDESH: Send FAILED: 1765418540594417 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:20:594.628 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:20:727.257 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.193:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-12-11 Thu 02:02:20:727.363 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 401 2025-12-11 Thu 02:02:20:727.441 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 281 2025-12-11 Thu 02:02:20:727.545 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 157 2025-12-11 Thu 02:02:20:727.558 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-12-11 Thu 02:02:20:727.568 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:727.610 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: SANDESH: Send FAILED: 1765418540727529 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-12-11 Thu 02:02:20:727.620 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:735.878 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 150 2025-12-11 Thu 02:02:20:735.907 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:737.575 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 285 2025-12-11 Thu 02:02:20:737.626 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: SANDESH: Send FAILED: 1765418540735833 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-12-11 Thu 02:02:20:737.638 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:737.655 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 579 2025-12-11 Thu 02:02:20:737.659 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:737.673 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-12-11 Thu 02:02:20:737.714 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: SANDESH: Send FAILED: 1765418540737641 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-12-11 Thu 02:02:20:737.725 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:759.407 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 94 2025-12-11 Thu 02:02:20:759.880 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 103 2025-12-11 Thu 02:02:20:759.914 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 109 2025-12-11 Thu 02:02:20:759.968 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:759.977 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 392 2025-12-11 Thu 02:02:20:760.144 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:760.184 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: SANDESH: Send FAILED: 1765418540759943 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:20:760.193 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:761.532 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:762.748 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:763.550 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:764.631 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:765.940 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:766.425 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:766.798 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:767.330 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:767.934 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:768.684 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:769.282 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:769.802 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:771.011 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:772.018 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:772.390 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:772.924 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:773.569 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:774.419 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:774.934 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:775.426 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:775.858 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:776.345 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:776.771 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:777.235 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:777.679 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:778.390 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:778.819 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:779.258 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:779.692 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:780.771 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:781.353 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:782.069 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:782.818 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:783.416 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:783.919 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:784.492 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:785.009 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:785.541 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:786.052 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:786.518 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:787.180 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:787.755 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:788.320 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:788.938 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:789.519 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:790.359 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:790.883 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:791.423 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:791.889 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:792.457 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:793.031 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:793.602 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:794.459 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:795.049 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:795.637 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:796.144 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:796.800 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:797.477 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:798.460 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:799.364 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:799.892 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:800.516 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:801.205 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:802.089 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:802.760 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:804.050 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:805.122 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:805.555 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:806.168 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:806.709 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:807.348 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:807.798 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:808.224 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:808.591 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:809.855 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:810.489 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:810.841 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:811.348 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:811.748 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:813.815 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:814.790 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:815.339 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:816.008 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:816.657 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:817.356 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:817.941 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:818.550 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:819.264 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:820.020 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:820.806 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:821.483 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:822.305 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:823.130 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:823.665 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:824.519 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:824.891 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:825.468 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:825.861 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:826.376 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:826.746 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:827.407 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:828.283 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:828.692 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:829.087 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:829.726 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:830.122 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:830.524 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:831.571 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:835.163 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:835.845 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:836.276 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:836.678 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:837.118 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:838.960 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:842.595 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:843.660 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:844.289 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:844.870 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:844.935 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-11 Thu 02:02:20:845.018 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-11 Thu 02:02:20:845.035 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360189724224, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-11 Thu 02:02:20:845.093 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-11 Thu 02:02:20:845.136 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360181327424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-11 Thu 02:02:20:845.149 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-11 Thu 02:02:20:845.206 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-11 Thu 02:02:20:845.206 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 553 2025-12-11 Thu 02:02:20:845.256 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 187 2025-12-11 Thu 02:02:20:845.274 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 216 2025-12-11 Thu 02:02:20:845.294 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:845.326 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: SANDESH: Send FAILED: 1765418540845278 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:20:845.334 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:859.710 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:859.935 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:859.984 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:859.999 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.012 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.028 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.039 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.054 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.073 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.094 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.106 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.115 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.134 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.145 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.155 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.168 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.178 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.192 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.228 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.250 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.267 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.662 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:860.752 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.794 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.814 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.830 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.842 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.866 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.885 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.901 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.919 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.934 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.948 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:860.960 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:860.977 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.111 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:861.176 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.196 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.209 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.221 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.236 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.247 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.265 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.273 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 224d6dda-c3a7-46dd-a1db-3eeb39a2fff1 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-11 Thu 02:02:20:861.369 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.391 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.402 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 81749e09-9198-4109-a36f-344ebee68585 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-11 Thu 02:02:20:861.410 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.428 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.456 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.473 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.484 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.495 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.512 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.535 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.565 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.602 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:861.705 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.730 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.785 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.808 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.846 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.872 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.884 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.897 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.907 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.926 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.938 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.950 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:861.975 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:861.989 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:862.000 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:862.014 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360168732224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:862.208 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360181327424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:862.287 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:862.309 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:862.321 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:862.324 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360181327424, Pid 68573]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 482858c3-4bb7-4709-8a43-457f0f47c831 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-11 Thu 02:02:20:862.493 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:862.520 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:862.543 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:862.558 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:862.559 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:862.906 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:862.925 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:862.940 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:862.953 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:862.991 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.002 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.013 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.033 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.044 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.065 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.076 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.090 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.100 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.114 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.123 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.132 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.160 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.561 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360189724224, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:863.641 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.674 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.690 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.711 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.740 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.757 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.770 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.784 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.805 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:863.815 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:863.828 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:871.153 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:20:871.288 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:871.323 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0a97c92c-7392-40a9-904e-55783ff62916 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-11 Thu 02:02:20:871.335 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:871.354 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:871.372 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:871.435 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:871.452 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:871.474 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:871.494 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:871.507 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:871.525 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:871.537 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:20:871.551 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:20:872.009 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 83 2025-12-11 Thu 02:02:20:872.034 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 96 2025-12-11 Thu 02:02:20:872.044 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 96 2025-12-11 Thu 02:02:20:872.053 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 2 elements controller/src/dns/main.cc 96 2025-12-11 Thu 02:02:20:872.073 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 0 elements controller/src/dns/main.cc 96 2025-12-11 Thu 02:02:20:872.082 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 96 2025-12-11 Thu 02:02:20:872.090 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 106 2025-12-11 Thu 02:02:20:872.097 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 2 controller/src/dns/main.cc 117 2025-12-11 Thu 02:02:20:872.105 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 128 2025-12-11 Thu 02:02:20:872.120 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 139 2025-12-11 Thu 02:02:20:872.127 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 149 2025-12-11 Thu 02:02:20:872.185 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 157 2025-12-11 Thu 02:02:20:872.195 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-12-11 Thu 02:02:20:872.208 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:872.242 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: SANDESH: Send FAILED: 1765418540872157 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-12-11 Thu 02:02:20:872.250 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:883.581 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 150 2025-12-11 Thu 02:02:20:883.643 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-11 Thu 02:02:20:883.652 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1):EvTcpConnectFail 2025-12-11 Thu 02:02:20:883.682 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:20:883.706 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: SANDESH: Send FAILED: 1765418540883548 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:20:883.714 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:883.732 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvTcpConnectFail in state Connect 2025-12-11 Thu 02:02:20:883.739 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Connect : EvTcpConnectFail 2025-12-11 Thu 02:02:20:883.779 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-11 Thu 02:02:20:883.808 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Idle 2025-12-11 Thu 02:02:20:883.909 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:20:883.928 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: SANDESH: Send FAILED: 1765418540883761 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:20:883.935 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:20:883.942 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-11 Thu 02:02:20:883.995 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:20:884.160 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: SANDESH: Send FAILED: 1765418540883895 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 284, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:20:884.191 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:20:884.209 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360276944448, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 216 2025-12-11 Thu 02:02:20:884.357 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 735 2025-12-11 Thu 02:02:21:884.453 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-11 Thu 02:02:21:885.115 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Connect : Start Connect timer 10.0.0.57:8086 2025-12-11 Thu 02:02:21:885.208 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:21:885.231 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: SANDESH: Send FAILED: 1765418541884926 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:21:885.239 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:21:885.248 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:21:885.356 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: SANDESH: Send FAILED: 1765418541885190 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 286, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 12, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:21:885.381 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:21:885.411 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-11 Thu 02:02:21:885.418 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1):EvTcpConnectFail 2025-12-11 Thu 02:02:21:885.452 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Processing scm::EvTcpConnectFail in state Connect 2025-12-11 Thu 02:02:21:885.462 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Connect : EvTcpConnectFail 2025-12-11 Thu 02:02:21:885.496 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-11 Thu 02:02:21:885.519 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Idle 2025-12-11 Thu 02:02:21:885.580 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:21:885.602 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SANDESH: Send FAILED: 1765418541885483 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:21:885.608 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:21:885.615 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-11 Thu 02:02:21:885.637 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:21:885.734 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SANDESH: Send FAILED: 1765418541885567 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 287, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:21:885.752 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:22:073.452 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 452 2025-12-11 Thu 02:02:22:437.068 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:22:680.835 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:23:885.630 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-11 Thu 02:02:23:885.875 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Connect : Start Connect timer 10.0.0.57:8086 2025-12-11 Thu 02:02:23:885.898 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-11 Thu 02:02:23:885.930 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1):EvTcpConnectFail 2025-12-11 Thu 02:02:23:885.993 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:23:886.018 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418543885705 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:23:886.026 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:23:886.034 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvTcpConnectFail in state Connect 2025-12-11 Thu 02:02:23:886.041 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Connect : EvTcpConnectFail 2025-12-11 Thu 02:02:23:886.083 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-11 Thu 02:02:23:886.110 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Idle 2025-12-11 Thu 02:02:23:886.162 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:23:886.276 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418543885978 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 290, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:23:886.295 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:23:886.304 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:23:886.318 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418543886066 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:23:886.329 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:23:886.335 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-11 Thu 02:02:23:886.356 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:23:886.437 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418543886149 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 291, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:23:886.449 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:27:886.219 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-11 Thu 02:02:27:886.780 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Connect : Start Connect timer 10.0.0.57:8086 2025-12-11 Thu 02:02:27:886.800 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-11 Thu 02:02:27:886.828 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1):EvTcpConnectFail 2025-12-11 Thu 02:02:27:886.882 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:27:886.907 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418547886309 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:27:886.915 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:27:886.924 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvTcpConnectFail in state Connect 2025-12-11 Thu 02:02:27:886.931 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Connect : EvTcpConnectFail 2025-12-11 Thu 02:02:27:886.965 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-11 Thu 02:02:27:886.989 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Idle 2025-12-11 Thu 02:02:27:887.046 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:27:887.193 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418547886865 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 291, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:27:887.220 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:27:887.229 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:27:887.244 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418547886948 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:27:887.250 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:27:887.257 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-11 Thu 02:02:27:887.280 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:27:887.379 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418547887033 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 292, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:27:887.403 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:35:887.098 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-11 Thu 02:02:35:887.316 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Connect : Start Connect timer 10.0.0.57:8086 2025-12-11 Thu 02:02:35:887.341 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-11 Thu 02:02:35:887.373 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1):EvTcpConnectFail 2025-12-11 Thu 02:02:35:887.403 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:35:887.426 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: SANDESH: Send FAILED: 1765418555887165 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:35:887.447 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:35:887.456 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvTcpConnectFail in state Connect 2025-12-11 Thu 02:02:35:887.462 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Connect : EvTcpConnectFail 2025-12-11 Thu 02:02:35:887.495 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-11 Thu 02:02:35:887.520 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Idle 2025-12-11 Thu 02:02:35:887.567 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:35:887.675 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: SANDESH: Send FAILED: 1765418555887388 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 292, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:35:887.694 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:35:887.703 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:35:887.718 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: SANDESH: Send FAILED: 1765418555887479 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:35:887.724 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:35:887.730 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-11 Thu 02:02:35:887.751 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:35:887.833 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: SANDESH: Send FAILED: 1765418555887557 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 293, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:35:887.849 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:48:466.087 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:02:48:466.219 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:02:48:466.249 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:02:50:593.371 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:50:593.436 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418570593256 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 28 dequeues = 28 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 44 dequeues = 44 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1765418555887519 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1765418555887750 ] max_sm_queue_count = 4 ] 2025-12-11 Thu 02:02:50:593.449 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:50:593.457 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:50:593.562 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418570593343 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 63 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 296, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:50:593.585 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:51:887.625 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-11 Thu 02:02:51:887.824 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Connect : Start Connect timer 10.0.0.57:8086 2025-12-11 Thu 02:02:51:887.840 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-11 Thu 02:02:51:887.863 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: -(-1):EvTcpConnectFail 2025-12-11 Thu 02:02:51:887.912 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:02:51:887.934 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418571887676 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:51:887.949 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:51:887.957 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvTcpConnectFail in state Connect 2025-12-11 Thu 02:02:51:887.964 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Connect : EvTcpConnectFail 2025-12-11 Thu 02:02:51:887.997 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-11 Thu 02:02:51:888.023 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Idle 2025-12-11 Thu 02:02:51:888.082 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:51:888.216 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418571887899 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 63 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 296, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:51:888.236 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:02:51:888.246 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:51:888.261 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418571887980 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:02:51:888.267 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:02:51:888.274 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-11 Thu 02:02:51:888.296 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:02:51:888.381 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: SANDESH: Send FAILED: 1765418571888072 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 63 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 297, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:02:51:888.395 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:03:14:865.974 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:03:14:866.099 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:03:14:866.131 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:03:20:593.582 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:03:20:596.746 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418600593435 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 34 dequeues = 34 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 53 dequeues = 53 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1765418571888022 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1765418571888296 ] max_sm_queue_count = 4 ] 2025-12-11 Thu 02:03:20:596.767 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:03:20:596.778 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:03:20:596.904 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: SANDESH: Send FAILED: 1765418600593529 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 156 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 54 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 64 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 300, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 34, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:03:20:596.923 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:03:20:727.482 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Processing scm::EvSandeshSend in state Idle 2025-12-11 Thu 02:03:20:727.526 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: SANDESH: Send FAILED: 1765418600727450 [SYS_NOTICE]: UveDnsInfo: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 start_time = 1765418540727348 build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-11 00:10:34.361562", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13006-1.novalocal", "build-id": "v0+nightly", "build-number": "202512110009"}]} collector = 10.0.0.57:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.193, ] ] ] 2025-12-11 Thu 02:03:20:727.537 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: Wrong state: Idle for event: EvSandeshSend message: UveDnsInfo 2025-12-11 Thu 02:03:21:888.110 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-11 Thu 02:03:21:888.362 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Connect : Start Connect timer 10.0.0.57:8086 2025-12-11 Thu 02:03:21:888.478 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:03:21:888.503 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: SANDESH: Send FAILED: 1765418601888167 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:03:21:888.511 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-11 Thu 02:03:21:888.519 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Processing scm::EvSandeshSend in state Connect 2025-12-11 Thu 02:03:21:888.628 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: SANDESH: Send FAILED: 1765418601888459 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 156 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 54 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 64 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 300, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:03:21:888.651 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-11 Thu 02:03:21:891.205 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.57:44674::10.0.0.57:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2025-12-11 Thu 02:03:21:891.235 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: 10.0.0.57:44674::10.0.0.57:8086(-1) OnSessionEvent TCP Connected 2025-12-11 Thu 02:03:21:891.245 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: 10.0.0.57:44674::10.0.0.57:8086(-1):EvTcpConnected 2025-12-11 Thu 02:03:21:891.293 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Processing scm::EvTcpConnected in state Connect 2025-12-11 Thu 02:03:21:891.308 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Connect : EvTcpConnected : Cancelling Connect timer 2025-12-11 Thu 02:03:21:891.339 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: ClientInit 2025-12-11 Thu 02:03:21:891.354 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-4881-1:contrail-dns:0:Control count 1 2025-12-11 Thu 02:03:21:891.425 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Processing scm::EvSandeshSend in state ClientInit 2025-12-11 Thu 02:03:21:891.433 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-12-11 Thu 02:03:21:891.451 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: SANDESH: Send FAILED: 1765418601891333 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-11 Thu 02:03:21:891.457 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Received UVE message in wrong state : NodeStatusUVE 2025-12-11 Thu 02:03:21:891.469 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Processing scm::EvSandeshSend in state ClientInit 2025-12-11 Thu 02:03:21:891.475 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-12-11 Thu 02:03:21:891.492 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Processing scm::EvSandeshSend in state ClientInit 2025-12-11 Thu 02:03:21:891.497 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-12-11 Thu 02:03:21:891.601 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: SANDESH: Send FAILED: 1765418601891415 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 156 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 54 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 64 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 301, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 39, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-11 Thu 02:03:21:891.621 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-12-11 Thu 02:03:23:641.371 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: OnMessage control in state: ClientInit 2025-12-11 Thu 02:03:23:641.446 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-12-11 Thu 02:03:23:641.469 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ClientInit : EvSandeshMessageRecv 2025-12-11 Thu 02:03:23:641.493 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: Received Ctrl Message with size 0 2025-12-11 Thu 02:03:23:641.514 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-4881-1 start_time = 1765418540727348 build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-11 00:10:34.361562", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13006-1.novalocal", "build-id": "v0+nightly", "build-number": "202512110009"}]} collector = 10.0.0.57:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.193, ] ] proxy seq 1 2025-12-11 Thu 02:03:23:641.528 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-12-11 Thu 02:03:23:641.680 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-4881-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 68573 http_port = 8092 start_time = 1765418540592891 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.57:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 34 dequeues = 34 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 53 dequeues = 53 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1765418571888022 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1765418571888296 ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 156 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 54 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 64 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 301, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 39, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 4 proxy seq 21 2025-12-11 Thu 02:03:23:641.712 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-12-11 Thu 02:03:23:641.733 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-4881-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 20 2025-12-11 Thu 02:03:23:641.748 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-12-11 Thu 02:03:23:641.755 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-12-11 Thu 02:03:23:641.778 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-12-11 Thu 02:03:23:641.784 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-12-11 Thu 02:03:23:641.824 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: Established 2025-12-11 Thu 02:03:28:239.226 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:03:28:239.344 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:03:28:239.373 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360285341248, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:03:33:606.369 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: OnMessage control in state: Established 2025-12-11 Thu 02:03:33:606.438 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Processing scm::EvSandeshMessageRecv in state Established 2025-12-11 Thu 02:03:33:606.451 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Established : EvSandeshMessageRecv 2025-12-11 Thu 02:03:33:606.490 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: Received Ctrl Message with size 3 2025-12-11 Thu 02:03:33:606.509 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SyncAllMaps for DnsState:0 period 0 cycle 0 with seqno 1, total = 0 2025-12-11 Thu 02:03:33:606.522 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 22, total = 0 2025-12-11 Thu 02:03:33:606.535 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 22, total = 0 2025-12-11 Thu 02:03:33:606.545 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-12-11 Thu 02:03:33:606.553 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-12-11 Thu 02:03:33:606.563 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-12-11 Thu 02:03:39:672.235 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360189724224, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:03:39:673.860 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360189724224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:03:39:673.895 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360189724224, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:05:10:115.376 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-4881-1:10.20.0.193 SEND Xmpp creating dynamic channel 10.20.0.193:8093::10.20.0.193:40789 controller/src/xmpp/xmpp_server.cc 577 2025-12-11 Thu 02:05:10:115.438 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-4881-1:10.20.0.193 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-4881-1 To : controller/src/xmpp/xmpp_connection.cc 725 2025-12-11 Thu 02:05:10:115.505 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.193:8093::10.20.0.193:40789 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255 2025-12-11 Thu 02:05:10:115.572 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-4881-1:10.20.0.193 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.193 ( ) controller/src/xmpp/xmpp_state_machine.cc 1323 2025-12-11 Thu 02:05:10:115.600 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.193 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-12-11 Thu 02:05:10:115.682 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.193 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 40789 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-12-11 Thu 02:05:10:116.018 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.193 state = Active next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-ansible-os-4881-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-12-11 Thu 02:05:11:369.253 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360147740224, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:05:11:484.166 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:05:11:484.291 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:05:11:484.322 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:05:11:787.722 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:05:11:787.901 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4881-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:05:11:787.950 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:05:11:787.970 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360281142848, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:05:11:807.317 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360177129024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:05:12:308.340 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:302.604 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:302.765 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:admin controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:10:302.805 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360185525824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:315.390 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:315.547 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:admin:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:10:315.598 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:333.134 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:333.295 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:453.350 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:453.520 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:admin:default controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:10:453.551 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:524.778 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:524.955 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:10:525.020 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:592.247 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360156137024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:611.887 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:612.020 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:admin:tf-tempest-test controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:10:612.053 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:688.440 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:688.569 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360172930624, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:688.735 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:10:688.788 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:705.575 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:705.673 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:admin:tf-tempest-test:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:10:705.700 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360164533824, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:10:774.429 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360193922624, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:832.474 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:10:832.560 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360198121024, Pid 68573]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 78d4c940-88ca-4baa-a635-ef217ac9c791 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-11 Thu 02:06:12:410.250 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:12:410.383 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:admin:tf-tempest-test,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-12-11 Thu 02:06:12:410.411 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:12:410.426 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360160335424, Pid 68573]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-11 Thu 02:06:12:473.024 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360202319424, Pid 68573]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-11 Thu 02:06:49:590.923 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.193:8092::10.20.0.193:56014 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255 2025-12-11 Thu 02:06:50:363.418 UTC cn-jenkins-deploy-platform-ansible-os-4881-1 [Thread 140360294088832, Pid 68573]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.193:8092::10.20.0.193:56024 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255