11/27/2025 02:03:41.427 7f3560651880 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 11/27/2025 02:03:41.427 7f3560651880 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 11/27/2025 02:03:41.427 7f3560651880 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 11/27/2025 02:03:41.437 7f355d76c360 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 11/27/2025 02:03:41.438 7f355d76c360 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 11/27/2025 02:03:41.438 7f355d76c720 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 11/27/2025 02:03:41.439 7f355d76c720 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 02:03:41.439 7f355d76c720 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 02:03:41.440 7f355d76c720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 11/27/2025 02:03:41.440 7f355d76c720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.440 7f355d76c720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/27/2025 02:03:41.440 7f355d76c720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.440 7f355d76c720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.440 7f355d76c720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 11/27/2025 02:03:41.440 7f355d76c720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.600 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 45290252708672019640223125421426408389844938526717698852251334136880496506722, 'start': '1764209019000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 66567376590373331055426713249066361040998332450801972369217922700151473881422, 'start': '1764209019000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 52503171770856329010919774778899417074058721162357025938111910591520258599626, 'start': '1764209020000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 111291720215612190546511688520071777698714398678564735205894200306293198116451, 'start': '1764209019000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 11/27/2025 02:03:41.645 7f3560651880 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4821-1', _node_type='Control', _instance_id='0', _timestamp=1764209021645677, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/27/2025 02:03:41.646 7f3560651880 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4821-1', _node_type='Control', _instance_id='0', _timestamp=1764209021646502, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209019000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209019000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209020000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209019000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/27/2025 02:03:41.650 7f355d76c7c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.651 7f355d76c7c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> >> 11/27/2025 02:03:41.651 7f355d76c7c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.651 7f355d76c7c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.651 7f355d76c7c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/27/2025 02:03:41.651 7f355d76c7c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.652 7f355d76c7c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:41.652 7f355d76c7c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209019000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209019000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209020000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209019000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]} >> 11/27/2025 02:03:41.652 7f355d76c7c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:45.440 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:03:45.442 7f355d76ce00 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:03:45.442 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:03:45.442 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:45.442 7f355d76ce00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:03:45.442 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:45.442 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:03:45.442 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:03:45.443 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:45.443 7f355d76ce00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:03:45.443 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:45.443 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:45.443 7f355d76ce00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:03:45.443 7f355d76ce00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:48.903 7f3560651880 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4821-1', _node_type='Control', _instance_id='0', _timestamp=1764209028903305, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209019000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209019000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209020000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764209019000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/27/2025 02:03:48.903 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16214900, partition_space_available_1k=64875584, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=573308, cpu_share=0.0, mem_res=8780, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=10516, cpu_share=0.0, mem_res=8332, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11288, cpu_share=0.0, mem_res=9196, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52280, cpu_share=0.0, mem_res=42916, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=6457624, free=9709720, buffers=658732, cached=16310052, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.17, five_min_avg=1.97, fifteen_min_avg=1.36, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:03:48.903 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:48.904 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209019000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209019000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209020000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764209019000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]} >> 11/27/2025 02:03:48.904 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:48.904 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:48.904 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16214900 partition_space_available_1k = 64875584 percentage_partition_space_used = 20 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 573308 cpu_share = 0.0 mem_res = 8780 >>contrail-dns : << mem_virt = 10516 cpu_share = 0.0 mem_res = 8332 >>contrail-named : << mem_virt = 11288 cpu_share = 0.0 mem_res = 9196 >>contrail-control-nodemgr : << mem_virt = 52280 cpu_share = 0.0 mem_res = 42916 >> } system_mem_usage = << total = 32665120 used = 6457624 free = 9709720 buffers = 658732 cached = 16310052 node_type = control-node >> system_cpu_usage = << one_min_avg = 2.17 five_min_avg = 1.97 fifteen_min_avg = 1.36 cpu_share = 0 node_type = control-node >> >> 11/27/2025 02:03:48.904 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:49.443 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:03:49.444 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:03:49.444 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:03:49.444 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:49.444 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:03:49.444 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:49.444 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:03:49.445 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:03:49.445 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:49.445 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:03:49.445 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:49.445 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:49.446 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:03:49.446 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:53.447 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:03:53.448 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:03:53.448 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:03:53.448 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:53.448 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:03:53.448 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:53.448 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:03:53.448 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:03:53.449 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:53.449 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:03:53.449 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:53.449 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:53.449 7f355d6e2a40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:03:53.449 7f355d6e2a40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:57.449 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:03:57.450 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:03:57.450 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:03:57.450 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:57.450 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:03:57.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:01.451 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:01.452 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:01.452 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:01.452 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:01.452 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:01.453 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:01.453 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:01.453 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:01.453 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:01.453 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:01.453 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:01.453 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:01.454 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:01.454 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:05.455 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:05.456 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:05.456 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:05.456 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:05.456 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:05.457 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:09.459 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:09.460 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:09.460 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:09.460 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:09.460 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:09.461 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:13.462 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:13.464 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:13.464 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:13.464 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:13.465 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:13.465 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:13.465 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:13.465 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:13.465 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:13.465 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:13.465 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:13.466 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:13.466 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:13.467 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:17.467 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:17.468 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:17.468 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:17.468 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:17.468 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:17.468 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:17.468 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:17.469 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:17.469 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:17.469 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:17.469 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:17.469 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:17.469 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:17.469 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:21.471 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:21.472 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:21.472 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:21.472 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:21.472 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:21.472 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:21.472 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:21.473 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:21.473 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:21.473 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:21.473 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:21.473 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:21.473 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:21.473 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:25.476 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:25.477 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:25.478 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:25.478 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:25.478 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:25.478 7f355d6e2360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:25.478 7f355d6e2360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:29.479 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:29.480 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:29.480 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:29.480 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:29.480 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:29.480 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:29.480 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:29.481 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:29.481 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:29.481 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:29.481 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:29.481 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:29.481 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:29.481 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:33.483 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:33.484 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:33.484 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:33.484 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:33.484 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:33.484 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:33.484 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:33.485 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:33.485 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:33.485 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:33.485 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:33.485 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:33.485 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:33.485 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:37.486 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:37.487 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:37.487 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:37.487 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:37.487 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:37.487 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:37.487 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:37.488 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:37.488 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:37.488 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:37.488 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:37.488 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:37.488 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:37.488 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:41.488 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:41.489 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 02:04:41.489 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:41.489 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:41.489 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:41.489 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:41.490 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:45.490 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:04:45.492 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 11/27/2025 02:04:45.492 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:04:45.492 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:45.492 7f355d6e2720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:04:45.492 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:04:45.493 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/27/2025 02:04:45.493 7f355d6e2720 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 11/27/2025 02:04:45.493 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/27/2025 02:04:45.493 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 02:04:45.493 7f355d6e2720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 02:04:48.808 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16844944, partition_space_available_1k=64245540, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=574016, cpu_share=0.01, mem_res=9300, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11356, cpu_share=0.01, mem_res=9080, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11628, cpu_share=0.0, mem_res=9292, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52340, cpu_share=0.01, mem_res=42916, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=8002512, free=7639736, buffers=667708, cached=16826920, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.18, five_min_avg=2.26, fifteen_min_avg=1.49, cpu_share=3.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:04:48.809 7f355d6e2ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 02:04:56.430 7f355d6e20e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 11/27/2025 02:04:56.431 7f355e4694a0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 11/27/2025 02:04:56.431 7f355e4694a0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 11/27/2025 02:04:56.431 7f355e4694a0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:56.431 7f355e4694a0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 11/27/2025 02:04:56.431 7f355e4694a0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:56.431 7f355e4694a0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:04:56.431 7f355e4694a0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8101 start_time = 1764209021439802 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 02:04:56.432 7f355e4694a0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 02:05:00.434 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 02:05:00.435 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 11/27/2025 02:05:00.435 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 02:05:00.435 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:05:00.435 7f355d6e2c20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4821-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 02:05:00.435 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 02:05:00.435 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/27/2025 02:05:00.436 7f355d6e2c20 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 11/27/2025 02:05:00.436 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/27/2025 02:05:00.436 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 02:05:00.436 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 02:05:00.443 7f355d6f90e0 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 11/27/2025 02:05:00.444 7f355d6f90e0 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/27/2025 02:05:00.445 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 11/27/2025 02:05:00.445 7f355d6e2c20 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 11/27/2025 02:05:00.445 7f355d6e2c20 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 02:05:00.445 7f355d6e2c20 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 02:05:00.446 7f355d6e2c20 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 11/27/2025 02:05:00.446 7f355d6e25e0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/27/2025 02:05:00.447 7f355d6e25e0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/27/2025 02:05:07.407 7f355d6f90e0 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 11/27/2025 02:05:07.407 7f355d6f90e0 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/27/2025 02:05:07.408 7f355d76cea0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 11/27/2025 02:05:07.408 7f355d76cea0 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 11/27/2025 02:05:07.408 7f355d76cea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 02:05:07.408 7f355d76cea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 02:05:49.241 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19454300, partition_space_available_1k=61636184, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=574632, cpu_share=0.01, mem_res=9836, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11648, cpu_share=0.01, mem_res=9320, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11628, cpu_share=0.0, mem_res=9292, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52308, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9353716, free=3564836, buffers=699448, cached=19519392, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.37, five_min_avg=2.84, fifteen_min_avg=1.74, cpu_share=5.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:06:49.331 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19517412, partition_space_available_1k=61573072, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=574304, cpu_share=0.0, mem_res=9864, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11256, cpu_share=0.01, mem_res=9424, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11384, cpu_share=0.0, mem_res=9292, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44976, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9307836, free=18486300, buffers=703628, cached=4639760, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.74, five_min_avg=2.97, fifteen_min_avg=1.86, cpu_share=4.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:07:49.076 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19521100, partition_space_available_1k=61569384, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=574420, cpu_share=0.0, mem_res=9980, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11304, cpu_share=0.01, mem_res=9472, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11384, cpu_share=0.0, mem_res=9292, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44948, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9930804, free=17926992, buffers=706692, cached=4573352, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.39, five_min_avg=2.72, fifteen_min_avg=1.85, cpu_share=2.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:08:04.444 7f355d76ca40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 02:08:06.845 7f355d76ca40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 02:08:48.950 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21177204, partition_space_available_1k=59913280, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=575232, cpu_share=0.01, mem_res=10708, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11684, cpu_share=0.01, mem_res=9816, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11444, cpu_share=0.0, mem_res=9300, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48228, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10028732, free=16218964, buffers=743264, cached=6145740, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.01, five_min_avg=2.8, fifteen_min_avg=1.93, cpu_share=3.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:09:09.764 7f355d6e2360 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 02:09:49.368 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21014640, partition_space_available_1k=60075844, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=576220, cpu_share=0.01, mem_res=11544, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12020, cpu_share=0.01, mem_res=10116, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11456, cpu_share=0.0, mem_res=9312, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48224, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10507260, free=15594724, buffers=747704, cached=6286712, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.51, five_min_avg=2.91, fifteen_min_avg=2.02, cpu_share=4.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:10:49.255 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21041504, partition_space_available_1k=60048980, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=578856, cpu_share=0.02, mem_res=13588, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12880, cpu_share=0.02, mem_res=10804, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11572, cpu_share=0.0, mem_res=9320, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48228, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10983220, free=15085492, buffers=747796, cached=6319752, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.56, five_min_avg=3.04, fifteen_min_avg=2.12, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:11:49.135 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21144228, partition_space_available_1k=59946256, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=580116, cpu_share=0.01, mem_res=14504, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13308, cpu_share=0.01, mem_res=11168, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11572, cpu_share=0.0, mem_res=9320, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48228, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10719280, free=15242116, buffers=747836, cached=6427228, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.03, five_min_avg=3.97, fifteen_min_avg=2.49, cpu_share=5.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:12:49.196 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21175804, partition_space_available_1k=59914680, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=583468, cpu_share=0.03, mem_res=16404, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14484, cpu_share=0.02, mem_res=12068, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11480, cpu_share=0.0, mem_res=9328, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48228, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10878568, free=15035468, buffers=748444, cached=6474068, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.35, five_min_avg=4.57, fifteen_min_avg=2.79, cpu_share=5.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:13:49.374 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21204324, partition_space_available_1k=59886160, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=584832, cpu_share=0.01, mem_res=17332, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14768, cpu_share=0.01, mem_res=12272, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11584, cpu_share=0.0, mem_res=9328, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48232, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10831588, free=15059420, buffers=748508, cached=6495936, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.76, five_min_avg=4.39, fifteen_min_avg=2.84, cpu_share=4.62, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:14:49.164 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21291540, partition_space_available_1k=59798944, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=586220, cpu_share=0.01, mem_res=18304, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15104, cpu_share=0.01, mem_res=12540, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11748, cpu_share=0.0, mem_res=9328, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48236, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11971864, free=13872148, buffers=748584, cached=6542940, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.53, five_min_avg=4.45, fifteen_min_avg=2.96, cpu_share=5.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:15:49.170 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21290216, partition_space_available_1k=59800268, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=588028, cpu_share=0.02, mem_res=19212, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18600, cpu_share=0.02, mem_res=13032, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16364, cpu_share=0.0, mem_res=13992, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48236, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11404460, free=14408868, buffers=748640, cached=6575256, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.75, five_min_avg=4.21, fifteen_min_avg=2.97, cpu_share=4.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:16:49.151 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21308124, partition_space_available_1k=59782360, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=588604, cpu_share=0.01, mem_res=19468, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18916, cpu_share=0.01, mem_res=13280, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16140, cpu_share=0.0, mem_res=13848, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48240, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10949804, free=14841504, buffers=748712, cached=6595400, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.46, five_min_avg=4.31, fifteen_min_avg=3.08, cpu_share=4.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:17:49.614 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21332576, partition_space_available_1k=59757908, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=589732, cpu_share=0.01, mem_res=20212, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19104, cpu_share=0.01, mem_res=13416, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16304, cpu_share=0.0, mem_res=13848, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48244, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11792524, free=13967028, buffers=748756, cached=6625984, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.71, five_min_avg=4.09, fifteen_min_avg=3.09, cpu_share=4.88, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:18:49.175 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21420448, partition_space_available_1k=59670036, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=590396, cpu_share=0.01, mem_res=20624, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19352, cpu_share=0.01, mem_res=13608, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16196, cpu_share=0.0, mem_res=13848, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48240, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11208724, free=14460336, buffers=748812, cached=6716552, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.45, five_min_avg=4.22, fifteen_min_avg=3.19, cpu_share=4.88, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:19:49.162 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21426768, partition_space_available_1k=59663716, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=590900, cpu_share=0.01, mem_res=21036, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19488, cpu_share=0.01, mem_res=13708, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16140, cpu_share=0.0, mem_res=13848, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48240, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10966008, free=14695468, buffers=748820, cached=6730624, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.6, five_min_avg=3.97, fifteen_min_avg=3.17, cpu_share=2.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:20:18.139 7f355d6e2cc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 02:20:48.952 7f3560651880 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4821-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21484224, partition_space_available_1k=59606260, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=591308, cpu_share=0.01, mem_res=21204, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19828, cpu_share=0.01, mem_res=13960, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16140, cpu_share=0.0, mem_res=13848, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48248, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10709452, free=14879968, buffers=751192, cached=6793560, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.91, five_min_avg=3.69, fifteen_min_avg=3.12, cpu_share=3.62, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 02:21:12.623 7f355d76cd60 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map