12/01/2025 02:13:41.034 7f55f94efe80 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 12/01/2025 02:13:41.034 7f55f94efe80 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 12/01/2025 02:13:41.034 7f55f94efe80 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 12/01/2025 02:13:41.045 7f55f62c8360 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 12/01/2025 02:13:41.046 7f55f62c8360 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 12/01/2025 02:13:41.046 7f55f62c8720 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 12/01/2025 02:13:41.047 7f55f62c8720 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 02:13:41.048 7f55f62c8720 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/01/2025 02:13:41.048 7f55f62c8720 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 12/01/2025 02:13:41.048 7f55f62c8720 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.048 7f55f62c8720 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/01/2025 02:13:41.048 7f55f62c8720 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.048 7f55f62c8720 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.049 7f55f62c8720 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 12/01/2025 02:13:41.049 7f55f62c8720 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.212 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 76120110528407063880718093078252960109291224124497072036555078778769443203315, 'start': '1764555219000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 42867410369490270156851737624181229688970003003912570818369352590208667760965, 'start': '1764555219000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 85244502020671132849809624738449309950705128740093259560535589216960082375458, 'start': '1764555219000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 9674440215290289705662508490437285325295454133778254615103594440837650037743, 'start': '1764555219000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 23303322908513966455112580606524209720690859913405918304383788459673900057374, 'start': '1764555219000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 12/01/2025 02:13:41.258 7f55f94efe80 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4826-1.', _node_type='Config', _instance_id='0', _timestamp=1764555221258085, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 12/01/2025 02:13:41.258 7f55f94efe80 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4826-1.', _node_type='Config', _instance_id='0', _timestamp=1764555221258614, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-01 00:48:28.850228", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12899-1.novalocal", "build-id": "v0+nightly", "build-number": "202512010007"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 12/01/2025 02:13:41.261 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.262 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-01 00:48:28.850228", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12899-1.novalocal", "build-id": "v0+nightly", "build-number": "202512010007"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> >> 12/01/2025 02:13:41.262 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.262 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.263 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/01/2025 02:13:41.263 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.263 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:41.263 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-01 00:48:28.850228", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12899-1.novalocal", "build-id": "v0+nightly", "build-number": "202512010007"}]} >> 12/01/2025 02:13:41.263 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:45.049 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:13:45.050 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:13:45.050 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:13:45.050 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:45.050 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:13:45.050 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:45.050 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:13:45.051 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:13:45.051 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:45.051 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:13:45.051 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:45.051 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:45.051 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:13:45.051 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:49.051 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:13:49.052 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:13:49.053 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:13:49.053 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:49.053 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:13:49.053 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:49.053 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:13:49.054 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:13:49.054 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:49.054 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:13:49.054 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:49.054 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:49.054 7f55f61762c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:13:49.054 7f55f61762c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:50.330 7f55f94efe80 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4826-1.', _node_type='Config', _instance_id='0', _timestamp=1764555230330613, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764555219000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-01 00:48:28.850228", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12899-1.novalocal", "build-id": "v0+nightly", "build-number": "202512010007"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 12/01/2025 02:13:50.331 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14218788, partition_space_available_1k=66871696, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2080, cpu_share=0.0, mem_res=1244, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2076, cpu_share=0.0, mem_res=1248, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=163024, cpu_share=0.0, mem_res=160628, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197236, cpu_share=0.0, mem_res=177808, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51960, cpu_share=0.0, mem_res=42624, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=6594784, free=11400212, buffers=642296, cached=14571668, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.37, five_min_avg=2.16, fifteen_min_avg=1.41, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:13:50.331 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:50.331 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764555219000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-01 00:48:28.850228", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12899-1.novalocal", "build-id": "v0+nightly", "build-number": "202512010007"}]} >> 12/01/2025 02:13:50.331 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:50.331 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:50.331 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14218788 partition_space_available_1k = 66871696 percentage_partition_space_used = 18 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 2080 cpu_share = 0.0 mem_res = 1244 >>contrail-schema : << mem_virt = 2076 cpu_share = 0.0 mem_res = 1248 >>contrail-svc-monitor : << mem_virt = 163024 cpu_share = 0.0 mem_res = 160628 >>contrail-device-manager : << mem_virt = 197236 cpu_share = 0.0 mem_res = 177808 >>contrail-config-nodemgr : << mem_virt = 51960 cpu_share = 0.0 mem_res = 42624 >> } system_mem_usage = << total = 32665112 used = 6594784 free = 11400212 buffers = 642296 cached = 14571668 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.37 five_min_avg = 2.16 fifteen_min_avg = 1.41 cpu_share = 0 node_type = config-node >> >> 12/01/2025 02:13:50.331 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:53.056 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:13:53.058 7f55f6176220 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:13:53.058 7f55f6176220 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:13:53.058 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:53.058 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:13:53.058 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:53.058 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:13:53.058 7f55f6176220 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:13:53.059 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:53.059 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:13:53.059 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:53.059 7f55f6176220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:53.059 7f55f6176220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:13:53.059 7f55f6176220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:57.059 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:13:57.063 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:13:57.064 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:13:57.064 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:57.064 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:13:57.064 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:13:57.064 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:13:57.065 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:13:57.065 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:57.066 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:13:57.066 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:57.066 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:13:57.066 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:13:57.066 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:01.065 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:01.067 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:01.067 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:01.067 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:01.067 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:01.067 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:01.067 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:01.068 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:01.068 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:01.068 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:01.068 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:01.068 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:01.068 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:01.068 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:05.069 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:05.070 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:05.070 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:05.070 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:05.070 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:05.071 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:09.074 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:09.075 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:09.075 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:09.075 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:09.076 7f55f61767c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:09.077 7f55f61767c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:13.077 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:13.079 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:13.080 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:13.080 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:13.080 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:13.080 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:13.080 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:17.081 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:17.082 7f55f6176400 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:17.082 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:17.082 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:17.082 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:17.082 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:17.082 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:17.082 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:17.083 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:17.083 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:17.083 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:17.083 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:17.083 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:17.083 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:21.085 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:21.086 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:21.087 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:21.087 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:21.087 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:21.087 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:25.090 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:25.091 7f55f6176400 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:25.091 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:25.091 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:25.091 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:25.092 7f55f6176400 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:29.093 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:29.094 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:29.094 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:29.094 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:29.094 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:29.094 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:29.094 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:29.095 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:29.095 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:29.095 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:29.095 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:29.095 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:29.095 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:29.095 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:33.098 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:33.100 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:33.100 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:33.100 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:33.100 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:33.100 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:33.100 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:33.101 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:33.101 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:33.101 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:33.101 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:33.101 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:33.101 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:33.101 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:37.101 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:37.102 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:37.102 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:37.102 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:37.102 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:37.102 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:37.102 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:37.103 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:37.103 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:37.103 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:37.103 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:37.103 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:37.103 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:37.103 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:41.104 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:41.105 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:41.105 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:41.105 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:41.105 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:41.105 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:41.106 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:45.107 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:45.109 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:45.109 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:45.109 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:45.109 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:45.109 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:45.110 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:45.110 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:45.110 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:45.110 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:45.110 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:45.110 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:45.111 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:45.111 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:49.110 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:49.111 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:49.112 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:49.113 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:49.113 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:49.113 7f55f6176d60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:49.113 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:50.309 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15717468, partition_space_available_1k=65373016, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183408, cpu_share=0.1, mem_res=179372, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175432, cpu_share=0.06, mem_res=172360, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164216, cpu_share=0.04, mem_res=160760, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=312668, cpu_share=0.04, mem_res=288468, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52012, cpu_share=0.01, mem_res=42624, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=6797280, free=10101288, buffers=653368, cached=15584288, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.91, five_min_avg=2.26, fifteen_min_avg=1.5, cpu_share=3.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:14:50.310 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:50.310 7f55f62c8cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15717468 partition_space_available_1k = 65373016 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 183408 cpu_share = 0.1 mem_res = 179372 >>contrail-schema : << mem_virt = 175432 cpu_share = 0.06 mem_res = 172360 >>contrail-svc-monitor : << mem_virt = 164216 cpu_share = 0.04 mem_res = 160760 >>contrail-device-manager : << mem_virt = 312668 cpu_share = 0.04 mem_res = 288468 >>contrail-config-nodemgr : << mem_virt = 52012 cpu_share = 0.01 mem_res = 42624 >> } system_mem_usage = << total = 32665112 used = 6797280 free = 10101288 buffers = 653368 cached = 15584288 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.91 five_min_avg = 2.26 fifteen_min_avg = 1.5 cpu_share = 3.12 node_type = config-node >> >> 12/01/2025 02:14:50.310 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:53.113 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:53.114 7f55f62c8cc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:53.114 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:53.114 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:53.114 7f55f62c8cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:53.114 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:53.115 7f55f62c8cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:57.115 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:14:57.117 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:57.118 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:14:57.118 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:14:57.118 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:01.120 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:01.121 7f55f6176540 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:01.121 7f55f6176540 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:01.121 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:01.122 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:05.125 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:05.126 7f55f6176540 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:05.126 7f55f6176540 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:05.126 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:05.126 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:05.126 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:05.126 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:05.127 7f55f6176540 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:05.127 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:05.127 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:05.127 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:05.127 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:05.127 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:05.127 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:09.129 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:09.131 7f55f6176540 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:09.131 7f55f6176540 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:09.131 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:09.131 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:09.131 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:09.131 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:09.131 7f55f6176540 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:09.132 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:09.132 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:09.132 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:09.132 7f55f6176540 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:09.132 7f55f6176540 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:09.132 7f55f6176540 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:13.132 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:13.133 7f55f6176680 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:13.133 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:13.133 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:13.133 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:13.133 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:13.134 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:17.136 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:17.137 7f55f6176680 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:17.138 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:17.139 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:17.139 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:17.139 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:17.139 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:21.141 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:21.142 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:21.143 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:21.143 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:21.143 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:21.143 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:21.143 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:25.145 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:25.146 7f55f6176680 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:25.146 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:25.146 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:25.146 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:25.147 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:25.147 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:25.147 7f55f6176680 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:25.147 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:25.147 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:25.148 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:25.148 7f55f6176680 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:25.148 7f55f6176680 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:25.148 7f55f6176680 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:29.148 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:29.149 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:29.149 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:29.149 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:29.149 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:29.149 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:29.149 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:29.149 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:29.150 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:29.150 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:29.150 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:29.150 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:29.150 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:29.150 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:33.153 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:33.154 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:33.154 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:33.154 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:33.154 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:33.155 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:33.155 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:33.155 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:33.155 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:33.155 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:33.155 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:33.155 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:33.156 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:33.156 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:37.159 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:37.161 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:37.161 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:37.161 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:37.161 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:37.161 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:37.161 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:37.162 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:37.162 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:37.162 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:37.162 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:37.162 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:37.162 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:37.162 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:41.165 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:41.166 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:41.166 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:41.166 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:41.167 7f55f61760e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:45.167 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:45.169 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:45.169 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:45.169 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:45.170 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:45.170 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:45.170 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:45.170 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:45.170 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:45.170 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:45.170 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:45.171 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:45.171 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:45.171 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:49.171 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:49.172 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:49.172 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:49.172 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:49.172 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:49.172 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:49.172 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:49.173 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:49.173 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:49.173 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:49.173 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:49.173 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:49.173 7f55f6176cc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:49.173 7f55f6176cc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:50.321 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16907552, partition_space_available_1k=64182932, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183512, cpu_share=0.0, mem_res=179372, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175504, cpu_share=0.0, mem_res=172368, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164280, cpu_share=0.0, mem_res=160760, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=312744, cpu_share=0.0, mem_res=288468, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52060, cpu_share=0.01, mem_res=42624, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=8308560, free=7338804, buffers=661896, cached=16828284, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.48, five_min_avg=2.24, fifteen_min_avg=1.54, cpu_share=3.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:15:50.321 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:50.322 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16907552 partition_space_available_1k = 64182932 percentage_partition_space_used = 21 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 183512 cpu_share = 0.0 mem_res = 179372 >>contrail-schema : << mem_virt = 175504 cpu_share = 0.0 mem_res = 172368 >>contrail-svc-monitor : << mem_virt = 164280 cpu_share = 0.0 mem_res = 160760 >>contrail-device-manager : << mem_virt = 312744 cpu_share = 0.0 mem_res = 288468 >>contrail-config-nodemgr : << mem_virt = 52060 cpu_share = 0.01 mem_res = 42624 >> } system_mem_usage = << total = 32665112 used = 8308560 free = 7338804 buffers = 661896 cached = 16828284 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.48 five_min_avg = 2.24 fifteen_min_avg = 1.54 cpu_share = 3.25 node_type = config-node >> >> 12/01/2025 02:15:50.322 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:53.173 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:53.175 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:53.176 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:53.176 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:53.176 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:53.176 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:53.176 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:57.178 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:15:57.179 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:15:57.179 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:15:57.179 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:57.179 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:15:57.180 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:15:57.180 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:15:57.180 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:15:57.180 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:57.180 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:15:57.181 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:57.181 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:15:57.181 7f55f62c8c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:15:57.181 7f55f62c8c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:16:01.181 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 02:16:01.183 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:16:01.184 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 02:16:01.184 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:16:01.184 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:16:01.184 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1764555221048094 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/01/2025 02:16:01.184 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 02:16:05.185 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 02:16:05.186 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 12/01/2025 02:16:05.186 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 02:16:05.186 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:16:05.186 7f55f61769a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4826-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 02:16:05.187 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 02:16:05.187 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 12/01/2025 02:16:05.187 7f55f61769a0 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 12/01/2025 02:16:05.187 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 12/01/2025 02:16:05.187 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/01/2025 02:16:05.187 7f55f61769a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/01/2025 02:16:14.447 7f55f62c8c20 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 12/01/2025 02:16:14.448 7f55f62c8c20 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/01/2025 02:16:14.449 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 12/01/2025 02:16:14.449 7f55f6176d60 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 12/01/2025 02:16:14.449 7f55f6176d60 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 02:16:14.449 7f55f6176d60 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/01/2025 02:16:14.449 7f55f6176d60 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 12/01/2025 02:16:14.450 7f55f62c8a40 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/01/2025 02:16:14.451 7f55f62c8a40 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/01/2025 02:16:24.489 7f55f62c8c20 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 12/01/2025 02:16:24.489 7f55f62c8c20 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/01/2025 02:16:24.490 7f55f62c8ae0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 12/01/2025 02:16:24.490 7f55f62c8ae0 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 12/01/2025 02:16:24.490 7f55f62c8ae0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 02:16:24.490 7f55f62c8ae0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/01/2025 02:16:50.438 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17761396, partition_space_available_1k=63329088, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183576, cpu_share=0.0, mem_res=179372, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175580, cpu_share=0.0, mem_res=172432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164284, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=312752, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52052, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=9858704, free=4180840, buffers=692644, cached=18406456, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.69, five_min_avg=2.88, fifteen_min_avg=1.8, cpu_share=4.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:17:50.523 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19638232, partition_space_available_1k=61452252, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181448, cpu_share=0.0, mem_res=179384, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174040, cpu_share=0.0, mem_res=172432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162388, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292180, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44716, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=9328772, free=18408668, buffers=701260, cached=4699900, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.01, five_min_avg=3.4, fifteen_min_avg=2.05, cpu_share=5.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:18:50.686 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19669164, partition_space_available_1k=61421320, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181472, cpu_share=0.0, mem_res=179396, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174040, cpu_share=0.0, mem_res=172432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162388, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292188, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47996, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=9224280, free=18333172, buffers=704704, cached=4876220, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.31, five_min_avg=3.26, fifteen_min_avg=2.1, cpu_share=4.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:19:19.588 7f55f62c8ae0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 02:19:22.039 7f55f62c8ae0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 02:19:51.051 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19857012, partition_space_available_1k=61233472, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181636, cpu_share=0.0, mem_res=179504, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174112, cpu_share=0.0, mem_res=172496, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162392, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292204, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44748, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10011348, free=16688052, buffers=716788, cached=5721492, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.96, five_min_avg=3.13, fifteen_min_avg=2.12, cpu_share=3.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:20:30.376 7f55f6176b80 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 02:20:51.071 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21136880, partition_space_available_1k=59953604, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182884, cpu_share=0.02, mem_res=180432, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174284, cpu_share=0.0, mem_res=172584, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162480, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292292, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44752, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10551676, free=15524788, buffers=745184, cached=6315912, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.96, five_min_avg=3.92, fifteen_min_avg=2.45, cpu_share=4.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:21:51.179 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21171216, partition_space_available_1k=59919268, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=201568, cpu_share=0.12, mem_res=182580, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174712, cpu_share=0.01, mem_res=172772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162744, cpu_share=0.01, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292592, cpu_share=0.01, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44752, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10598412, free=15412172, buffers=745888, cached=6381096, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.91, five_min_avg=4.33, fifteen_min_avg=2.69, cpu_share=5.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:22:50.773 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21319148, partition_space_available_1k=59771336, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=206492, cpu_share=0.11, mem_res=185904, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175296, cpu_share=0.01, mem_res=172964, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=163108, cpu_share=0.01, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292924, cpu_share=0.01, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44768, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11272192, free=14586968, buffers=745940, cached=6532480, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.5, five_min_avg=4.24, fifteen_min_avg=2.77, cpu_share=5.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:23:51.194 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21348476, partition_space_available_1k=59742008, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=210672, cpu_share=0.11, mem_res=188328, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=176156, cpu_share=0.02, mem_res=173256, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=163784, cpu_share=0.01, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=293484, cpu_share=0.01, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44788, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10765648, free=15042400, buffers=746520, cached=6582932, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.34, five_min_avg=4.86, fifteen_min_avg=3.07, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:24:51.294 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21379900, partition_space_available_1k=59710584, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=212476, cpu_share=0.1, mem_res=188328, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=176752, cpu_share=0.01, mem_res=173376, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164092, cpu_share=0.01, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=293912, cpu_share=0.01, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44924, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10856392, free=14917628, buffers=746600, cached=6616332, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.79, five_min_avg=5.0, fifteen_min_avg=3.24, cpu_share=5.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:25:50.788 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21468420, partition_space_available_1k=59622064, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=213576, cpu_share=0.07, mem_res=188328, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=177096, cpu_share=0.01, mem_res=173500, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164304, cpu_share=0.01, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=294128, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44788, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11981144, free=13744304, buffers=746700, cached=6664656, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.5, five_min_avg=4.89, fifteen_min_avg=3.32, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:26:50.701 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21466272, partition_space_available_1k=59624212, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=215760, cpu_share=0.08, mem_res=189264, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=177600, cpu_share=0.01, mem_res=173692, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164580, cpu_share=0.01, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=294400, cpu_share=0.01, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44792, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11526220, free=14167532, buffers=746756, cached=6696264, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.85, five_min_avg=4.67, fifteen_min_avg=3.34, cpu_share=4.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:27:51.020 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21486368, partition_space_available_1k=59604116, percentage_partition_space_used=26, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=217264, cpu_share=0.05, mem_res=190060, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=177800, cpu_share=0.0, mem_res=173692, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164780, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=294608, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44792, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11171692, free=14496132, buffers=746800, cached=6722260, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.45, five_min_avg=4.43, fifteen_min_avg=3.35, cpu_share=4.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:28:50.925 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21511132, partition_space_available_1k=59579352, percentage_partition_space_used=27, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=219200, cpu_share=0.07, mem_res=191012, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=177976, cpu_share=0.01, mem_res=173692, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164936, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=294768, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44796, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11935912, free=13702456, buffers=746868, cached=6750756, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.97, five_min_avg=4.43, fifteen_min_avg=3.41, cpu_share=4.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:29:50.723 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21606696, partition_space_available_1k=59483788, percentage_partition_space_used=27, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=219828, cpu_share=0.05, mem_res=191012, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=178152, cpu_share=0.0, mem_res=173712, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165100, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=294936, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44800, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11043316, free=14496512, buffers=746952, cached=6849016, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.15, five_min_avg=4.44, fifteen_min_avg=3.48, cpu_share=4.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:30:50.852 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21612800, partition_space_available_1k=59477684, percentage_partition_space_used=27, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=220240, cpu_share=0.02, mem_res=191012, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=178316, cpu_share=0.0, mem_res=173720, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165260, cpu_share=0.0, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=295108, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44796, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11043116, free=14488644, buffers=746976, cached=6857092, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.59, five_min_avg=3.93, fifteen_min_avg=3.37, cpu_share=3.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:31:08.916 7f55f619c2c0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 02:31:50.863 7f55f94efe80 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4826-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=21670704, partition_space_available_1k=59419780, percentage_partition_space_used=27, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=221348, cpu_share=0.07, mem_res=191012, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=178588, cpu_share=0.01, mem_res=173720, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165520, cpu_share=0.01, mem_res=160756, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=295372, cpu_share=0.0, mem_res=288464, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44804, cpu_share=0.01, mem_res=42620, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10820728, free=14640548, buffers=749320, cached=6925112, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.2, five_min_avg=3.59, fifteen_min_avg=3.29, cpu_share=3.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/01/2025 02:32:06.356 7f55f6faa4a0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map