11/27/2025 01:41:00.294 7f8a1db14680 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 11/27/2025 01:41:00.294 7f8a1db14680 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 11/27/2025 01:41:00.294 7f8a1db14680 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 11/27/2025 01:41:00.311 7f8a1ae56360 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 11/27/2025 01:41:00.311 7f8a1ae56360 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 11/27/2025 01:41:00.312 7f8a1ae56720 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 11/27/2025 01:41:00.313 7f8a1ae56720 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:41:00.313 7f8a1ae56720 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 01:41:00.318 7f8a1ae56720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 11/27/2025 01:41:00.329 7f8a1ae56720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.329 7f8a1ae56720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/27/2025 01:41:00.329 7f8a1ae56720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.329 7f8a1ae56720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.329 7f8a1ae56720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1764207660313543 collector_name = collector_ip = collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 11/27/2025 01:41:00.329 7f8a1ae56720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.592 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 41180227335132432267702230207233059911879576660741642978363004932919830725715, 'start': '1764207655000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 23201176040504076057160828979029093787986824511841926581373379128110715434546, 'start': '1764207655000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 40313015215120943989914677295734053375604682409654001618004241221454648062533, 'start': '1764207656000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 8084213785447629425502381447707165602048559692743175555747686219129770967406, 'start': '1764207655000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 11/27/2025 01:41:00.635 7f8a1db14680 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1739-1', _node_type='Control', _instance_id='0', _timestamp=1764207660635321, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/27/2025 01:41:00.637 7f8a1db14680 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1739-1', _node_type='Control', _instance_id='0', _timestamp=1764207660637050, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207655000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207655000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207655000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/27/2025 01:41:00.640 7f8a1ab76f40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.641 7f8a1ab76f40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> >> 11/27/2025 01:41:00.641 7f8a1ab76f40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.641 7f8a1ab76f40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.641 7f8a1ab76f40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/27/2025 01:41:00.642 7f8a1ab76f40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.642 7f8a1ab76f40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:00.642 7f8a1ab76f40 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764207655000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764207655000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764207656000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1764207655000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]} >> 11/27/2025 01:41:00.642 7f8a1ab76f40 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:02.479 7f8a1ab5b220 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:41:04.313 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 01:41:04.314 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 11/27/2025 01:41:04.314 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 01:41:04.314 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 01:41:04.315 7f8a1ab5b220 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 01:41:04.315 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 01:41:04.315 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/27/2025 01:41:04.315 7f8a1ab5b220 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 11/27/2025 01:41:04.315 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/27/2025 01:41:04.315 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:04.315 7f8a1ab5b220 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:08.197 7f8a1db14680 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1739-1', _node_type='Control', _instance_id='0', _timestamp=1764207668197420, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207655000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207655000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1764207655000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-11-27 00:50:11.016574", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12893-1.novalocal", "build-id": "v0+nightly", "build-number": "202511270009"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/27/2025 01:41:08.197 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12812116, partition_space_available_1k=68278368, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=538456, cpu_share=0.0, mem_res=4144, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=8172, cpu_share=0.0, mem_res=4020, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13636, cpu_share=0.0, mem_res=8184, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54332, cpu_share=0.0, mem_res=42680, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=5909280, free=308904, buffers=358640, cached=9987880, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.11, five_min_avg=3.03, fifteen_min_avg=1.41, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:41:08.197 7f8a1ab76860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:08.198 7f8a1ab76860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:15.864 7f8a1ab76220 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:41:15.874 7f8a1ab5b360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 11/27/2025 01:41:15.875 7f8a1ae56cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 11/27/2025 01:41:15.877 7f8a1ae56cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 11/27/2025 01:41:15.877 7f8a1ae56cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:15.877 7f8a1ae56cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 11/27/2025 01:41:15.877 7f8a1ae56cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:15.877 7f8a1ae56cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:15.877 7f8a1ae56cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8101 start_time = 1764207660313543 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 01:41:15.878 7f8a1ae56cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:19.878 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 01:41:19.880 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 11/27/2025 01:41:19.881 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 01:41:19.881 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 01:41:19.881 7f8a1ab76720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 01:41:19.881 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 01:41:19.881 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/27/2025 01:41:19.881 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 11/27/2025 01:41:19.882 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/27/2025 01:41:19.882 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:19.882 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:19.885 7f8a1ab5b5e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 11/27/2025 01:41:19.885 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 11/27/2025 01:41:19.886 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 11/27/2025 01:41:19.886 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:19.886 7f8a1ab76720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 11/27/2025 01:41:19.886 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:19.886 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:19.886 7f8a1ab76720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8101 start_time = 1764207660313543 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/27/2025 01:41:19.886 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 01:41:21.613 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:41:23.889 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 01:41:23.889 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1739-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:23.890 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 01:41:23.917 7f8a1ab5b5e0 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001014 11/27/2025 01:41:23.917 7f8a1ab5b5e0 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/27/2025 01:41:23.917 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 11/27/2025 01:41:23.918 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 11/27/2025 01:41:23.918 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:41:23.918 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 01:41:23.918 7f8a1ab76720 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 11/27/2025 01:41:23.918 7f8a1ae56a40 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/27/2025 01:41:23.919 7f8a1ae56a40 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/27/2025 01:41:25.770 7f8a1ab5b5e0 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001292 11/27/2025 01:41:25.771 7f8a1ab5b5e0 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/27/2025 01:41:25.771 7f8a1ae56ae0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 11/27/2025 01:41:25.771 7f8a1ae56ae0 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 11/27/2025 01:41:25.771 7f8a1ae56ae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:41:25.771 7f8a1ae56ae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 01:42:08.243 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12864304, partition_space_available_1k=68226180, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=409368, cpu_share=0.01, mem_res=9112, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15468, cpu_share=0.01, mem_res=10744, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14408, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53924, cpu_share=0.0, mem_res=42772, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7405452, free=336048, buffers=352780, cached=8408820, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.59, five_min_avg=3.53, fifteen_min_avg=1.69, cpu_share=14.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:43:08.280 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12878884, partition_space_available_1k=68211600, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=409576, cpu_share=0.0, mem_res=9112, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15620, cpu_share=0.0, mem_res=10876, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14436, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54108, cpu_share=0.0, mem_res=42860, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7419100, free=292628, buffers=356268, cached=8435364, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.11, five_min_avg=3.19, fifteen_min_avg=1.69, cpu_share=7.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:43:34.486 7f8a1ae56a40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:43:37.173 7f8a1ae56a40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:43:41.609 7f8a1ae56a40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:43:59.837 7f8a1ab76f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:44:08.131 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12894696, partition_space_available_1k=68195788, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=405396, cpu_share=0.0, mem_res=9376, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15720, cpu_share=0.0, mem_res=10876, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14436, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54152, cpu_share=0.0, mem_res=42748, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7650164, free=190824, buffers=361484, cached=8302512, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.67, five_min_avg=3.34, fifteen_min_avg=1.84, cpu_share=12.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:44:26.195 7f8a1ab76ae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:44:31.537 7f8a1ab76ae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:44:34.129 7f8a1ae56ea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:44:37.803 7f8a1ae56ea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:45:08.665 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12915816, partition_space_available_1k=68174668, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=386672, cpu_share=0.02, mem_res=10960, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17316, cpu_share=0.02, mem_res=12328, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14436, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54144, cpu_share=0.0, mem_res=42860, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7679232, free=416748, buffers=362684, cached=8048444, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.17, five_min_avg=4.13, fifteen_min_avg=2.23, cpu_share=12.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:46:08.031 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12922064, partition_space_available_1k=68168420, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=386816, cpu_share=0.0, mem_res=11092, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17468, cpu_share=0.0, mem_res=12460, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14436, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54296, cpu_share=0.0, mem_res=42948, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7699120, free=384736, buffers=363180, cached=8059044, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.84, five_min_avg=3.65, fifteen_min_avg=2.18, cpu_share=8.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:47:08.163 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12929804, partition_space_available_1k=68160680, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=388680, cpu_share=0.0, mem_res=12012, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17748, cpu_share=0.0, mem_res=12856, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14436, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54328, cpu_share=0.0, mem_res=42944, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7648856, free=424620, buffers=363212, cached=8069324, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.24, five_min_avg=3.34, fifteen_min_avg=2.16, cpu_share=8.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:48:03.890 7f8a1ab76400 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:48:07.991 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12936744, partition_space_available_1k=68153740, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=388952, cpu_share=0.0, mem_res=12388, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17912, cpu_share=0.0, mem_res=12988, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14436, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54400, cpu_share=0.0, mem_res=42932, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7648248, free=415372, buffers=363284, cached=8078364, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.0, five_min_avg=3.13, fifteen_min_avg=2.17, cpu_share=8.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:49:04.089 7f8a1ae56e00 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:49:06.619 7f8a1ab76220 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:49:08.275 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12948292, partition_space_available_1k=68142192, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=389756, cpu_share=0.01, mem_res=13556, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18240, cpu_share=0.01, mem_res=13120, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14436, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54388, cpu_share=0.0, mem_res=42940, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7831396, free=218360, buffers=364284, cached=8091736, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.39, five_min_avg=3.31, fifteen_min_avg=2.29, cpu_share=11.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:49:10.600 7f8a1b9954a0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:50:07.805 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14181040, partition_space_available_1k=66909444, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=305472, cpu_share=0.0, mem_res=13948, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18324, cpu_share=0.0, mem_res=13384, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14428, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54036, cpu_share=0.0, mem_res=42744, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7847448, free=447828, buffers=379780, cached=7841868, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.38, five_min_avg=3.54, fifteen_min_avg=2.43, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:51:08.265 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14216756, partition_space_available_1k=66873728, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=307196, cpu_share=0.02, mem_res=15136, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18968, cpu_share=0.02, mem_res=13912, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14428, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54076, cpu_share=0.0, mem_res=42820, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7947772, free=301004, buffers=385264, cached=7882948, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.88, five_min_avg=3.3, fifteen_min_avg=2.41, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:52:08.271 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14237612, partition_space_available_1k=66852872, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=309956, cpu_share=0.02, mem_res=16968, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20152, cpu_share=0.02, mem_res=14836, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14428, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53968, cpu_share=0.0, mem_res=42776, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7915416, free=309552, buffers=385356, cached=7906132, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.39, five_min_avg=3.14, fifteen_min_avg=2.42, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:53:08.649 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14246940, partition_space_available_1k=66843544, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=308272, cpu_share=0.01, mem_res=17232, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20292, cpu_share=0.01, mem_res=14968, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14428, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53976, cpu_share=0.0, mem_res=42972, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7940020, free=286600, buffers=390552, cached=7899888, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.05, five_min_avg=3.11, fifteen_min_avg=2.45, cpu_share=10.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:53:16.844 7f8a1ab76540 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:54:08.247 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14250756, partition_space_available_1k=66839728, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=308544, cpu_share=0.0, mem_res=17496, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20460, cpu_share=0.0, mem_res=15100, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14428, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53932, cpu_share=0.0, mem_res=42692, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7947672, free=264660, buffers=391256, cached=7913276, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.98, five_min_avg=2.8, fifteen_min_avg=2.38, cpu_share=8.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:54:39.544 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:54:42.016 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:54:45.853 7f8a1ab76720 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:55:08.246 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14265976, partition_space_available_1k=66824508, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=306808, cpu_share=0.0, mem_res=18016, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20540, cpu_share=0.0, mem_res=15232, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14428, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53884, cpu_share=0.0, mem_res=42752, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7974136, free=294492, buffers=388832, cached=7858648, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.85, five_min_avg=3.05, fifteen_min_avg=2.49, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:56:08.415 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14279696, partition_space_available_1k=66810788, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=308244, cpu_share=0.01, mem_res=18528, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20976, cpu_share=0.01, mem_res=15364, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14428, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54032, cpu_share=0.0, mem_res=42616, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7856072, free=393212, buffers=389264, cached=7876708, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.73, five_min_avg=2.87, fifteen_min_avg=2.46, cpu_share=9.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:57:08.688 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14632932, partition_space_available_1k=66457552, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292820, cpu_share=0.0, mem_res=18528, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21000, cpu_share=0.0, mem_res=15364, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14424, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53836, cpu_share=0.0, mem_res=42544, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7939572, free=425132, buffers=395724, cached=7757516, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.46, five_min_avg=2.96, fifteen_min_avg=2.51, cpu_share=10.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:57:11.833 7f8a1b9954a0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:57:38.086 7f8a1b9954a0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:58:04.145 7f8a1ab5bb80 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:58:08.405 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14641828, partition_space_available_1k=66448656, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=291192, cpu_share=0.01, mem_res=19188, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21048, cpu_share=0.01, mem_res=15496, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14424, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53708, cpu_share=0.0, mem_res=42480, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7939564, free=428156, buffers=398288, cached=7752460, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.27, five_min_avg=2.96, fifteen_min_avg=2.54, cpu_share=11.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:58:51.384 7f8a1ae56a40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:58:54.406 7f8a1ae56e00 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/27/2025 01:59:08.083 7f8a1db14680 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1739-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14657804, partition_space_available_1k=66432680, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=288960, cpu_share=0.01, mem_res=18912, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21104, cpu_share=0.01, mem_res=15496, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14424, cpu_share=0.0, mem_res=8844, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53808, cpu_share=0.0, mem_res=42700, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7920968, free=478068, buffers=399492, cached=7719976, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.78, five_min_avg=2.89, fifteen_min_avg=2.54, cpu_share=11.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/27/2025 01:59:51.329 7f8a1ae56ae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map