12/11/2025 02:20:03.040 7fdb35bf8740 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 12/11/2025 02:20:03.040 7fdb35bf8740 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 12/11/2025 02:20:03.040 7fdb35bf8740 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 12/11/2025 02:20:03.043 7fdb35bf8740 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:20:03.107 7fdb35bf8740 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 12/11/2025 02:20:03.108 7fdb31ac7e00 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 12/11/2025 02:20:03.108 7fdb31ac7e00 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 12/11/2025 02:20:03.109 7fdb31527220 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 12/11/2025 02:20:03.109 7fdb31527220 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/11/2025 02:20:03.109 7fdb31527220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized] connection down >>, ] >> 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 12/11/2025 02:20:03.112 7fdb31527220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. analytics_node_ip = { rest_api_ip : 10.0.0.22host_ip : 10.0.0.22 } >> 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1765419603109741 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 12/11/2025 02:20:03.113 7fdb31527220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.114 7fdb315275e0 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 12/11/2025 02:20:03.122 7fdb306cf900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.122 7fdb306cf900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 12/11/2025 02:20:03.122 7fdb306cf900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.124 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.124 7fdb306cfd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 12/11/2025 02:20:03.125 7fdb306cfd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.126 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.127 7fdb306cfd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/11/2025 02:20:03.127 7fdb306cfd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.127 7fdb306cf900 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 12/11/2025 02:20:03.127 7fdb306cf900 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 12/11/2025 02:20:03.128 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.128 7fdb306cfd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/11/2025 02:20:03.128 7fdb306cfd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.128 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.128 7fdb306cfd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/11/2025 02:20:03.128 7fdb306cfd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:20:03.133 7fdb315275e0 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 12/11/2025 02:20:03.134 7fdb315275e0 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 12/11/2025 02:20:03.134 7fdb315275e0 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 12/11/2025 02:20:03.135 7fdb315275e0 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 12/11/2025 02:20:03.140 7fdb315275e0 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-4880-1.-0 12/11/2025 02:20:07.111 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/11/2025 02:20:07.112 7fdb306cfd60 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 12/11/2025 02:20:07.112 7fdb306cfd60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/11/2025 02:20:07.113 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/11/2025 02:20:07.114 7fdb306e0b80 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/11/2025 02:20:07.114 7fdb306e0b80 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/11/2025 02:20:07.116 7fdb306e0720 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 12/11/2025 02:20:07.117 7fdb306e0720 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/11/2025 02:20:07.117 7fdb306cfd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 12/11/2025 02:20:07.117 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 12/11/2025 02:20:07.117 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 12/11/2025 02:20:07.117 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:20:07.117 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/11/2025 02:20:07.118 7fdb306cfd60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 12/11/2025 02:20:07.118 7fdb31a21860 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/11/2025 02:20:07.119 7fdb31a21860 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/11/2025 02:20:10.460 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOipaPdvNG3DiJUDS8ooUTJKBASYu1qweeP7nKm8hHPKczfpQhj03lxeNE_JjCLiPT_kHFsNP7MS6f-mvxsk7B_8jJ0B6TUnOP2odM513yqNa7GIaWSvrmbILv-OKfOwyDYPAYzh-GQ-bVWrdoRN872TGZX2RjmQwdxGp7eSeDjpUhoc 12/11/2025 02:20:10.461 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:20:10.462 7fdb31a21860 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 955 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:20:10.826 7fdb31a21860 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOipanSNTCgw51edj5LiL7gSPAVYMlL9h1Kx7vZ2G69uZn-KLsQHLJucEGo4mp1TsC84vNdCUB7OdB_oh8As-6rGUxvbNHtdlJlc4irqsX0bZ2plIbb48tQG7Jejqz8_M3ohy-vjbiVXyMBz_sSgo3hUI3LgNikMeQaou49lGMGlRs-0 12/11/2025 02:20:10.826 7fdb31a21860 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:20:10.828 7fdb3220c2c0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1430 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:20:16.085 7fdb306e0720 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 12/11/2025 02:20:16.086 7fdb306e0720 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/11/2025 02:20:16.086 7fdb31a41040 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 12/11/2025 02:20:16.086 7fdb31a41040 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 12/11/2025 02:20:16.086 7fdb31a41040 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 12/11/2025 02:20:16.087 7fdb31a41040 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:20:16.087 7fdb31a41040 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/11/2025 02:20:16.087 7fdb31a21860 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/11/2025 02:20:16.087 7fdb31a21860 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/11/2025 02:20:19.481 7fdb31527220 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-4880-1.-0'] 12/11/2025 02:20:23.143 7fdb315275e0 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 12/11/2025 02:20:23.143 7fdb315275e0 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 12/11/2025 02:20:23.143 7fdb315275e0 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 12/11/2025 02:20:23.145 7fdb315275e0 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-4880-1.-0 12/11/2025 02:20:23.147 7fdb315275e0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data b'{"ip-address": "10.0.0.22", "instance-id": "0", "redis-ip": "10.0.0.22", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 12/11/2025 02:20:23.149 7fdb315275e0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.22'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.22'), ('redis-port', '6379')]), event GET 12/11/2025 02:20:28.581 7fdb31527220 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data b'{"ip-address": "10.0.0.22", "instance-id": "0", "redis-ip": "10.0.0.22", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-4880-1.-0') 12/11/2025 02:20:29.889 7fdb31527220 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data b'{"ip-address": "10.0.0.22", "instance-id": "0", "redis-ip": "10.0.0.22", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1765419628755001, \\"1\\": 1765419628760651, \\"2\\": 1765419628775529, \\"3\\": 1765419628811098, \\"4\\": 1765419628811785, \\"6\\": 1765419628818106, \\"5\\": 1765419628818990, \\"7\\": 1765419628826980, \\"8\\": 1765419628895844, \\"9\\": 1765419628942285, \\"10\\": 1765419628952926, \\"11\\": 1765419628961848, \\"12\\": 1765419628975654, \\"13\\": 1765419628989744, \\"14\\": 1765419628995422, \\"15\\": 1765419629015685, \\"16\\": 1765419629026221, \\"17\\": 1765419629048507, \\"18\\": 1765419629069281, \\"19\\": 1765419629083673, \\"21\\": 1765419629098320, \\"22\\": 1765419629124038, \\"23\\": 1765419629133291, \\"24\\": 1765419629140748, \\"25\\": 1765419629181207, \\"26\\": 1765419629193201, \\"27\\": 1765419629211547, \\"28\\": 1765419629236401, \\"29\\": 1765419629256135, \\"20\\": 1765419629275354}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-4880-1.-0') 12/11/2025 02:21:11.200 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOiqXwnMZdrlw1QoIwPe06kfiB8MfuLSQ7KVvYb1CUXd8qoql9tmnEOBf8bkChMNGWE02G7EcJKkpLNxnQsh3R6UKk7WjPomK-wJgFYQhR8HtXjqIrOP-qIvpaCxra6foaLlH1PBYD30jTI5GyLm_FXJNgOZmbNO7Uiov6N6hnYlkKe0 12/11/2025 02:21:11.201 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:21:11.203 7fdb316c7860 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1860 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:21:11.550 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOiqX5DgdVO9haCSpR_hvXyTirQ7V_GCFLd_D3JgOGKbCyUfr2VOnlFlxmYizsyMtzzpFMjXKma6ro_ScdiKJI-xUuI4ck74N0itJTe1oviZrlS5DSEbd0yuok79ydnGOZqABoVyfVBn_fz38zjPtSAIYIPVnhEwWvGjbykSSN6rSqA0 12/11/2025 02:21:11.550 7fdb306cfd60 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:21:11.552 7fdb316c7860 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1378 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:22:05.715 7fdb316c7860 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:22:07.852 7fdb316c7860 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:22:11.904 7fdb316c7860 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOirT822TlIUbvqebXLGxPaTftPLJh3yAtBHxfddNxAtEB8vK7NB21KBz8KMvWmjxWNJ3vwvFMMTBfqbUt3oOm-pER_cUKAlYZc_kbJAHSLaW0CqbC0tmh2ysP4QMKefjXLvcqz362lr_W6nv-h3eFxKAriPZQa1Zjj2K1Esytd28L08 12/11/2025 02:22:11.904 7fdb316c7860 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:22:11.906 7fdb3220c2c0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1187 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:22:12.259 7fdb316c7860 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOirUl2tltcYV7SuJO1kk4uGLIJgIppuh-yRKumuAeCHlqXAMzUpizXOHe2Gw1PTiSgEmNmcqauOnOgyzVRE7-1mB5jWkHKrIGBsgF6NjpCKbmulzvXLxlXvFL9tvUW3ND4YZRTHuwrCITzAk20CujpaAO9Ig97Qv0cumqfsZXYmUg1M 12/11/2025 02:22:12.259 7fdb316c7860 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:22:12.262 7fdb316c7860 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-4880-1 as ['NodeStatus'] 12/11/2025 02:22:12.263 7fdb3220c2c0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3276 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:23:07.336 7fdb316c7860 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:23:12.068 7fdb316c7860 [contrail-analytics-api] [DEBUG]: resource list for virtual-network is None 12/11/2025 02:23:12.675 7fdb316c7860 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOisQAMiAw8yk5lzDNDPWoEky0qxrL45aKmlJLQhNaZRcz44Nw7uDVFaMMeNRAhc4rlrUaVpxw0_WnMYisDnJoIkTlKEHSmTgs8w2dynuDQE9_-w7JyHQi9nDngNaAt6NmVid7du8o1zgInStVG-HGt1BwBrJqOTyiSce4cn8UVKyz14 12/11/2025 02:23:12.675 7fdb316c7860 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:23:12.676 7fdb316c7860 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-4880-1 as ['VrouterAgent'] 12/11/2025 02:23:12.677 7fdb306e0ea0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1795 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:23:13.342 7fdb316c7860 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOisQO8sejEFSyfWBmq3qQYFI7KBAWWF5ja-zlixjZS0OXJGIbG_8dxgxml7XcqfxO8C2a8uDkEpI1CQYwPqoxFRjLYhBeLOwVJg1QQ8MupFtRiAAC7OeYzMOizpo9x245YFTEuCpMW2BR-IhbIaIEFyxJecV-rGwemqxsRmbN81qPnU 12/11/2025 02:23:13.342 7fdb316c7860 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:23:13.344 7fdb316c7860 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-4880-1 as ['NodeStatus'] 12/11/2025 02:23:13.345 7fdb3220c2c0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2430 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:23:25.729 7fdb316c7860 [contrail-analytics-api] [INFO]: Received Query: {'table': 'ObjectVNTable', 'start_time': 1765419789862993, 'end_time': 1765419805721506, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'Messagetype', 'ModuleId', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-23147250:ctest-vn22-59799168', 'op': 1, 'value2': None}]]} 12/11/2025 02:23:25.729 7fdb316c7860 [contrail-analytics-api] [INFO]: Starting Query 5f81196f-d638-11f0-a5af-00000a000016 12/11/2025 02:23:25.729 7fdb316c7860 [contrail-analytics-api] [INFO]: Table is ObjectVNTable 12/11/2025 02:23:25.729 7fdb316c7860 [contrail-analytics-api] [INFO]: {'MessageTS': 'int', 'ObjectId': 'string', 'Source': 'string', 'ModuleId': 'string', 'Messagetype': 'string', 'ObjectLog': 'string', 'SystemLog': 'string'} 12/11/2025 02:23:25.736 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Accepted at time 1765419805 , Progress 10 12/11/2025 02:23:25.736 7fdb316c7860 [contrail-analytics-api] [INFO]: Polling REPLY:5f81196f-d638-11f0-a5af-00000a000016 for query result 12/11/2025 02:23:26.738 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Progress is {'progress': 100, 'chunks': [{'progress': 100, 'lines': 3, 'count': 25, 'ttl': 299, 'start_time': '1765419789862993', 'end_time': '1765419805721506', 'href': '/analytics/query/5f81196f-d638-11f0-a5af-00000a000016/chunk-final/0'}]} time 1765419806 12/11/2025 02:23:26.743 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Result available at time 1765419806 12/11/2025 02:23:26.751 7fdb316c7860 [contrail-analytics-api] [INFO]: Received Query: {'table': 'ObjectVMTable', 'start_time': 1765419789862993, 'end_time': 1765419806744812, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '403efccc-7c3a-4a89-86c7-4f2473fa8968', 'op': 1, 'value2': None}]]} 12/11/2025 02:23:26.751 7fdb316c7860 [contrail-analytics-api] [INFO]: Starting Query 601d0d87-d638-11f0-9dfd-00000a000016 12/11/2025 02:23:26.751 7fdb316c7860 [contrail-analytics-api] [INFO]: Table is ObjectVMTable 12/11/2025 02:23:26.751 7fdb316c7860 [contrail-analytics-api] [INFO]: {'MessageTS': 'int', 'ObjectId': 'string', 'Source': 'string', 'ModuleId': 'string', 'Messagetype': 'string', 'ObjectLog': 'string', 'SystemLog': 'string'} 12/11/2025 02:23:26.755 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Accepted at time 1765419806 , Progress 15 12/11/2025 02:23:26.755 7fdb316c7860 [contrail-analytics-api] [INFO]: Polling REPLY:601d0d87-d638-11f0-9dfd-00000a000016 for query result 12/11/2025 02:23:27.757 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Progress is {'progress': 100, 'chunks': [{'progress': 100, 'lines': 1, 'count': 3, 'ttl': 299, 'start_time': '1765419789862993', 'end_time': '1765419806744812', 'href': '/analytics/query/601d0d87-d638-11f0-9dfd-00000a000016/chunk-final/0'}]} time 1765419807 12/11/2025 02:23:27.761 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Result available at time 1765419807 12/11/2025 02:23:27.770 7fdb316c7860 [contrail-analytics-api] [INFO]: Received Query: {'table': 'ObjectRoutingInstance', 'start_time': 1765419789862993, 'end_time': 1765419807762233, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-23147250:ctest-vn22-59799168:ctest-vn22-59799168', 'op': 1, 'value2': None}]]} 12/11/2025 02:23:27.770 7fdb316c7860 [contrail-analytics-api] [INFO]: Starting Query 60b87a91-d638-11f0-a324-00000a000016 12/11/2025 02:23:27.770 7fdb316c7860 [contrail-analytics-api] [INFO]: Table is ObjectRoutingInstance 12/11/2025 02:23:27.770 7fdb316c7860 [contrail-analytics-api] [INFO]: {'MessageTS': 'int', 'ObjectId': 'string', 'Source': 'string', 'ModuleId': 'string', 'Messagetype': 'string', 'ObjectLog': 'string', 'SystemLog': 'string'} 12/11/2025 02:23:27.776 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Accepted at time 1765419807 , Progress 15 12/11/2025 02:23:27.776 7fdb316c7860 [contrail-analytics-api] [INFO]: Polling REPLY:60b87a91-d638-11f0-a324-00000a000016 for query result 12/11/2025 02:23:28.779 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Progress is {'progress': 100, 'chunks': [{'progress': 100, 'lines': 1, 'count': 1, 'ttl': 299, 'start_time': '1765419789862993', 'end_time': '1765419807762233', 'href': '/analytics/query/60b87a91-d638-11f0-a324-00000a000016/chunk-final/0'}]} time 1765419808 12/11/2025 02:23:28.784 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Result available at time 1765419808 12/11/2025 02:23:28.793 7fdb316c7860 [contrail-analytics-api] [INFO]: Received Query: {'table': 'ObjectVMTable', 'start_time': 1765419789862993, 'end_time': 1765419808785532, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '403efccc-7c3a-4a89-86c7-4f2473fa8968', 'op': 1, 'value2': None}]]} 12/11/2025 02:23:28.793 7fdb316c7860 [contrail-analytics-api] [INFO]: Starting Query 61548dab-d638-11f0-a4b3-00000a000016 12/11/2025 02:23:28.793 7fdb316c7860 [contrail-analytics-api] [INFO]: Table is ObjectVMTable 12/11/2025 02:23:28.793 7fdb316c7860 [contrail-analytics-api] [INFO]: {'MessageTS': 'int', 'ObjectId': 'string', 'Source': 'string', 'ModuleId': 'string', 'Messagetype': 'string', 'ObjectLog': 'string', 'SystemLog': 'string'} 12/11/2025 02:23:28.797 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Accepted at time 1765419808 , Progress 10 12/11/2025 02:23:28.797 7fdb316c7860 [contrail-analytics-api] [INFO]: Polling REPLY:61548dab-d638-11f0-a4b3-00000a000016 for query result 12/11/2025 02:23:29.799 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Progress is {'progress': 100, 'chunks': [{'progress': 100, 'lines': 1, 'count': 4, 'ttl': 299, 'start_time': '1765419789862993', 'end_time': '1765419808785532', 'href': '/analytics/query/61548dab-d638-11f0-a4b3-00000a000016/chunk-final/0'}]} time 1765419809 12/11/2025 02:23:29.802 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Result available at time 1765419809 12/11/2025 02:23:29.811 7fdb316c7860 [contrail-analytics-api] [INFO]: Received Query: {'table': 'ObjectRoutingInstance', 'start_time': 1765419789862993, 'end_time': 1765419809804597, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-23147250:ctest-vn22-59799168:ctest-vn22-59799168', 'op': 1, 'value2': None}]]} 12/11/2025 02:23:29.812 7fdb316c7860 [contrail-analytics-api] [INFO]: Starting Query 61f00554-d638-11f0-9069-00000a000016 12/11/2025 02:23:29.812 7fdb316c7860 [contrail-analytics-api] [INFO]: Table is ObjectRoutingInstance 12/11/2025 02:23:29.812 7fdb316c7860 [contrail-analytics-api] [INFO]: {'MessageTS': 'int', 'ObjectId': 'string', 'Source': 'string', 'ModuleId': 'string', 'Messagetype': 'string', 'ObjectLog': 'string', 'SystemLog': 'string'} 12/11/2025 02:23:29.816 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Accepted at time 1765419809 , Progress 10 12/11/2025 02:23:29.816 7fdb316c7860 [contrail-analytics-api] [INFO]: Polling REPLY:61f00554-d638-11f0-9069-00000a000016 for query result 12/11/2025 02:23:30.819 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Progress is {'progress': 100, 'chunks': [{'progress': 100, 'lines': 1, 'count': 1, 'ttl': 299, 'start_time': '1765419789862993', 'end_time': '1765419809804597', 'href': '/analytics/query/61f00554-d638-11f0-9069-00000a000016/chunk-final/0'}]} time 1765419810 12/11/2025 02:23:30.823 7fdb316c7860 [contrail-analytics-api] [INFO]: Query Result available at time 1765419810 12/11/2025 02:23:44.070 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: resource list for virtual-network is None 12/11/2025 02:23:44.977 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: resource list for virtual-network is None 12/11/2025 02:24:13.719 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOitNqrBWgbLf3p-pSm83P6kwK3579PivGvru6XUP_2zhp_6GB7xfb8KVwcmgLAPk4EghkA-467Yc-38oy9NwhftgNi1txUQAiu8Vgkdwer6IYU3-67yXR33oZt19zy0NIqsm5JaMR_jI9FH9fNh_G-t7tKm-WEajRygfiiAKvO9np28 12/11/2025 02:24:13.719 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:24:13.721 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-4880-1 as ['VrouterAgent'] 12/11/2025 02:24:13.722 7fdb306e0b80 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2234 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:24:14.110 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABpOitO_u2hQ633yv0Om4HFtFMLyousJkTF7EhZLahJST1c_iglus9g42A_ugM_XsFckXbycA9_QSjUB6_j7S_iabCFiHYMuFirFsuVuQa250B2Uv0Ra8rdCuMbXz7TbsORclTuGmuJhet_FwfmlpJuzO2dlrZgqZa1NL1F6a-4tl7I13U 12/11/2025 02:24:14.110 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: user resources are None 12/11/2025 02:24:14.113 7fdb3220c2c0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-4880-1 as ['NodeStatus'] 12/11/2025 02:24:14.113 7fdb306e0b80 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.22 object_type = vrouter request_url = http://10.0.0.22:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3050 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-4880-1. >> 12/11/2025 02:26:58.792 7f30cf5b5b40 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 12/11/2025 02:26:58.793 7f30cf5b5b40 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 12/11/2025 02:26:58.793 7f30cf5b5b40 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 12/11/2025 02:26:58.794 7f30cf5b5b40 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:26:58.949 7f30cf5b5b40 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 12/11/2025 02:26:58.950 7f30cb6cce00 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 12/11/2025 02:26:58.951 7f30cb6cce00 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 12/11/2025 02:26:58.951 7f30cb607220 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 12/11/2025 02:26:58.951 7f30cb607220 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/11/2025 02:26:58.951 7f30cb607220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized] connection down >>, ] >> 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. analytics_node_ip = { rest_api_ip : 10.0.0.22host_ip : 10.0.0.22 } >> 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.952 7f30cb607220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/11/2025 02:26:58.953 7f30cb607220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.953 7f30cb607220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.953 7f30cb607220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1765420018951704 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 12/11/2025 02:26:58.953 7f30cb607220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.954 7f30cb6075e0 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 12/11/2025 02:26:58.962 7f30ca7ac540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.963 7f30ca7ac540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 12/11/2025 02:26:58.963 7f30ca7ac540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.967 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.967 7f30cbb22ae0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Down description = >>, ] description = Redis-UVE:10.0.0.22:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 12/11/2025 02:26:58.967 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.969 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.969 7f30cbb22ae0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 12/11/2025 02:26:58.969 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.971 7f30ca7ac540 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 12/11/2025 02:26:58.971 7f30ca7ac540 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 12/11/2025 02:26:58.972 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.972 7f30cbb22ae0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 12/11/2025 02:26:58.972 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.972 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.972 7f30cbb22ae0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 12/11/2025 02:26:58.973 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.976 7f30cb6075e0 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-4880-1.-0'] 12/11/2025 02:26:58.979 7f30cb6075e0 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 12/11/2025 02:26:58.979 7f30cb6075e0 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 12/11/2025 02:26:58.979 7f30cb6075e0 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 12/11/2025 02:26:58.979 7f30cb6075e0 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-4880-1.-0 12/11/2025 02:26:58.982 7f30cb6075e0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data b'{"ip-address": "10.0.0.22", "instance-id": "0", "redis-ip": "10.0.0.22", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1765419628755001, \\"1\\": 1765419628760651, \\"2\\": 1765419628775529, \\"3\\": 1765419628811098, \\"4\\": 1765419628811785, \\"6\\": 1765419628818106, \\"5\\": 1765419628818990, \\"7\\": 1765419628826980, \\"8\\": 1765419628895844, \\"9\\": 1765419628942285, \\"10\\": 1765419628952926, \\"11\\": 1765419628961848, \\"12\\": 1765419628975654, \\"13\\": 1765419628989744, \\"14\\": 1765419628995422, \\"15\\": 1765419629015685, \\"16\\": 1765419629026221, \\"17\\": 1765419629048507, \\"18\\": 1765419629069281, \\"19\\": 1765419629083673, \\"21\\": 1765419629098320, \\"22\\": 1765419629124038, \\"23\\": 1765419629133291, \\"24\\": 1765419629140748, \\"25\\": 1765419629181207, \\"26\\": 1765419629193201, \\"27\\": 1765419629211547, \\"28\\": 1765419629236401, \\"29\\": 1765419629256135, \\"20\\": 1765419629275354}"}', event None 12/11/2025 02:26:58.983 7f30cb6075e0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.22'), ('partitions', '{"0": 1765419628755001, "1": 1765419628760651, "2": 1765419628775529, "3": 1765419628811098, "4": 1765419628811785, "6": 1765419628818106, "5": 1765419628818990, "7": 1765419628826980, "8": 1765419628895844, "9": 1765419628942285, "10": 1765419628952926, "11": 1765419628961848, "12": 1765419628975654, "13": 1765419628989744, "14": 1765419628995422, "15": 1765419629015685, "16": 1765419629026221, "17": 1765419629048507, "18": 1765419629069281, "19": 1765419629083673, "21": 1765419629098320, "22": 1765419629124038, "23": 1765419629133291, "24": 1765419629140748, "25": 1765419629181207, "26": 1765419629193201, "27": 1765419629211547, "28": 1765419629236401, "29": 1765419629256135, "20": 1765419629275354}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.22'), ('redis-port', '6379')]), event GET 12/11/2025 02:26:58.983 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:58.983 7f30cbb22ae0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 12/11/2025 02:26:58.983 7f30cbb22ae0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/11/2025 02:26:59.426 7f30cb607220 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data None, event WatchedEvent(type='DELETED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-4880-1.-0') 12/11/2025 02:26:59.427 7f30cb607220 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 12/11/2025 02:27:00.305 7f30cb607220 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-4880-1.-0, data b'{"ip-address": "10.0.0.22", "instance-id": "0", "redis-ip": "10.0.0.22", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CREATED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-4880-1.-0') 12/11/2025 02:27:00.307 7f30cb607220 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-4880-1.-0'] 12/11/2025 02:27:02.952 7f30ca7c2680 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/11/2025 02:27:02.953 7f30ca7c2680 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4880-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.22:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.22:6379 server_addrs = [ 10.0.0.22:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.22:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.22:8082, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/11/2025 02:27:02.954 7f30ca7c2680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/11/2025 02:27:02.955 7f30cc4d62c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/11/2025 02:27:02.955 7f30cc4d62c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/11/2025 02:27:02.958 7f30ca7c2b80 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 12/11/2025 02:27:02.958 7f30ca7c2b80 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/11/2025 02:27:02.959 7f30ca7c2680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 12/11/2025 02:27:02.959 7f30ca7c2680 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 12/11/2025 02:27:02.959 7f30ca7c2680 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 12/11/2025 02:27:02.959 7f30ca7c2680 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 12/11/2025 02:27:02.959 7f30ca7c2680 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/11/2025 02:27:02.959 7f30ca7c2680 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 12/11/2025 02:27:02.960 7f30ca7c29a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/11/2025 02:27:02.960 7f30ca7c29a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]