2026-04-20 05:21:28.502 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:21:31.006 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:21:31.006 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:21:31.030 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:21:31.030 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:21:31.042 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:21:31.042 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:21:31.042 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:21:31.054 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:21:31.062 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:21:31.062 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:21:31.073 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:21:31.074 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:21:31.074 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:21:31.074 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:21:31.075 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:21:31.081 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:21:31.081 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:21:31.081 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:21:31.082 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:21:31.082 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:21:31.082 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:21:31.082 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:21:31.082 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:21:31.082 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:21:31.082 [info] <0.240.0> Will wait for 57568 milliseconds before proceeding with registration... 2026-04-20 05:22:08.457 [info] <0.302.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2026-04-20 05:22:28.650 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:22:28.650 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:22:28.651 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:28.661 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:22:28.661 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:22:29.162 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:29.169 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:22:29.169 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:22:29.672 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:29.673 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:29.673 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:22:30.175 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:30.176 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:30.176 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:22:30.678 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:30.678 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:30.678 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:22:31.180 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:31.181 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:31.181 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:22:31.683 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:31.684 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:31.685 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:22:32.186 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:32.187 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:32.187 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:22:32.688 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:32.689 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:32.689 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:22:33.190 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:22:33.191 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:22:33.191 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:22:33.691 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:22:33.693 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:22:33.884 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:22:33.884 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:22:33.920 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:22:33.921 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:22:33.964 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:22:33.964 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:22:33.964 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:22:33.964 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:22:33.964 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:22:33.964 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:22:33.964 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:22:33.964 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:22:33.964 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:22:33.965 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:22:33.965 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:22:33.966 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:22:33.966 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:22:33.966 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:22:33.966 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:22:33.968 [info] <0.480.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:22:33.968 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:22:34.005 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:22:34.006 [info] <0.484.0> Starting rabbit_node_monitor 2026-04-20 05:22:34.006 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:22:34.006 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:22:34.006 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:22:34.006 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:22:34.052 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:22:34.053 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:22:34.053 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:22:34.053 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:22:34.054 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:22:34.103 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:22:34.104 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:22:34.104 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:22:34.104 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:22:34.104 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:22:34.105 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:22:34.105 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:22:34.105 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:22:34.105 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:22:34.105 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:22:34.105 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:22:34.105 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:22:34.105 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:22:34.106 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:22:34.107 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:22:34.107 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:22:34.107 [info] <0.240.0> Importing users... 2026-04-20 05:22:34.107 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:22:34.117 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:22:34.120 [info] <0.240.0> Importing vhosts... 2026-04-20 05:22:34.120 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:22:34.160 [info] <0.532.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:22:34.167 [info] <0.532.0> Starting message stores for vhost '/' 2026-04-20 05:22:34.167 [info] <0.536.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:22:34.169 [info] <0.532.0> Started message store of type transient for vhost '/' 2026-04-20 05:22:34.169 [info] <0.539.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:22:34.170 [warning] <0.539.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:22:34.172 [info] <0.532.0> Started message store of type persistent for vhost '/' 2026-04-20 05:22:34.173 [info] <0.240.0> Importing user permissions... 2026-04-20 05:22:34.174 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:22:34.178 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:22:34.178 [info] <0.240.0> Importing parameters... 2026-04-20 05:22:34.178 [info] <0.240.0> Importing global parameters... 2026-04-20 05:22:34.178 [info] <0.240.0> Importing policies... 2026-04-20 05:22:34.185 [info] <0.240.0> Importing queues... 2026-04-20 05:22:34.185 [info] <0.240.0> Importing exchanges... 2026-04-20 05:22:34.185 [info] <0.240.0> Importing bindings... 2026-04-20 05:22:34.185 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:22:34.185 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:22:34.185 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:22:34.185 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:22:34.185 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:22:34.190 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:22:34.200 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:22:34.200 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:22:34.200 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:22:34.200 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:22:34.200 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:22:34.202 [info] <0.585.0> started TCP listener on [::]:5673 2026-04-20 05:22:34.202 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:22:34.202 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:22:34.202 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:22:34.202 [info] <0.587.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:22:34.229 [info] <0.637.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:22:34.229 [info] <0.743.0> Statistics database started. 2026-04-20 05:22:34.229 [info] <0.742.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:22:34.230 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:22:34.302 [info] <0.753.0> accepting AMQP connection <0.753.0> (10.0.0.50:58320 -> 10.0.0.50:5673) 2026-04-20 05:22:34.317 [info] <0.753.0> connection <0.753.0> (10.0.0.50:58320 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:22:34.359 [warning] <0.775.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Unable to start queue mirror on node ''contrail@cn-jenkins-deploy-platform-ansible-os-5649-1''. Target virtual host is not running: {'EXIT',{aborted,{no_exists,[rabbit_vhost,<<"/">>]}}} 2026-04-20 05:22:34.363 [info] <0.785.0> accepting AMQP connection <0.785.0> (10.0.0.50:58336 -> 10.0.0.50:5673) 2026-04-20 05:22:34.365 [info] <0.785.0> connection <0.785.0> (10.0.0.50:58336 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:22:34.375 [info] <0.753.0> closing AMQP connection <0.753.0> (10.0.0.50:58320 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:22:34.375 [info] <0.785.0> closing AMQP connection <0.785.0> (10.0.0.50:58336 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:22:34.392 [info] <0.802.0> accepting AMQP connection <0.802.0> (10.0.0.50:58352 -> 10.0.0.50:5673) 2026-04-20 05:22:34.393 [info] <0.805.0> accepting AMQP connection <0.805.0> (10.0.0.50:58360 -> 10.0.0.50:5673) 2026-04-20 05:22:34.401 [info] <0.802.0> connection <0.802.0> (10.0.0.50:58352 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:22:34.402 [info] <0.805.0> connection <0.805.0> (10.0.0.50:58360 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:22:34.422 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:22:34.422 [info] <0.302.0> RabbitMQ is asked to stop... 2026-04-20 05:22:34.560 [info] <0.302.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:22:34.560 [info] <0.302.0> Stopping application 'rabbitmq_management' 2026-04-20 05:22:34.565 [warning] <0.593.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:22:34.569 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:22:34.569 [info] <0.302.0> Stopping application 'amqp_client' 2026-04-20 05:22:34.571 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:22:34.571 [info] <0.302.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:22:34.572 [info] <0.302.0> Stopping application 'cowboy' 2026-04-20 05:22:34.572 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:22:34.573 [info] <0.302.0> Stopping application 'cowlib' 2026-04-20 05:22:34.573 [info] <0.302.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:22:34.573 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:22:34.573 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:22:34.577 [info] <0.302.0> Stopping application 'rabbit' 2026-04-20 05:22:34.577 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:22:34.577 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:22:34.577 [info] <0.585.0> stopped TCP listener on [::]:5673 2026-04-20 05:22:34.577 [error] <0.805.0> Error on AMQP connection <0.805.0> (10.0.0.50:58360 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:22:34.577 [error] <0.802.0> Error on AMQP connection <0.802.0> (10.0.0.50:58352 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:22:34.578 [info] <0.509.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:22:34.578 [info] <0.539.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:22:34.585 [info] <0.539.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:22:34.586 [info] <0.536.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:22:34.592 [info] <0.536.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:22:34.594 [info] <0.302.0> Stopping application 'mnesia' 2026-04-20 05:22:34.594 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:22:34.609 [info] <0.302.0> Stopping application 'rabbit_common' 2026-04-20 05:22:34.609 [info] <0.302.0> Stopping application 'sysmon_handler' 2026-04-20 05:22:34.609 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:22:34.609 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:22:34.611 [info] <0.302.0> Stopping application 'os_mon' 2026-04-20 05:22:34.611 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:22:34.613 [info] <0.302.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:22:34.613 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:22:41.948 [info] <0.862.0> Resetting Rabbit forcefully 2026-04-20 05:22:42.818 [info] <0.874.0> RabbitMQ is asked to stop... 2026-04-20 05:22:42.861 [info] <0.874.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'rabbitmq_management' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'amqp_client' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'rabbit' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'mnesia' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'rabbit_common' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'sysmon_handler' 2026-04-20 05:22:42.862 [info] <0.874.0> Stopping application 'os_mon' 2026-04-20 05:22:42.862 [info] <0.874.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:22:42.862 [info] <0.874.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:22:48.243 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:22:50.127 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:22:50.127 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:22:50.333 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:22:50.333 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:22:50.345 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:22:50.345 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:22:50.346 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:22:50.350 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:22:50.355 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:22:50.355 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:22:50.358 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:22:50.358 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:22:50.359 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:22:50.359 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:22:50.359 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:22:50.359 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:22:50.359 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:22:50.359 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:22:50.359 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:22:50.360 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:22:50.360 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:22:50.360 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:22:50.360 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:22:50.360 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:22:50.360 [info] <0.240.0> Will wait for 17864 milliseconds before proceeding with registration... 2026-04-20 05:23:08.225 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:23:08.225 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:23:08.226 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:08.227 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:08.227 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:23:08.730 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:08.730 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:08.731 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:23:09.232 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:09.233 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:09.233 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:23:09.735 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:09.736 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:09.736 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:23:10.238 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:10.239 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:10.239 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:23:10.740 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:10.740 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:10.740 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:23:11.242 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:11.243 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:11.243 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:23:11.745 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:11.746 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:11.746 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:23:12.247 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:12.247 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:12.247 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:23:12.749 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:23:12.749 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:23:12.750 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:23:13.250 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:23:13.252 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:23:13.340 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:23:13.340 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:23:13.381 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:23:13.381 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:23:13.417 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:23:13.418 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:23:13.418 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:23:13.419 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:23:13.419 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:23:13.420 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:23:13.420 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:23:13.421 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:23:13.421 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:23:13.422 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:23:13.422 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:23:13.423 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:23:13.423 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:23:13.423 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:23:13.424 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:23:13.424 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:23:13.425 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:23:13.425 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:23:13.426 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:23:13.426 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:23:13.427 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:23:13.427 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:23:13.427 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:23:13.428 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:23:13.428 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:23:13.428 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:23:13.428 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:23:13.429 [info] <0.452.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:23:13.429 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:23:13.433 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:23:13.433 [info] <0.456.0> Starting rabbit_node_monitor 2026-04-20 05:23:13.433 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:23:13.434 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:23:13.434 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:23:13.434 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:23:13.455 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:23:13.455 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:23:13.456 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:23:13.456 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:23:13.456 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:23:13.483 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:23:13.484 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:23:13.484 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:23:13.485 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:23:13.485 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:23:13.486 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:23:13.486 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:23:13.486 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:23:13.486 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:23:13.486 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:23:13.486 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:23:13.486 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:23:13.487 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:23:13.487 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:23:13.488 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:23:13.488 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:23:13.488 [info] <0.240.0> Importing users... 2026-04-20 05:23:13.488 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:23:13.494 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:23:13.497 [info] <0.240.0> Importing vhosts... 2026-04-20 05:23:13.497 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:23:13.521 [info] <0.504.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:23:13.525 [info] <0.504.0> Starting message stores for vhost '/' 2026-04-20 05:23:13.525 [info] <0.508.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:23:13.526 [info] <0.504.0> Started message store of type transient for vhost '/' 2026-04-20 05:23:13.526 [info] <0.511.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:23:13.527 [warning] <0.511.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:23:13.527 [info] <0.504.0> Started message store of type persistent for vhost '/' 2026-04-20 05:23:13.528 [info] <0.240.0> Importing user permissions... 2026-04-20 05:23:13.528 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:23:13.531 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:23:13.531 [info] <0.240.0> Importing parameters... 2026-04-20 05:23:13.531 [info] <0.240.0> Importing global parameters... 2026-04-20 05:23:13.531 [info] <0.240.0> Importing policies... 2026-04-20 05:23:13.536 [info] <0.240.0> Importing queues... 2026-04-20 05:23:13.536 [info] <0.240.0> Importing exchanges... 2026-04-20 05:23:13.536 [info] <0.240.0> Importing bindings... 2026-04-20 05:23:13.536 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:23:13.536 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:23:13.536 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:23:13.536 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:23:13.536 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:23:13.540 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:23:13.543 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:23:13.543 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:23:13.543 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:23:13.543 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:23:13.543 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:23:13.545 [info] <0.557.0> started TCP listener on [::]:5673 2026-04-20 05:23:13.545 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:23:13.545 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:23:13.545 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:23:13.545 [info] <0.559.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:23:13.578 [info] <0.609.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:23:13.578 [info] <0.715.0> Statistics database started. 2026-04-20 05:23:13.579 [info] <0.714.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:23:13.579 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:23:13.690 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:23:14.094 [info] <0.737.0> accepting AMQP connection <0.737.0> (10.0.0.50:44950 -> 10.0.0.50:5673) 2026-04-20 05:23:14.097 [info] <0.737.0> connection <0.737.0> (10.0.0.50:44950 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:23:14.109 [info] <0.756.0> accepting AMQP connection <0.756.0> (10.0.0.50:44954 -> 10.0.0.50:5673) 2026-04-20 05:23:14.112 [info] <0.756.0> connection <0.756.0> (10.0.0.50:44954 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:23:14.118 [info] <0.737.0> closing AMQP connection <0.737.0> (10.0.0.50:44950 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:23:14.120 [info] <0.756.0> closing AMQP connection <0.756.0> (10.0.0.50:44954 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:23:14.291 [info] <0.772.0> RabbitMQ is asked to stop... 2026-04-20 05:23:14.373 [info] <0.772.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:23:14.373 [info] <0.772.0> Stopping application 'rabbitmq_management' 2026-04-20 05:23:14.375 [warning] <0.565.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:23:14.377 [info] <0.772.0> Stopping application 'amqp_client' 2026-04-20 05:23:14.377 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:23:14.378 [info] <0.772.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:23:14.378 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:23:14.379 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:23:14.379 [info] <0.772.0> Stopping application 'cowboy' 2026-04-20 05:23:14.380 [info] <0.772.0> Stopping application 'cowlib' 2026-04-20 05:23:14.380 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:23:14.380 [info] <0.772.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:23:14.380 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:23:14.382 [info] <0.772.0> Stopping application 'rabbit' 2026-04-20 05:23:14.382 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:23:14.382 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:23:14.382 [info] <0.557.0> stopped TCP listener on [::]:5673 2026-04-20 05:23:14.382 [info] <0.481.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:23:14.382 [info] <0.511.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:23:14.387 [info] <0.511.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:23:14.387 [info] <0.508.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:23:14.391 [info] <0.508.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:23:14.393 [info] <0.772.0> Stopping application 'mnesia' 2026-04-20 05:23:14.394 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:23:14.407 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:23:14.407 [info] <0.772.0> Stopping application 'rabbit_common' 2026-04-20 05:23:14.407 [info] <0.772.0> Stopping application 'sysmon_handler' 2026-04-20 05:23:14.407 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:23:14.408 [info] <0.772.0> Stopping application 'os_mon' 2026-04-20 05:23:14.408 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:23:14.409 [info] <0.772.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:23:14.409 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:23:21.656 [info] <0.787.0> Resetting Rabbit forcefully 2026-04-20 05:23:22.489 [info] <0.799.0> RabbitMQ is asked to stop... 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'rabbitmq_management' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'amqp_client' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'rabbit' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'mnesia' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'rabbit_common' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'sysmon_handler' 2026-04-20 05:23:22.533 [info] <0.799.0> Stopping application 'os_mon' 2026-04-20 05:23:22.533 [info] <0.799.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:23:22.533 [info] <0.799.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:23:28.348 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:23:30.048 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:23:30.048 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:23:30.069 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:23:30.069 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:23:30.081 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:23:30.082 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:23:30.082 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:23:30.086 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:23:30.091 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:23:30.091 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:23:30.097 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:23:30.098 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:23:30.098 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:23:30.099 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:23:30.099 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:23:30.100 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:23:30.101 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:23:30.101 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:23:30.101 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:23:30.102 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:23:30.103 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:23:30.103 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:23:30.103 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:23:30.103 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:23:30.103 [info] <0.240.0> Will wait for 40331 milliseconds before proceeding with registration... 2026-04-20 05:24:10.271 [info] <0.294.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2026-04-20 05:24:10.436 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:24:10.436 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:24:10.443 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:10.447 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:10.447 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:24:10.948 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:10.949 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:10.949 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:24:11.451 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:11.452 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:11.453 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:24:11.954 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:11.955 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:11.955 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:24:12.457 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:12.459 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:12.459 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:24:12.960 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:12.961 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:12.961 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:24:13.462 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:13.463 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:13.463 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:24:13.965 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:13.966 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:13.966 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:24:14.467 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:14.469 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:14.469 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:24:14.971 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:24:14.972 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:24:14.972 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:24:15.473 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:24:15.475 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:24:15.631 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:24:15.632 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:24:15.759 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:24:15.759 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:24:15.826 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:24:15.826 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:24:15.827 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:24:15.827 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:24:15.828 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:24:15.829 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:24:15.830 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:24:15.830 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:24:15.831 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:24:15.831 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:24:15.833 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:24:15.833 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:24:15.834 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:24:15.834 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:24:15.836 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:24:15.837 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:24:15.838 [info] <0.462.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:24:15.838 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:24:15.842 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:24:15.842 [info] <0.466.0> Starting rabbit_node_monitor 2026-04-20 05:24:15.842 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:24:15.843 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:24:15.843 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:24:15.843 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:24:15.902 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:24:15.902 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:24:15.902 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:24:15.902 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:24:15.902 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:24:15.963 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:24:15.963 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:24:15.963 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:24:15.963 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:24:15.963 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:24:15.964 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:24:15.964 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:24:15.964 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:24:15.964 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:24:15.964 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:24:15.964 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:24:15.964 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:24:15.964 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:24:15.965 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:24:15.966 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:24:15.966 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:24:15.966 [info] <0.240.0> Importing users... 2026-04-20 05:24:15.967 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:24:15.973 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:24:15.976 [info] <0.240.0> Importing vhosts... 2026-04-20 05:24:15.976 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:24:15.998 [info] <0.514.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:24:16.003 [info] <0.514.0> Starting message stores for vhost '/' 2026-04-20 05:24:16.003 [info] <0.518.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:24:16.004 [info] <0.514.0> Started message store of type transient for vhost '/' 2026-04-20 05:24:16.004 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:24:16.005 [warning] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:24:16.005 [info] <0.514.0> Started message store of type persistent for vhost '/' 2026-04-20 05:24:16.006 [info] <0.240.0> Importing user permissions... 2026-04-20 05:24:16.006 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:24:16.011 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:24:16.011 [info] <0.240.0> Importing parameters... 2026-04-20 05:24:16.011 [info] <0.240.0> Importing global parameters... 2026-04-20 05:24:16.011 [info] <0.240.0> Importing policies... 2026-04-20 05:24:16.017 [info] <0.240.0> Importing queues... 2026-04-20 05:24:16.017 [info] <0.240.0> Importing exchanges... 2026-04-20 05:24:16.017 [info] <0.240.0> Importing bindings... 2026-04-20 05:24:16.017 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:24:16.017 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:24:16.017 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:24:16.017 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:24:16.018 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:24:16.021 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:24:16.025 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:24:16.025 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:24:16.025 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:24:16.026 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:24:16.026 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:24:16.027 [info] <0.567.0> started TCP listener on [::]:5673 2026-04-20 05:24:16.027 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:24:16.028 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:24:16.028 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:24:16.028 [info] <0.569.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:24:16.068 [info] <0.619.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:24:16.068 [info] <0.725.0> Statistics database started. 2026-04-20 05:24:16.068 [info] <0.724.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:24:16.069 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:24:16.411 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:24:16.431 [info] <0.294.0> RabbitMQ is asked to stop... 2026-04-20 05:24:16.528 [info] <0.294.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:24:16.528 [info] <0.294.0> Stopping application 'rabbitmq_management' 2026-04-20 05:24:16.532 [warning] <0.615.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:24:16.535 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:24:16.535 [info] <0.294.0> Stopping application 'amqp_client' 2026-04-20 05:24:16.536 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:24:16.536 [info] <0.294.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:24:16.537 [info] <0.294.0> Stopping application 'cowboy' 2026-04-20 05:24:16.537 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:24:16.538 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:24:16.538 [info] <0.294.0> Stopping application 'cowlib' 2026-04-20 05:24:16.538 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:24:16.538 [info] <0.294.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:24:16.539 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:24:16.539 [info] <0.294.0> Stopping application 'rabbit' 2026-04-20 05:24:16.539 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:24:16.540 [info] <0.567.0> stopped TCP listener on [::]:5673 2026-04-20 05:24:16.542 [info] <0.491.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:24:16.542 [info] <0.521.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:24:16.577 [info] <0.521.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:24:16.578 [info] <0.518.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:24:16.583 [info] <0.518.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:24:16.586 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:24:16.586 [info] <0.294.0> Stopping application 'mnesia' 2026-04-20 05:24:16.591 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:24:16.591 [info] <0.294.0> Stopping application 'rabbit_common' 2026-04-20 05:24:16.592 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:24:16.592 [info] <0.294.0> Stopping application 'sysmon_handler' 2026-04-20 05:24:16.593 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:24:16.593 [info] <0.294.0> Stopping application 'os_mon' 2026-04-20 05:24:16.594 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:24:16.594 [info] <0.294.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:24:25.500 [info] <0.747.0> Resetting Rabbit forcefully 2026-04-20 05:24:26.807 [info] <0.759.0> RabbitMQ is asked to stop... 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'rabbitmq_management' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'amqp_client' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'rabbit' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'mnesia' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'rabbit_common' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'sysmon_handler' 2026-04-20 05:24:26.885 [info] <0.759.0> Stopping application 'os_mon' 2026-04-20 05:24:26.885 [info] <0.759.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:24:26.885 [info] <0.759.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:24:32.101 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:24:33.498 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:24:33.498 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:24:33.519 [info] <0.253.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:24:33.519 [info] <0.253.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:24:33.535 [info] <0.253.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:24:33.535 [info] <0.253.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:24:33.536 [info] <0.253.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:24:33.550 [info] <0.259.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:24:33.554 [info] <0.261.0> Enabling free disk space monitoring 2026-04-20 05:24:33.554 [info] <0.261.0> Disk free limit set to 50MB 2026-04-20 05:24:33.565 [info] <0.253.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:24:33.566 [info] <0.253.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:24:33.566 [info] <0.264.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:24:33.567 [info] <0.265.0> FHC read buffering: OFF 2026-04-20 05:24:33.567 [info] <0.265.0> FHC write buffering: ON 2026-04-20 05:24:33.568 [info] <0.253.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:24:33.569 [info] <0.254.0> Will use 4 processes for default worker pool 2026-04-20 05:24:33.569 [info] <0.254.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:24:33.570 [info] <0.253.0> Running boot step database defined by app rabbit 2026-04-20 05:24:33.571 [info] <0.253.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:24:33.571 [info] <0.253.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:24:33.571 [info] <0.253.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:24:33.571 [info] <0.253.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:24:33.571 [info] <0.253.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:24:33.571 [info] <0.253.0> Will wait for 36286 milliseconds before proceeding with registration... 2026-04-20 05:25:09.859 [info] <0.253.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:25:09.859 [info] <0.253.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:25:09.862 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:09.865 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:09.865 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:25:10.367 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:10.367 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:10.368 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:25:10.870 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:10.871 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:10.871 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:25:11.372 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:11.375 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:11.375 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:25:11.878 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:11.879 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:11.879 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:25:12.380 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:12.381 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:12.381 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:25:12.882 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:12.883 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:12.884 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:25:13.397 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:13.398 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:13.398 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:25:13.899 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:13.905 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:13.905 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:25:14.406 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:25:14.407 [warning] <0.253.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:25:14.407 [error] <0.253.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:25:14.908 [warning] <0.253.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:25:14.909 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:25:15.164 [info] <0.253.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:25:15.164 [info] <0.253.0> Successfully synced tables from a peer 2026-04-20 05:25:15.224 [info] <0.253.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:25:15.224 [info] <0.253.0> Successfully synced tables from a peer 2026-04-20 05:25:15.282 [info] <0.253.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:25:15.283 [info] <0.253.0> Successfully synced tables from a peer 2026-04-20 05:25:15.283 [info] <0.253.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:25:15.283 [info] <0.253.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:25:15.284 [info] <0.253.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:25:15.284 [info] <0.253.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:25:15.285 [info] <0.253.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:25:15.285 [info] <0.253.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:25:15.285 [info] <0.253.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:25:15.286 [info] <0.253.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:25:15.286 [info] <0.253.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:25:15.287 [info] <0.253.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:25:15.287 [info] <0.253.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:25:15.287 [info] <0.253.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:25:15.287 [info] <0.253.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:25:15.288 [info] <0.253.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:25:15.288 [info] <0.253.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:25:15.289 [info] <0.253.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:25:15.290 [info] <0.253.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:25:15.291 [info] <0.253.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:25:15.291 [info] <0.253.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:25:15.292 [info] <0.253.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:25:15.292 [info] <0.253.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:25:15.293 [info] <0.253.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:25:15.297 [info] <0.253.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:25:15.298 [info] <0.253.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:25:15.298 [info] <0.253.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:25:15.299 [info] <0.465.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:25:15.300 [info] <0.253.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:25:15.305 [info] <0.253.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:25:15.305 [info] <0.469.0> Starting rabbit_node_monitor 2026-04-20 05:25:15.305 [info] <0.253.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:25:15.306 [info] <0.253.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:25:15.306 [info] <0.253.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:25:15.306 [info] <0.253.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:25:15.423 [info] <0.253.0> message_store upgrades: 1 to apply 2026-04-20 05:25:15.424 [info] <0.253.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:25:15.424 [info] <0.253.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:25:15.424 [info] <0.253.0> message_store upgrades: Removing the old message store data 2026-04-20 05:25:15.424 [info] <0.253.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:25:15.499 [info] <0.253.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:25:15.500 [info] <0.253.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:25:15.500 [info] <0.253.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:25:15.502 [info] <0.253.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:25:15.502 [info] <0.253.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:25:15.503 [info] <0.253.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:25:15.503 [info] <0.253.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:25:15.503 [info] <0.253.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:25:15.503 [info] <0.253.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:25:15.509 [info] <0.253.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:25:15.509 [warning] <0.253.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:25:15.509 [info] <0.253.0> Management plugin: using rates mode 'basic' 2026-04-20 05:25:15.509 [info] <0.253.0> Running boot step recovery defined by app rabbit 2026-04-20 05:25:15.510 [info] <0.253.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:25:15.514 [info] <0.253.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:25:15.514 [info] <0.253.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:25:15.515 [info] <0.253.0> Importing users... 2026-04-20 05:25:15.515 [info] <0.253.0> Creating user 'guest' 2026-04-20 05:25:15.526 [info] <0.253.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:25:15.530 [info] <0.253.0> Importing vhosts... 2026-04-20 05:25:15.530 [info] <0.253.0> Adding vhost '/' 2026-04-20 05:25:15.565 [info] <0.517.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:25:15.572 [info] <0.517.0> Starting message stores for vhost '/' 2026-04-20 05:25:15.572 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:25:15.573 [info] <0.517.0> Started message store of type transient for vhost '/' 2026-04-20 05:25:15.574 [info] <0.524.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:25:15.581 [warning] <0.524.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:25:15.582 [info] <0.517.0> Started message store of type persistent for vhost '/' 2026-04-20 05:25:15.583 [info] <0.253.0> Importing user permissions... 2026-04-20 05:25:15.583 [info] <0.253.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:25:15.592 [info] <0.253.0> Importing topic permissions... 2026-04-20 05:25:15.592 [info] <0.253.0> Importing parameters... 2026-04-20 05:25:15.592 [info] <0.253.0> Importing global parameters... 2026-04-20 05:25:15.592 [info] <0.253.0> Importing policies... 2026-04-20 05:25:15.609 [info] <0.253.0> Importing queues... 2026-04-20 05:25:15.609 [info] <0.253.0> Importing exchanges... 2026-04-20 05:25:15.609 [info] <0.253.0> Importing bindings... 2026-04-20 05:25:15.609 [info] <0.253.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:25:15.609 [info] <0.253.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:25:15.609 [info] <0.253.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:25:15.609 [info] <0.253.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:25:15.609 [info] <0.253.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:25:15.622 [info] <0.253.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:25:15.630 [info] <0.253.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:25:15.630 [info] <0.253.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:25:15.630 [info] <0.253.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:25:15.630 [info] <0.253.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:25:15.631 [info] <0.253.0> Running boot step networking defined by app rabbit 2026-04-20 05:25:15.633 [info] <0.570.0> started TCP listener on [::]:5673 2026-04-20 05:25:15.633 [info] <0.253.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:25:15.634 [info] <0.253.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:25:15.635 [info] <0.253.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:25:15.635 [info] <0.572.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:25:15.703 [info] <0.622.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:25:15.704 [info] <0.728.0> Statistics database started. 2026-04-20 05:25:15.704 [info] <0.727.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:25:15.704 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:25:16.042 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:25:16.967 [info] <0.739.0> accepting AMQP connection <0.739.0> (10.0.0.38:38738 -> 10.0.0.50:5673) 2026-04-20 05:25:16.973 [info] <0.739.0> connection <0.739.0> (10.0.0.38:38738 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:17.025 [info] <0.759.0> accepting AMQP connection <0.759.0> (10.0.0.38:38754 -> 10.0.0.50:5673) 2026-04-20 05:25:17.030 [info] <0.759.0> connection <0.759.0> (10.0.0.38:38754 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:17.039 [info] <0.759.0> closing AMQP connection <0.759.0> (10.0.0.38:38754 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:25:17.042 [info] <0.770.0> accepting AMQP connection <0.770.0> (10.0.0.38:38766 -> 10.0.0.50:5673) 2026-04-20 05:25:17.051 [info] <0.770.0> connection <0.770.0> (10.0.0.38:38766 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:17.958 [info] <0.779.0> accepting AMQP connection <0.779.0> (10.0.0.50:57056 -> 10.0.0.50:5673) 2026-04-20 05:25:17.959 [info] <0.779.0> connection <0.779.0> (10.0.0.50:57056 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.110 [info] <0.797.0> accepting AMQP connection <0.797.0> (10.0.0.50:57058 -> 10.0.0.50:5673) 2026-04-20 05:25:18.118 [info] <0.797.0> connection <0.797.0> (10.0.0.50:57058 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.246 [info] <0.815.0> accepting AMQP connection <0.815.0> (10.0.0.38:38772 -> 10.0.0.50:5673) 2026-04-20 05:25:18.250 [info] <0.815.0> connection <0.815.0> (10.0.0.38:38772 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.406 [info] <0.835.0> accepting AMQP connection <0.835.0> (10.0.0.50:57062 -> 10.0.0.50:5673) 2026-04-20 05:25:18.409 [info] <0.837.0> RabbitMQ is asked to stop... 2026-04-20 05:25:18.413 [info] <0.835.0> connection <0.835.0> (10.0.0.50:57062 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.437 [info] <0.855.0> accepting AMQP connection <0.855.0> (10.0.0.50:57070 -> 10.0.0.50:5673) 2026-04-20 05:25:18.454 [info] <0.855.0> connection <0.855.0> (10.0.0.50:57070 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.467 [info] <0.855.0> closing AMQP connection <0.855.0> (10.0.0.50:57070 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:25:18.485 [info] <0.866.0> accepting AMQP connection <0.866.0> (10.0.0.50:57072 -> 10.0.0.50:5673) 2026-04-20 05:25:18.531 [info] <0.866.0> connection <0.866.0> (10.0.0.50:57072 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.650 [info] <0.875.0> accepting AMQP connection <0.875.0> (10.0.0.33:60746 -> 10.0.0.50:5673) 2026-04-20 05:25:18.652 [info] <0.875.0> connection <0.875.0> (10.0.0.33:60746 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.682 [info] <0.893.0> accepting AMQP connection <0.893.0> (10.0.0.33:60752 -> 10.0.0.50:5673) 2026-04-20 05:25:18.686 [info] <0.893.0> connection <0.893.0> (10.0.0.33:60752 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.692 [info] <0.893.0> closing AMQP connection <0.893.0> (10.0.0.33:60752 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:25:18.698 [info] <0.904.0> accepting AMQP connection <0.904.0> (10.0.0.33:60768 -> 10.0.0.50:5673) 2026-04-20 05:25:18.707 [info] <0.904.0> connection <0.904.0> (10.0.0.33:60768 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.864 [info] <0.913.0> accepting AMQP connection <0.913.0> (10.0.0.33:55078 -> 10.0.0.50:5673) 2026-04-20 05:25:18.869 [info] <0.913.0> connection <0.913.0> (10.0.0.33:55078 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.927 [info] <0.931.0> accepting AMQP connection <0.931.0> (10.0.0.33:55084 -> 10.0.0.50:5673) 2026-04-20 05:25:18.931 [info] <0.931.0> connection <0.931.0> (10.0.0.33:55084 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:25:18.974 [info] <0.837.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:25:18.974 [info] <0.837.0> Stopping application 'rabbitmq_management' 2026-04-20 05:25:18.976 [warning] <0.578.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:25:18.978 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:25:18.978 [info] <0.837.0> Stopping application 'amqp_client' 2026-04-20 05:25:18.980 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:25:18.980 [info] <0.837.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:25:18.988 [info] <0.837.0> Stopping application 'cowboy' 2026-04-20 05:25:18.987 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:25:18.990 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:25:18.990 [info] <0.837.0> Stopping application 'cowlib' 2026-04-20 05:25:18.990 [info] <0.837.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:25:18.990 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:25:18.999 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:25:18.999 [info] <0.837.0> Stopping application 'rabbit' 2026-04-20 05:25:19.000 [info] <0.253.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:25:19.002 [info] <0.570.0> stopped TCP listener on [::]:5673 2026-04-20 05:25:19.007 [error] <0.913.0> Error on AMQP connection <0.913.0> (10.0.0.33:55078 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.007 [error] <0.739.0> Error on AMQP connection <0.739.0> (10.0.0.38:38738 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.008 [error] <0.779.0> Error on AMQP connection <0.779.0> (10.0.0.50:57056 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.008 [error] <0.835.0> Error on AMQP connection <0.835.0> (10.0.0.50:57062 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.007 [error] <0.770.0> Error on AMQP connection <0.770.0> (10.0.0.38:38766 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.007 [error] <0.797.0> Error on AMQP connection <0.797.0> (10.0.0.50:57058 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.007 [error] <0.866.0> Error on AMQP connection <0.866.0> (10.0.0.50:57072 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.008 [error] <0.904.0> Error on AMQP connection <0.904.0> (10.0.0.33:60768 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.008 [error] <0.875.0> Error on AMQP connection <0.875.0> (10.0.0.33:60746 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.008 [error] <0.815.0> Error on AMQP connection <0.815.0> (10.0.0.38:38772 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.009 [error] <0.931.0> Error on AMQP connection <0.931.0> (10.0.0.33:55084 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:25:19.011 [error] <0.799.0> Supervisor {<0.799.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:25:19.014 [info] <0.494.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:25:19.014 [warning] <0.806.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.014 [warning] <0.750.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.015 [warning] <0.846.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.015 [warning] <0.788.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.015 [warning] <0.922.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.015 [warning] <0.884.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.015 [warning] <0.824.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.015 [warning] <0.940.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:25:19.032 [info] <0.524.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:25:19.065 [info] <0.524.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:25:19.066 [info] <0.521.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:25:19.086 [info] <0.521.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:25:19.093 [info] <0.837.0> Stopping application 'mnesia' 2026-04-20 05:25:19.093 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:25:19.113 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:25:19.113 [info] <0.837.0> Stopping application 'rabbit_common' 2026-04-20 05:25:19.113 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:25:19.113 [info] <0.837.0> Stopping application 'sysmon_handler' 2026-04-20 05:25:19.115 [info] <0.837.0> Stopping application 'os_mon' 2026-04-20 05:25:19.115 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:25:19.116 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:25:19.116 [info] <0.837.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:25:31.110 [info] <0.1009.0> Resetting Rabbit forcefully 2026-04-20 05:25:32.772 [info] <0.1021.0> RabbitMQ is asked to stop... 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'rabbitmq_management' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'amqp_client' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'rabbit' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'mnesia' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'rabbit_common' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'sysmon_handler' 2026-04-20 05:25:32.831 [info] <0.1021.0> Stopping application 'os_mon' 2026-04-20 05:25:32.831 [info] <0.1021.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:25:32.831 [info] <0.1021.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli xmerl jsx tools credentials_obfuscation crypto stdout_formatter recon inets lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:25:42.390 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:25:44.931 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:25:44.932 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:25:44.949 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:25:44.949 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:25:44.961 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:25:44.961 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:25:44.961 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:25:44.968 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:25:44.973 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:25:44.973 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:25:44.977 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:25:44.977 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:25:44.977 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:25:44.977 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:25:44.977 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:25:44.977 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:25:44.977 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:25:44.978 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:25:44.978 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:25:44.978 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:25:44.978 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:25:44.978 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:25:44.978 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:25:44.978 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:25:44.978 [info] <0.240.0> Will wait for 17584 milliseconds before proceeding with registration... 2026-04-20 05:26:02.562 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:26:02.562 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:26:02.567 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:02.570 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:02.570 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:26:03.075 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:03.076 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:03.076 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:26:03.577 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:03.579 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:03.579 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:26:04.083 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:04.084 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:04.084 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:26:04.586 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:04.587 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:04.587 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:26:05.088 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:05.089 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:05.089 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:26:05.592 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:05.592 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:05.593 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:26:06.095 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:06.096 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:06.096 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:26:06.597 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:06.598 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:06.598 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:26:07.100 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:26:07.101 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:26:07.101 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:26:07.602 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:26:07.604 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:26:07.740 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:26:07.740 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:26:07.774 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:26:07.774 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:26:07.808 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:26:07.808 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:26:07.808 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:26:07.808 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:26:07.808 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:26:07.809 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:26:07.810 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:26:07.811 [info] <0.446.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:26:07.811 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:26:07.816 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:26:07.816 [info] <0.450.0> Starting rabbit_node_monitor 2026-04-20 05:26:07.816 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:26:07.816 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:26:07.816 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:26:07.816 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:26:07.838 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:26:07.839 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:26:07.839 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:26:07.839 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:26:07.840 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:26:07.863 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:26:07.864 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:26:07.864 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:26:07.864 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:26:07.864 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:26:07.865 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:26:07.865 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:26:07.865 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:26:07.865 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:26:07.865 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:26:07.865 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:26:07.865 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:26:07.865 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:26:07.866 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:26:07.866 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:26:07.867 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:26:07.867 [info] <0.240.0> Importing users... 2026-04-20 05:26:07.867 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:26:07.874 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:26:07.877 [info] <0.240.0> Importing vhosts... 2026-04-20 05:26:07.877 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:26:07.906 [info] <0.498.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:26:07.912 [info] <0.498.0> Starting message stores for vhost '/' 2026-04-20 05:26:07.913 [info] <0.502.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:26:07.914 [info] <0.498.0> Started message store of type transient for vhost '/' 2026-04-20 05:26:07.914 [info] <0.505.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:26:07.914 [warning] <0.505.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:26:07.915 [info] <0.498.0> Started message store of type persistent for vhost '/' 2026-04-20 05:26:07.916 [info] <0.240.0> Importing user permissions... 2026-04-20 05:26:07.916 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:26:07.920 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:26:07.920 [info] <0.240.0> Importing parameters... 2026-04-20 05:26:07.920 [info] <0.240.0> Importing global parameters... 2026-04-20 05:26:07.920 [info] <0.240.0> Importing policies... 2026-04-20 05:26:07.930 [info] <0.240.0> Importing queues... 2026-04-20 05:26:07.930 [info] <0.240.0> Importing exchanges... 2026-04-20 05:26:07.930 [info] <0.240.0> Importing bindings... 2026-04-20 05:26:07.930 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:26:07.930 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:26:07.930 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:26:07.930 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:26:07.930 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:26:07.937 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:26:07.941 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:26:07.941 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:26:07.942 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:26:07.942 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:26:07.942 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:26:07.943 [info] <0.551.0> started TCP listener on [::]:5673 2026-04-20 05:26:07.944 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:26:07.944 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:26:07.944 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:26:07.944 [info] <0.553.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:26:07.973 [info] <0.603.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:26:07.974 [info] <0.709.0> Statistics database started. 2026-04-20 05:26:07.974 [info] <0.708.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:26:07.974 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:26:08.069 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:26:08.172 [info] <0.719.0> accepting AMQP connection <0.719.0> (10.0.0.38:37444 -> 10.0.0.50:5673) 2026-04-20 05:26:08.181 [info] <0.719.0> connection <0.719.0> (10.0.0.38:37444 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:09.028 [info] <0.740.0> accepting AMQP connection <0.740.0> (10.0.0.33:58638 -> 10.0.0.50:5673) 2026-04-20 05:26:09.030 [info] <0.740.0> connection <0.740.0> (10.0.0.33:58638 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:09.038 [info] <0.758.0> accepting AMQP connection <0.758.0> (10.0.0.33:58654 -> 10.0.0.50:5673) 2026-04-20 05:26:09.040 [info] <0.758.0> connection <0.758.0> (10.0.0.33:58654 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:09.052 [info] <0.776.0> accepting AMQP connection <0.776.0> (10.0.0.38:37458 -> 10.0.0.50:5673) 2026-04-20 05:26:09.054 [info] <0.776.0> connection <0.776.0> (10.0.0.38:37458 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:09.306 [info] <0.794.0> accepting AMQP connection <0.794.0> (10.0.0.50:37136 -> 10.0.0.50:5673) 2026-04-20 05:26:09.308 [info] <0.794.0> connection <0.794.0> (10.0.0.50:37136 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:09.518 [info] <0.812.0> accepting AMQP connection <0.812.0> (10.0.0.33:58668 -> 10.0.0.50:5673) 2026-04-20 05:26:09.520 [info] <0.812.0> connection <0.812.0> (10.0.0.33:58668 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:09.623 [info] <0.830.0> accepting AMQP connection <0.830.0> (10.0.0.38:37466 -> 10.0.0.50:5673) 2026-04-20 05:26:09.626 [info] <0.830.0> connection <0.830.0> (10.0.0.38:37466 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:10.109 [info] <0.848.0> accepting AMQP connection <0.848.0> (10.0.0.50:37152 -> 10.0.0.50:5673) 2026-04-20 05:26:10.110 [info] <0.848.0> connection <0.848.0> (10.0.0.50:37152 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:10.239 [info] <0.866.0> accepting AMQP connection <0.866.0> (10.0.0.50:37166 -> 10.0.0.50:5673) 2026-04-20 05:26:10.240 [info] <0.866.0> connection <0.866.0> (10.0.0.50:37166 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:26:12.227 [info] <0.896.0> RabbitMQ is asked to stop... 2026-04-20 05:26:12.345 [info] <0.896.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:26:12.345 [info] <0.896.0> Stopping application 'rabbitmq_management' 2026-04-20 05:26:12.346 [warning] <0.559.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:26:12.348 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:26:12.348 [info] <0.896.0> Stopping application 'amqp_client' 2026-04-20 05:26:12.349 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:26:12.349 [info] <0.896.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:26:12.351 [info] <0.896.0> Stopping application 'cowboy' 2026-04-20 05:26:12.351 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:26:12.352 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:26:12.352 [info] <0.896.0> Stopping application 'cowlib' 2026-04-20 05:26:12.352 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:26:12.352 [info] <0.896.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:26:12.354 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:26:12.354 [info] <0.896.0> Stopping application 'rabbit' 2026-04-20 05:26:12.354 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:26:12.354 [info] <0.551.0> stopped TCP listener on [::]:5673 2026-04-20 05:26:12.355 [error] <0.794.0> Error on AMQP connection <0.794.0> (10.0.0.50:37136 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.355 [error] <0.776.0> Error on AMQP connection <0.776.0> (10.0.0.38:37458 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.355 [error] <0.830.0> Error on AMQP connection <0.830.0> (10.0.0.38:37466 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.355 [error] <0.866.0> Error on AMQP connection <0.866.0> (10.0.0.50:37166 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.355 [error] <0.848.0> Error on AMQP connection <0.848.0> (10.0.0.50:37152 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.355 [error] <0.719.0> Error on AMQP connection <0.719.0> (10.0.0.38:37444 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.355 [error] <0.740.0> Error on AMQP connection <0.740.0> (10.0.0.33:58638 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.355 [error] <0.812.0> Error on AMQP connection <0.812.0> (10.0.0.33:58668 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.356 [error] <0.758.0> Error on AMQP connection <0.758.0> (10.0.0.33:58654 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:26:12.362 [info] <0.475.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:26:12.363 [warning] <0.767.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.363 [warning] <0.749.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.363 [warning] <0.730.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.363 [warning] <0.821.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.363 [warning] <0.803.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.363 [warning] <0.785.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.364 [warning] <0.875.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.364 [warning] <0.839.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.364 [warning] <0.857.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:26:12.371 [info] <0.505.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:26:12.387 [info] <0.505.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:26:12.387 [info] <0.502.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:26:12.392 [info] <0.502.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:26:12.404 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:26:12.404 [info] <0.896.0> Stopping application 'mnesia' 2026-04-20 05:26:12.408 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:26:12.408 [info] <0.896.0> Stopping application 'rabbit_common' 2026-04-20 05:26:12.408 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:26:12.408 [info] <0.896.0> Stopping application 'sysmon_handler' 2026-04-20 05:26:12.413 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:26:12.413 [info] <0.896.0> Stopping application 'os_mon' 2026-04-20 05:26:12.415 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:26:13.187 [warning] lager_file_backend dropped 1 messages in the last second that exceeded the limit of 50 messages/sec 2026-04-20 05:26:20.149 [info] <0.947.0> Resetting Rabbit forcefully 2026-04-20 05:26:22.366 [info] <0.959.0> RabbitMQ is asked to stop... 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'rabbitmq_management' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'amqp_client' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'rabbit' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'mnesia' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'rabbit_common' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'sysmon_handler' 2026-04-20 05:26:22.482 [info] <0.959.0> Stopping application 'os_mon' 2026-04-20 05:26:22.483 [info] <0.959.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:26:22.483 [info] <0.959.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter jsx recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:26:29.786 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:26:33.411 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:26:33.411 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:26:33.430 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:26:33.431 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:26:33.443 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:26:33.443 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:26:33.443 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:26:33.449 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:26:33.453 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:26:33.454 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:26:33.459 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:26:33.462 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:26:33.464 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:26:33.465 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:26:33.465 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:26:33.466 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:26:33.466 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:26:33.466 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:26:33.466 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:26:33.466 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:26:33.466 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:26:33.466 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:26:33.466 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:26:33.466 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:26:33.466 [info] <0.240.0> Will wait for 54506 milliseconds before proceeding with registration... 2026-04-20 05:27:14.998 [info] <0.311.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2026-04-20 05:27:27.973 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:27:27.973 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:27:27.976 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:27.985 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:27.986 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:27:28.488 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:28.493 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:28.493 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:27:28.994 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:29.006 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:29.006 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:27:29.508 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:29.510 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:29.510 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:27:30.012 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:30.014 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:30.014 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:27:30.516 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:30.518 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:30.518 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:27:31.019 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:31.020 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:31.020 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:27:31.521 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:31.522 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:31.522 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:27:32.023 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:32.024 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:32.024 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:27:32.525 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,tables_not_present} 2026-04-20 05:27:32.526 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:27:32.526 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:27:33.026 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:27:33.028 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:27:33.138 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:27:33.138 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:27:33.170 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:27:33.170 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:27:33.204 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:27:33.205 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:27:33.205 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:27:33.205 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:27:33.206 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:27:33.206 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:27:33.206 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:27:33.207 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:27:33.207 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:27:33.207 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:27:33.208 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:27:33.208 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:27:33.209 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:27:33.209 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:27:33.209 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:27:33.210 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:27:33.210 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:27:33.210 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:27:33.211 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:27:33.211 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:27:33.211 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:27:33.212 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:27:33.212 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:27:33.212 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:27:33.212 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:27:33.213 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:27:33.213 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:27:33.214 [info] <0.475.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:27:33.214 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:27:33.219 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:27:33.220 [info] <0.479.0> Starting rabbit_node_monitor 2026-04-20 05:27:33.220 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:27:33.220 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:27:33.220 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:27:33.220 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:27:33.245 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:27:33.246 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:27:33.246 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:27:33.247 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:27:33.250 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:27:33.277 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:27:33.277 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:27:33.277 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:27:33.287 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:27:33.287 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:27:33.288 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:27:33.288 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:27:33.288 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:27:33.288 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:27:33.288 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:27:33.288 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:27:33.288 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:27:33.288 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:27:33.289 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:27:33.289 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:27:33.289 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:27:33.289 [info] <0.240.0> Importing users... 2026-04-20 05:27:33.290 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:27:33.296 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:27:33.299 [info] <0.240.0> Importing vhosts... 2026-04-20 05:27:33.299 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:27:33.359 [info] <0.527.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:27:33.368 [info] <0.527.0> Starting message stores for vhost '/' 2026-04-20 05:27:33.370 [info] <0.531.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:27:33.371 [info] <0.527.0> Started message store of type transient for vhost '/' 2026-04-20 05:27:33.371 [info] <0.534.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:27:33.371 [warning] <0.534.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:27:33.380 [info] <0.527.0> Started message store of type persistent for vhost '/' 2026-04-20 05:27:33.381 [info] <0.240.0> Importing user permissions... 2026-04-20 05:27:33.381 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:27:33.386 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:27:33.386 [info] <0.240.0> Importing parameters... 2026-04-20 05:27:33.386 [info] <0.240.0> Importing global parameters... 2026-04-20 05:27:33.386 [info] <0.240.0> Importing policies... 2026-04-20 05:27:33.394 [info] <0.240.0> Importing queues... 2026-04-20 05:27:33.394 [info] <0.240.0> Importing exchanges... 2026-04-20 05:27:33.394 [info] <0.240.0> Importing bindings... 2026-04-20 05:27:33.394 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:27:33.394 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:27:33.394 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:27:33.394 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:27:33.395 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:27:33.398 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:27:33.401 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:27:33.401 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:27:33.401 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:27:33.401 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:27:33.401 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:27:33.403 [info] <0.580.0> started TCP listener on [::]:5673 2026-04-20 05:27:33.403 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:27:33.403 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:27:33.403 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:27:33.403 [info] <0.582.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:27:33.431 [info] <0.632.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:27:33.431 [info] <0.738.0> Statistics database started. 2026-04-20 05:27:33.431 [info] <0.737.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:27:33.431 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:27:33.576 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:27:33.590 [info] <0.311.0> RabbitMQ is asked to stop... 2026-04-20 05:27:33.692 [info] <0.311.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:27:33.692 [info] <0.311.0> Stopping application 'rabbitmq_management' 2026-04-20 05:27:33.693 [warning] <0.628.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:27:33.695 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:27:33.695 [info] <0.311.0> Stopping application 'amqp_client' 2026-04-20 05:27:33.696 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:27:33.696 [info] <0.311.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:27:33.697 [info] <0.311.0> Stopping application 'cowboy' 2026-04-20 05:27:33.697 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:27:33.698 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:27:33.698 [info] <0.311.0> Stopping application 'cowlib' 2026-04-20 05:27:33.699 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:27:33.699 [info] <0.311.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:27:33.700 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:27:33.700 [info] <0.311.0> Stopping application 'rabbit' 2026-04-20 05:27:33.700 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:27:33.700 [info] <0.580.0> stopped TCP listener on [::]:5673 2026-04-20 05:27:33.700 [info] <0.504.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:27:33.701 [info] <0.534.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:27:33.707 [info] <0.534.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:27:33.707 [info] <0.531.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:27:33.712 [info] <0.531.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:27:33.715 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:27:33.715 [info] <0.311.0> Stopping application 'mnesia' 2026-04-20 05:27:33.720 [info] <0.311.0> Stopping application 'rabbit_common' 2026-04-20 05:27:33.720 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:27:33.720 [info] <0.311.0> Stopping application 'sysmon_handler' 2026-04-20 05:27:33.720 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:27:33.721 [info] <0.311.0> Stopping application 'os_mon' 2026-04-20 05:27:33.721 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:27:33.722 [info] <0.311.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:27:33.722 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:27:43.421 [info] <0.762.0> Resetting Rabbit forcefully 2026-04-20 05:27:44.925 [info] <0.779.0> RabbitMQ is asked to stop... 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'rabbitmq_management' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'amqp_client' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'rabbit' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'mnesia' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'rabbit_common' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'sysmon_handler' 2026-04-20 05:27:45.021 [info] <0.779.0> Stopping application 'os_mon' 2026-04-20 05:27:45.021 [info] <0.779.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:27:45.021 [info] <0.779.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:27:52.807 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:27:55.628 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:27:55.628 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:27:55.645 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:27:55.646 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:27:55.659 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:27:55.659 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:27:55.660 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:27:55.665 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:27:55.670 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:27:55.670 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:27:55.675 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:27:55.675 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:27:55.675 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:27:55.675 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:27:55.675 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:27:55.676 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:27:55.676 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:27:55.676 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:27:55.676 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:27:55.677 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:27:55.677 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:27:55.677 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:27:55.677 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:27:55.677 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:27:55.678 [info] <0.240.0> Will wait for 57695 milliseconds before proceeding with registration... 2026-04-20 05:28:43.771 [info] <0.294.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2026-04-20 05:28:53.373 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:28:53.373 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:28:53.383 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:28:53.386 [info] <0.240.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-3' selected for auto-clustering 2026-04-20 05:28:53.406 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:28:53.406 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:28:53.717 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:28:53.717 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:28:53.758 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:28:53.758 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:28:53.766 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:28:53.774 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:28:53.775 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:28:53.775 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:28:53.775 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:28:53.775 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:28:53.775 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:28:53.775 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:28:53.775 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:28:53.776 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:28:53.777 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:28:53.777 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:28:53.777 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:28:53.777 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:28:53.777 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:28:53.777 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:28:53.777 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:28:53.778 [info] <0.475.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:28:53.778 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:28:53.783 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:28:53.784 [info] <0.479.0> Starting rabbit_node_monitor 2026-04-20 05:28:53.784 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:28:53.785 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:28:53.785 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:28:53.785 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:28:53.815 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:28:53.815 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:28:53.815 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:28:53.815 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:28:53.815 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:28:53.844 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:28:53.844 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:28:53.844 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:28:53.845 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:28:53.845 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:28:53.845 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:28:53.845 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:28:53.845 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:28:53.846 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:28:53.846 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:28:53.846 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:28:53.846 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:28:53.847 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:28:53.848 [info] <0.516.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:28:53.853 [info] <0.516.0> Starting message stores for vhost '/' 2026-04-20 05:28:53.853 [info] <0.520.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:28:53.853 [info] <0.516.0> Started message store of type transient for vhost '/' 2026-04-20 05:28:53.854 [info] <0.523.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:28:53.854 [warning] <0.523.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:28:53.856 [info] <0.516.0> Started message store of type persistent for vhost '/' 2026-04-20 05:28:53.856 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:28:53.857 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:28:53.857 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:28:53.857 [info] <0.240.0> Importing users... 2026-04-20 05:28:53.867 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:28:53.873 [info] <0.240.0> Importing vhosts... 2026-04-20 05:28:53.873 [info] <0.240.0> Importing user permissions... 2026-04-20 05:28:53.873 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:28:53.876 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:28:53.876 [info] <0.240.0> Importing parameters... 2026-04-20 05:28:53.876 [info] <0.240.0> Importing global parameters... 2026-04-20 05:28:53.876 [info] <0.240.0> Importing policies... 2026-04-20 05:28:53.885 [info] <0.240.0> Importing queues... 2026-04-20 05:28:53.885 [info] <0.240.0> Importing exchanges... 2026-04-20 05:28:53.885 [info] <0.240.0> Importing bindings... 2026-04-20 05:28:53.885 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:28:53.885 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:28:53.885 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:28:53.885 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:28:53.885 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:28:53.886 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:28:53.886 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:28:53.886 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:28:53.887 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:28:53.887 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:28:53.887 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:28:53.887 [info] <0.479.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-3' up 2026-04-20 05:28:53.889 [info] <0.564.0> started TCP listener on [::]:5673 2026-04-20 05:28:53.889 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:28:53.889 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:28:53.889 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:28:53.889 [info] <0.566.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:28:53.926 [info] <0.617.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:28:53.927 [info] <0.723.0> Statistics database started. 2026-04-20 05:28:53.927 [info] <0.722.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:28:53.927 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:28:54.043 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:28:54.074 [info] <0.294.0> RabbitMQ is asked to stop... 2026-04-20 05:28:54.158 [info] <0.294.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:28:54.158 [info] <0.294.0> Stopping application 'rabbitmq_management' 2026-04-20 05:28:54.160 [warning] <0.613.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:28:54.162 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:28:54.162 [info] <0.294.0> Stopping application 'amqp_client' 2026-04-20 05:28:54.164 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:28:54.164 [info] <0.294.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:28:54.165 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:28:54.165 [info] <0.294.0> Stopping application 'cowboy' 2026-04-20 05:28:54.167 [info] <0.294.0> Stopping application 'cowlib' 2026-04-20 05:28:54.167 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:28:54.167 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:28:54.167 [info] <0.294.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:28:54.168 [info] <0.294.0> Stopping application 'rabbit' 2026-04-20 05:28:54.168 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:28:54.168 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:28:54.169 [info] <0.564.0> stopped TCP listener on [::]:5673 2026-04-20 05:28:54.170 [info] <0.504.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:28:54.170 [info] <0.523.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:28:54.174 [info] <0.523.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:28:54.174 [info] <0.520.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:28:54.182 [info] <0.520.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:28:54.184 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:28:54.184 [info] <0.294.0> Stopping application 'mnesia' 2026-04-20 05:28:54.189 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:28:54.189 [info] <0.294.0> Stopping application 'rabbit_common' 2026-04-20 05:28:54.189 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:28:54.189 [info] <0.294.0> Stopping application 'sysmon_handler' 2026-04-20 05:28:54.191 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:28:54.191 [info] <0.294.0> Stopping application 'os_mon' 2026-04-20 05:28:54.193 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:28:54.193 [info] <0.294.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:29:04.052 [info] <0.746.0> Resetting Rabbit forcefully 2026-04-20 05:29:05.243 [info] <0.760.0> RabbitMQ is asked to stop... 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'rabbitmq_management' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'amqp_client' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'rabbit' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'mnesia' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'rabbit_common' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'sysmon_handler' 2026-04-20 05:29:05.354 [info] <0.760.0> Stopping application 'os_mon' 2026-04-20 05:29:05.354 [info] <0.760.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:29:05.354 [info] <0.760.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:29:12.175 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:29:14.194 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:29:14.194 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:29:14.212 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:29:14.213 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:29:14.225 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:29:14.225 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:29:14.226 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:29:14.235 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:29:14.239 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:29:14.239 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:29:14.243 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:29:14.243 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:29:14.243 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:29:14.243 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:29:14.243 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:29:14.244 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:29:14.244 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:29:14.244 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:29:14.244 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:29:14.244 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:29:14.244 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:29:14.244 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:29:14.244 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:29:14.244 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:29:14.244 [info] <0.240.0> Will wait for 33668 milliseconds before proceeding with registration... 2026-04-20 05:29:47.913 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:29:47.914 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:29:47.915 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:47.924 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:47.925 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:29:48.427 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:48.427 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:48.427 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:29:48.930 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:48.930 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:48.931 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:29:49.433 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:49.433 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:49.433 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:29:49.936 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:49.936 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:49.937 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:29:50.439 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:50.439 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:50.440 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:29:50.942 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:50.943 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:50.943 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:29:51.446 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:51.446 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:51.447 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:29:51.949 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:51.950 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:51.950 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:29:52.452 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:29:52.452 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:29:52.453 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:29:52.954 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:29:52.956 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:29:53.073 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:29:53.073 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:29:53.105 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:29:53.105 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:29:53.135 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:29:53.135 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:29:53.135 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:29:53.136 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:29:53.136 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:29:53.136 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:29:53.136 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:29:53.136 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:29:53.136 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:29:53.136 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:29:53.137 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:29:53.138 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:29:53.138 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:29:53.138 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:29:53.140 [info] <0.468.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:29:53.140 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:29:53.148 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:29:53.149 [info] <0.472.0> Starting rabbit_node_monitor 2026-04-20 05:29:53.149 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:29:53.149 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:29:53.150 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:29:53.150 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:29:53.186 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:29:53.186 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:29:53.187 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:29:53.187 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:29:53.190 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:29:53.248 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:29:53.248 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:29:53.248 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:29:53.248 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:29:53.251 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:29:53.252 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:29:53.252 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:29:53.252 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:29:53.252 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:29:53.252 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:29:53.252 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:29:53.252 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:29:53.252 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:29:53.253 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:29:53.253 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:29:53.253 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:29:53.253 [info] <0.240.0> Importing users... 2026-04-20 05:29:53.253 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:29:53.271 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:29:53.280 [info] <0.240.0> Importing vhosts... 2026-04-20 05:29:53.280 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:29:53.308 [info] <0.520.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:29:53.313 [info] <0.520.0> Starting message stores for vhost '/' 2026-04-20 05:29:53.313 [info] <0.524.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:29:53.314 [info] <0.520.0> Started message store of type transient for vhost '/' 2026-04-20 05:29:53.314 [info] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:29:53.315 [warning] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:29:53.316 [info] <0.520.0> Started message store of type persistent for vhost '/' 2026-04-20 05:29:53.317 [info] <0.240.0> Importing user permissions... 2026-04-20 05:29:53.317 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:29:53.320 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:29:53.320 [info] <0.240.0> Importing parameters... 2026-04-20 05:29:53.320 [info] <0.240.0> Importing global parameters... 2026-04-20 05:29:53.320 [info] <0.240.0> Importing policies... 2026-04-20 05:29:53.333 [info] <0.240.0> Importing queues... 2026-04-20 05:29:53.333 [info] <0.240.0> Importing exchanges... 2026-04-20 05:29:53.333 [info] <0.240.0> Importing bindings... 2026-04-20 05:29:53.333 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:29:53.333 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:29:53.333 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:29:53.333 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:29:53.333 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:29:53.339 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:29:53.345 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:29:53.346 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:29:53.346 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:29:53.346 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:29:53.346 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:29:53.347 [info] <0.573.0> started TCP listener on [::]:5673 2026-04-20 05:29:53.348 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:29:53.348 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:29:53.348 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:29:53.348 [info] <0.575.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:29:53.379 [info] <0.625.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:29:53.380 [info] <0.731.0> Statistics database started. 2026-04-20 05:29:53.380 [info] <0.730.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:29:53.381 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:29:53.531 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:29:54.465 [info] <0.755.0> RabbitMQ is asked to stop... 2026-04-20 05:29:54.528 [info] <0.755.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:29:54.528 [info] <0.755.0> Stopping application 'rabbitmq_management' 2026-04-20 05:29:54.528 [info] <0.758.0> accepting AMQP connection <0.758.0> (10.0.0.50:54816 -> 10.0.0.50:5673) 2026-04-20 05:29:54.530 [info] <0.758.0> connection <0.758.0> (10.0.0.50:54816 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:29:54.533 [warning] <0.621.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:29:54.534 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:29:54.534 [info] <0.755.0> Stopping application 'amqp_client' 2026-04-20 05:29:54.536 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:29:54.536 [info] <0.755.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:29:54.538 [info] <0.755.0> Stopping application 'cowboy' 2026-04-20 05:29:54.538 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:29:54.540 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:29:54.540 [info] <0.755.0> Stopping application 'cowlib' 2026-04-20 05:29:54.540 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:29:54.540 [info] <0.755.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:29:54.542 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:29:54.542 [info] <0.755.0> Stopping application 'rabbit' 2026-04-20 05:29:54.542 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:29:54.543 [info] <0.573.0> stopped TCP listener on [::]:5673 2026-04-20 05:29:54.544 [error] <0.758.0> Error on AMQP connection <0.758.0> (10.0.0.50:54816 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:29:54.545 [info] <0.497.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:29:54.545 [info] <0.527.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:29:54.551 [info] <0.527.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:29:54.551 [info] <0.524.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:29:54.557 [info] <0.524.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:29:54.560 [info] <0.755.0> Stopping application 'mnesia' 2026-04-20 05:29:54.560 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:29:54.561 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:29:54.561 [info] <0.755.0> Stopping application 'rabbit_common' 2026-04-20 05:29:54.561 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:29:54.561 [info] <0.755.0> Stopping application 'sysmon_handler' 2026-04-20 05:29:54.563 [info] <0.755.0> Stopping application 'os_mon' 2026-04-20 05:29:54.562 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:29:54.563 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:29:54.563 [info] <0.755.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:30:07.985 [info] <0.784.0> Resetting Rabbit forcefully 2026-04-20 05:30:09.268 [info] <0.798.0> RabbitMQ is asked to stop... 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'rabbitmq_management' 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'amqp_client' 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'rabbit' 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'mnesia' 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'rabbit_common' 2026-04-20 05:30:09.348 [info] <0.798.0> Stopping application 'sysmon_handler' 2026-04-20 05:30:09.349 [info] <0.798.0> Stopping application 'os_mon' 2026-04-20 05:30:09.349 [info] <0.798.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:30:09.349 [info] <0.798.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:30:16.854 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:30:19.550 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:30:19.550 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:30:19.576 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:30:19.578 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:30:19.590 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:30:19.591 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:30:19.591 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:30:19.598 [info] <0.250.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:30:19.605 [info] <0.252.0> Enabling free disk space monitoring 2026-04-20 05:30:19.605 [info] <0.252.0> Disk free limit set to 50MB 2026-04-20 05:30:19.610 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:30:19.610 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:30:19.610 [info] <0.255.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:30:19.611 [info] <0.256.0> FHC read buffering: OFF 2026-04-20 05:30:19.611 [info] <0.256.0> FHC write buffering: ON 2026-04-20 05:30:19.611 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:30:19.611 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:30:19.611 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:30:19.611 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:30:19.611 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:30:19.611 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:30:19.611 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:30:19.611 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:30:19.612 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:30:19.612 [info] <0.240.0> Will wait for 10475 milliseconds before proceeding with registration... 2026-04-20 05:30:30.087 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:30:30.087 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:30:30.089 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:30:30.090 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:30.090 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:30:30.592 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:30:30.592 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:30.592 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:30:31.095 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:30:31.095 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:31.095 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:30:31.598 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:30:31.598 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:31.599 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:30:32.219 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:30:32.228 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:32.228 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:30:32.730 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:30:32.731 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:32.731 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:30:33.236 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:30:33.237 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:33.237 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:30:33.741 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:30:33.743 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:33.743 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:30:34.246 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:30:34.247 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:34.247 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:30:34.750 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:30:34.751 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:30:34.751 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:30:35.251 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:30:35.254 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:30:35.394 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:30:35.395 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:30:35.420 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:30:35.420 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:30:35.449 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:30:35.449 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:30:35.449 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:30:35.449 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:30:35.450 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:30:35.452 [info] <0.457.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:30:35.452 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:30:35.456 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:30:35.456 [info] <0.461.0> Starting rabbit_node_monitor 2026-04-20 05:30:35.456 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:30:35.457 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:30:35.457 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:30:35.457 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:30:35.477 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:30:35.477 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:30:35.478 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:30:35.478 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:30:35.478 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:30:35.502 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:30:35.502 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:30:35.502 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:30:35.502 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:30:35.502 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:30:35.503 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:30:35.503 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:30:35.503 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:30:35.503 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:30:35.503 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:30:35.503 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:30:35.503 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:30:35.503 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:30:35.504 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:30:35.505 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:30:35.505 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:30:35.505 [info] <0.240.0> Importing users... 2026-04-20 05:30:35.506 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:30:35.512 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:30:35.515 [info] <0.240.0> Importing vhosts... 2026-04-20 05:30:35.515 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:30:35.538 [info] <0.509.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:30:35.545 [info] <0.509.0> Starting message stores for vhost '/' 2026-04-20 05:30:35.546 [info] <0.513.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:30:35.547 [info] <0.509.0> Started message store of type transient for vhost '/' 2026-04-20 05:30:35.547 [info] <0.516.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:30:35.548 [warning] <0.516.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:30:35.549 [info] <0.509.0> Started message store of type persistent for vhost '/' 2026-04-20 05:30:35.550 [info] <0.240.0> Importing user permissions... 2026-04-20 05:30:35.550 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:30:35.553 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:30:35.553 [info] <0.240.0> Importing parameters... 2026-04-20 05:30:35.553 [info] <0.240.0> Importing global parameters... 2026-04-20 05:30:35.553 [info] <0.240.0> Importing policies... 2026-04-20 05:30:35.561 [info] <0.240.0> Importing queues... 2026-04-20 05:30:35.561 [info] <0.240.0> Importing exchanges... 2026-04-20 05:30:35.561 [info] <0.240.0> Importing bindings... 2026-04-20 05:30:35.561 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:30:35.561 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:30:35.562 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:30:35.562 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:30:35.562 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:30:35.567 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:30:35.572 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:30:35.572 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:30:35.572 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:30:35.572 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:30:35.572 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:30:35.574 [info] <0.562.0> started TCP listener on [::]:5673 2026-04-20 05:30:35.575 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:30:35.575 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:30:35.575 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:30:35.575 [info] <0.564.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:30:35.610 [info] <0.614.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:30:35.610 [info] <0.720.0> Statistics database started. 2026-04-20 05:30:35.610 [info] <0.719.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:30:35.610 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:30:35.737 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:30:36.830 [info] <0.461.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-1' down: connection_closed 2026-04-20 05:30:37.483 [info] <0.731.0> accepting AMQP connection <0.731.0> (10.0.0.33:49092 -> 10.0.0.50:5673) 2026-04-20 05:30:37.484 [info] <0.735.0> accepting AMQP connection <0.735.0> (10.0.0.50:50902 -> 10.0.0.50:5673) 2026-04-20 05:30:37.488 [info] <0.735.0> connection <0.735.0> (10.0.0.50:50902 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.488 [info] <0.740.0> accepting AMQP connection <0.740.0> (10.0.0.50:50910 -> 10.0.0.50:5673) 2026-04-20 05:30:37.493 [info] <0.731.0> connection <0.731.0> (10.0.0.33:49092 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.493 [info] <0.740.0> connection <0.740.0> (10.0.0.50:50910 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.496 [info] <0.759.0> accepting AMQP connection <0.759.0> (10.0.0.38:52316 -> 10.0.0.50:5673) 2026-04-20 05:30:37.499 [info] <0.771.0> accepting AMQP connection <0.771.0> (10.0.0.33:49100 -> 10.0.0.50:5673) 2026-04-20 05:30:37.505 [info] <0.786.0> accepting AMQP connection <0.786.0> (10.0.0.38:52318 -> 10.0.0.50:5673) 2026-04-20 05:30:37.506 [info] <0.771.0> connection <0.771.0> (10.0.0.33:49100 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.506 [info] <0.759.0> connection <0.759.0> (10.0.0.38:52316 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.512 [info] <0.808.0> accepting AMQP connection <0.808.0> (10.0.0.50:50920 -> 10.0.0.50:5673) 2026-04-20 05:30:37.513 [info] <0.786.0> connection <0.786.0> (10.0.0.38:52318 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.520 [info] <0.808.0> connection <0.808.0> (10.0.0.50:50920 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.563 [info] <0.859.0> accepting AMQP connection <0.859.0> (10.0.0.33:49102 -> 10.0.0.50:5673) 2026-04-20 05:30:37.566 [info] <0.859.0> connection <0.859.0> (10.0.0.33:49102 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:37.831 [info] <0.877.0> accepting AMQP connection <0.877.0> (10.0.0.38:52330 -> 10.0.0.50:5673) 2026-04-20 05:30:37.836 [info] <0.877.0> connection <0.877.0> (10.0.0.38:52330 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.703 [info] <0.898.0> accepting AMQP connection <0.898.0> (10.0.0.33:40914 -> 10.0.0.50:5673) 2026-04-20 05:30:39.703 [info] <0.895.0> accepting AMQP connection <0.895.0> (10.0.0.38:52342 -> 10.0.0.50:5673) 2026-04-20 05:30:39.703 [info] <0.901.0> accepting AMQP connection <0.901.0> (10.0.0.38:52344 -> 10.0.0.50:5673) 2026-04-20 05:30:39.703 [info] <0.904.0> accepting AMQP connection <0.904.0> (10.0.0.33:40918 -> 10.0.0.50:5673) 2026-04-20 05:30:39.704 [info] <0.907.0> accepting AMQP connection <0.907.0> (10.0.0.33:40934 -> 10.0.0.50:5673) 2026-04-20 05:30:39.705 [info] <0.910.0> accepting AMQP connection <0.910.0> (10.0.0.50:54668 -> 10.0.0.50:5673) 2026-04-20 05:30:39.705 [info] <0.913.0> accepting AMQP connection <0.913.0> (10.0.0.50:54672 -> 10.0.0.50:5673) 2026-04-20 05:30:39.706 [info] <0.898.0> connection <0.898.0> (10.0.0.33:40914 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.706 [info] <0.901.0> connection <0.901.0> (10.0.0.38:52344 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.706 [info] <0.921.0> accepting AMQP connection <0.921.0> (10.0.0.38:52358 -> 10.0.0.50:5673) 2026-04-20 05:30:39.706 [info] <0.895.0> connection <0.895.0> (10.0.0.38:52342 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.706 [info] <0.904.0> connection <0.904.0> (10.0.0.33:40918 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.708 [info] <0.907.0> connection <0.907.0> (10.0.0.33:40934 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.708 [info] <0.910.0> connection <0.910.0> (10.0.0.50:54668 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.708 [info] <0.946.0> accepting AMQP connection <0.946.0> (10.0.0.50:54686 -> 10.0.0.50:5673) 2026-04-20 05:30:39.713 [info] <0.921.0> connection <0.921.0> (10.0.0.38:52358 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.713 [info] <0.946.0> connection <0.946.0> (10.0.0.50:54686 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:39.713 [info] <0.913.0> connection <0.913.0> (10.0.0.50:54672 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:40.990 [info] <0.1068.0> accepting AMQP connection <0.1068.0> (10.0.0.38:52366 -> 10.0.0.50:5673) 2026-04-20 05:30:40.992 [info] <0.1068.0> connection <0.1068.0> (10.0.0.38:52366 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:41.707 [info] <0.1079.0> accepting AMQP connection <0.1079.0> (10.0.0.50:54700 -> 10.0.0.50:5673) 2026-04-20 05:30:41.728 [info] <0.1079.0> connection <0.1079.0> (10.0.0.50:54700 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:41.760 [info] <0.1097.0> accepting AMQP connection <0.1097.0> (10.0.0.50:54714 -> 10.0.0.50:5673) 2026-04-20 05:30:41.772 [info] <0.1097.0> connection <0.1097.0> (10.0.0.50:54714 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:41.779 [info] <0.1097.0> closing AMQP connection <0.1097.0> (10.0.0.50:54714 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:30:41.779 [info] <0.1108.0> accepting AMQP connection <0.1108.0> (10.0.0.50:54718 -> 10.0.0.50:5673) 2026-04-20 05:30:41.795 [info] <0.1108.0> connection <0.1108.0> (10.0.0.50:54718 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:42.517 [info] <0.1118.0> RabbitMQ is asked to stop... 2026-04-20 05:30:42.683 [info] <0.1121.0> accepting AMQP connection <0.1121.0> (10.0.0.33:40938 -> 10.0.0.50:5673) 2026-04-20 05:30:42.695 [info] <0.1121.0> connection <0.1121.0> (10.0.0.33:40938 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:30:42.942 [info] <0.1118.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:30:42.942 [info] <0.1118.0> Stopping application 'rabbitmq_management' 2026-04-20 05:30:42.946 [warning] <0.570.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:30:42.954 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:30:42.955 [info] <0.1118.0> Stopping application 'amqp_client' 2026-04-20 05:30:42.959 [info] <0.1118.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:30:42.959 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:30:42.969 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:30:42.969 [info] <0.1118.0> Stopping application 'cowboy' 2026-04-20 05:30:42.973 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:30:42.973 [info] <0.1118.0> Stopping application 'cowlib' 2026-04-20 05:30:42.973 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:30:42.973 [info] <0.1118.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:30:42.981 [info] <0.1118.0> Stopping application 'rabbit' 2026-04-20 05:30:42.981 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:30:42.982 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:30:42.982 [info] <0.562.0> stopped TCP listener on [::]:5673 2026-04-20 05:30:42.986 [error] <0.1079.0> Error on AMQP connection <0.1079.0> (10.0.0.50:54700 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.986 [error] <0.877.0> Error on AMQP connection <0.877.0> (10.0.0.38:52330 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.986 [error] <0.859.0> Error on AMQP connection <0.859.0> (10.0.0.33:49102 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.986 [error] <0.904.0> Error on AMQP connection <0.904.0> (10.0.0.33:40918 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.986 [error] <0.808.0> Error on AMQP connection <0.808.0> (10.0.0.50:50920 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.986 [error] <0.1108.0> Error on AMQP connection <0.1108.0> (10.0.0.50:54718 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.986 [error] <0.910.0> Error on AMQP connection <0.910.0> (10.0.0.50:54668 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.987 [error] <0.1121.0> Error on AMQP connection <0.1121.0> (10.0.0.33:40938 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.987 [error] <0.895.0> Error on AMQP connection <0.895.0> (10.0.0.38:52342 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.987 [error] <0.786.0> Error on AMQP connection <0.786.0> (10.0.0.38:52318 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.988 [error] <0.731.0> Error on AMQP connection <0.731.0> (10.0.0.33:49092 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.988 [error] <0.907.0> Error on AMQP connection <0.907.0> (10.0.0.33:40934 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.988 [error] <0.901.0> Error on AMQP connection <0.901.0> (10.0.0.38:52344 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.988 [error] <0.735.0> Error on AMQP connection <0.735.0> (10.0.0.50:50902 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.988 [error] <0.740.0> Error on AMQP connection <0.740.0> (10.0.0.50:50910 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.986 [error] <0.913.0> Error on AMQP connection <0.913.0> (10.0.0.50:54672 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.989 [error] <0.759.0> Error on AMQP connection <0.759.0> (10.0.0.38:52316 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.989 [error] <0.946.0> Error on AMQP connection <0.946.0> (10.0.0.50:54686 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.991 [error] <0.1068.0> Error on AMQP connection <0.1068.0> (10.0.0.38:52366 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.990 [error] <0.898.0> Error on AMQP connection <0.898.0> (10.0.0.33:40914 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.988 [error] <0.771.0> Error on AMQP connection <0.771.0> (10.0.0.33:49100 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.992 [error] <0.921.0> Error on AMQP connection <0.921.0> (10.0.0.38:52358 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:30:42.997 [error] <0.816.0> Supervisor {<0.816.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:30:43.008 [info] <0.486.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:30:43.009 [warning] <0.762.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.009 [warning] <0.1011.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.850.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.787.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.868.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.988.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.1003.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.886.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.827.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.970.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.822.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.010 [warning] <0.767.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.011 [warning] <0.979.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.011 [warning] <0.995.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.011 [warning] <0.963.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.011 [warning] <0.819.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.011 [warning] <0.1088.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.011 [warning] <0.958.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.012 [warning] <0.1017.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:30:43.098 [info] <0.516.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:30:43.104 [info] <0.516.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:30:43.105 [info] <0.513.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:30:43.111 [info] <0.513.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:30:43.117 [info] <0.1118.0> Stopping application 'mnesia' 2026-04-20 05:30:43.117 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:30:43.120 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:30:43.120 [info] <0.1118.0> Stopping application 'rabbit_common' 2026-04-20 05:30:44.126 [warning] lager_file_backend dropped 6 messages in the last second that exceeded the limit of 50 messages/sec 2026-04-20 05:31:38.827 [info] <0.1239.0> Resetting Rabbit forcefully 2026-04-20 05:31:39.989 [info] <0.1253.0> RabbitMQ is asked to stop... 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'rabbitmq_management' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'amqp_client' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'rabbit' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'mnesia' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'rabbit_common' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'sysmon_handler' 2026-04-20 05:31:40.043 [info] <0.1253.0> Stopping application 'os_mon' 2026-04-20 05:31:40.043 [info] <0.1253.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:31:40.043 [info] <0.1253.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:31:45.737 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:31:47.466 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:31:47.466 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:31:47.491 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:31:47.491 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:31:47.506 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:31:47.506 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:31:47.507 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:31:47.512 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:31:47.518 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:31:47.518 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:31:47.522 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:31:47.523 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:31:47.523 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:31:47.523 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:31:47.523 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:31:47.523 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:31:47.523 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:31:47.523 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:31:47.524 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:31:47.524 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:31:47.524 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:31:47.524 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:31:47.524 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:31:47.524 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:31:47.524 [info] <0.240.0> Will wait for 17719 milliseconds before proceeding with registration... 2026-04-20 05:32:05.243 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:32:05.244 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:32:05.246 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:05.249 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:05.249 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:32:05.752 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:05.752 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:05.752 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:32:06.255 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:06.256 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:06.256 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:32:06.759 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:06.760 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:06.760 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:32:07.263 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:07.264 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:07.264 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:32:07.766 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:07.767 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:07.767 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:32:08.269 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:08.270 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:08.270 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:32:08.773 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:08.774 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:08.774 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:32:09.276 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:09.277 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:09.277 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:32:09.779 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:32:09.779 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:32:09.779 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:32:10.280 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:32:10.283 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:32:10.403 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:32:10.403 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:32:10.436 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:32:10.436 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:32:10.464 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:32:10.464 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:32:10.464 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:32:10.465 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:32:10.466 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:32:10.467 [info] <0.462.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:32:10.467 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:32:10.472 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:32:10.472 [info] <0.466.0> Starting rabbit_node_monitor 2026-04-20 05:32:10.472 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:32:10.472 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:32:10.473 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:32:10.473 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:32:10.495 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:32:10.496 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:32:10.496 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:32:10.496 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:32:10.498 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:32:10.524 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:32:10.524 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:32:10.524 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:32:10.524 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:32:10.524 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:32:10.525 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:32:10.525 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:32:10.525 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:32:10.525 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:32:10.525 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:32:10.525 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:32:10.525 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:32:10.526 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:32:10.526 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:32:10.527 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:32:10.527 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:32:10.528 [info] <0.240.0> Importing users... 2026-04-20 05:32:10.528 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:32:10.536 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:32:10.539 [info] <0.240.0> Importing vhosts... 2026-04-20 05:32:10.539 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:32:10.562 [info] <0.514.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:32:10.573 [info] <0.514.0> Starting message stores for vhost '/' 2026-04-20 05:32:10.573 [info] <0.518.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:32:10.577 [info] <0.514.0> Started message store of type transient for vhost '/' 2026-04-20 05:32:10.578 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:32:10.581 [warning] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:32:10.582 [info] <0.514.0> Started message store of type persistent for vhost '/' 2026-04-20 05:32:10.584 [info] <0.240.0> Importing user permissions... 2026-04-20 05:32:10.584 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:32:10.588 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:32:10.588 [info] <0.240.0> Importing parameters... 2026-04-20 05:32:10.588 [info] <0.240.0> Importing global parameters... 2026-04-20 05:32:10.588 [info] <0.240.0> Importing policies... 2026-04-20 05:32:10.594 [info] <0.240.0> Importing queues... 2026-04-20 05:32:10.594 [info] <0.240.0> Importing exchanges... 2026-04-20 05:32:10.594 [info] <0.240.0> Importing bindings... 2026-04-20 05:32:10.595 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:32:10.595 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:32:10.595 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:32:10.595 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:32:10.595 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:32:10.599 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:32:10.604 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:32:10.605 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:32:10.605 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:32:10.605 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:32:10.605 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:32:10.607 [info] <0.567.0> started TCP listener on [::]:5673 2026-04-20 05:32:10.607 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:32:10.607 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:32:10.607 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:32:10.607 [info] <0.569.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:32:10.639 [info] <0.619.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:32:10.639 [info] <0.725.0> Statistics database started. 2026-04-20 05:32:10.639 [info] <0.724.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:32:10.639 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:32:10.733 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:32:13.105 [info] <0.736.0> accepting AMQP connection <0.736.0> (10.0.0.50:42034 -> 10.0.0.50:5673) 2026-04-20 05:32:13.111 [info] <0.740.0> accepting AMQP connection <0.740.0> (10.0.0.38:33310 -> 10.0.0.50:5673) 2026-04-20 05:32:13.113 [info] <0.736.0> connection <0.736.0> (10.0.0.50:42034 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.114 [info] <0.740.0> connection <0.740.0> (10.0.0.38:33310 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.116 [info] <0.759.0> accepting AMQP connection <0.759.0> (10.0.0.33:58464 -> 10.0.0.50:5673) 2026-04-20 05:32:13.119 [info] <0.759.0> connection <0.759.0> (10.0.0.33:58464 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.122 [info] <0.779.0> accepting AMQP connection <0.779.0> (10.0.0.38:33318 -> 10.0.0.50:5673) 2026-04-20 05:32:13.124 [info] <0.785.0> accepting AMQP connection <0.785.0> (10.0.0.50:42050 -> 10.0.0.50:5673) 2026-04-20 05:32:13.124 [info] <0.788.0> accepting AMQP connection <0.788.0> (10.0.0.33:58480 -> 10.0.0.50:5673) 2026-04-20 05:32:13.126 [info] <0.779.0> connection <0.779.0> (10.0.0.38:33318 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.126 [info] <0.788.0> connection <0.788.0> (10.0.0.33:58480 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.127 [info] <0.785.0> connection <0.785.0> (10.0.0.50:42050 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.143 [info] <0.846.0> accepting AMQP connection <0.846.0> (10.0.0.38:33332 -> 10.0.0.50:5673) 2026-04-20 05:32:13.147 [info] <0.846.0> connection <0.846.0> (10.0.0.38:33332 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.156 [info] <0.857.0> accepting AMQP connection <0.857.0> (10.0.0.33:58496 -> 10.0.0.50:5673) 2026-04-20 05:32:13.160 [info] <0.857.0> connection <0.857.0> (10.0.0.33:58496 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.202 [info] <0.875.0> accepting AMQP connection <0.875.0> (10.0.0.38:33346 -> 10.0.0.50:5673) 2026-04-20 05:32:13.220 [info] <0.875.0> connection <0.875.0> (10.0.0.38:33346 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.266 [info] <0.893.0> accepting AMQP connection <0.893.0> (10.0.0.38:33352 -> 10.0.0.50:5673) 2026-04-20 05:32:13.267 [info] <0.899.0> accepting AMQP connection <0.899.0> (10.0.0.50:42066 -> 10.0.0.50:5673) 2026-04-20 05:32:13.268 [info] <0.896.0> accepting AMQP connection <0.896.0> (10.0.0.33:58500 -> 10.0.0.50:5673) 2026-04-20 05:32:13.269 [info] <0.902.0> accepting AMQP connection <0.902.0> (10.0.0.50:42072 -> 10.0.0.50:5673) 2026-04-20 05:32:13.269 [info] <0.905.0> accepting AMQP connection <0.905.0> (10.0.0.50:42054 -> 10.0.0.50:5673) 2026-04-20 05:32:13.269 [info] <0.908.0> accepting AMQP connection <0.908.0> (10.0.0.33:58506 -> 10.0.0.50:5673) 2026-04-20 05:32:13.269 [info] <0.911.0> accepting AMQP connection <0.911.0> (10.0.0.38:33362 -> 10.0.0.50:5673) 2026-04-20 05:32:13.270 [info] <0.893.0> connection <0.893.0> (10.0.0.38:33352 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.270 [info] <0.896.0> connection <0.896.0> (10.0.0.33:58500 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.270 [info] <0.899.0> connection <0.899.0> (10.0.0.50:42066 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.271 [info] <0.923.0> accepting AMQP connection <0.923.0> (10.0.0.38:33376 -> 10.0.0.50:5673) 2026-04-20 05:32:13.271 [info] <0.908.0> connection <0.908.0> (10.0.0.33:58506 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.272 [info] <0.932.0> accepting AMQP connection <0.932.0> (10.0.0.33:58516 -> 10.0.0.50:5673) 2026-04-20 05:32:13.274 [info] <0.902.0> connection <0.902.0> (10.0.0.50:42072 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.274 [info] <0.905.0> connection <0.905.0> (10.0.0.50:42054 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.275 [info] <0.911.0> connection <0.911.0> (10.0.0.38:33362 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.276 [info] <0.932.0> connection <0.932.0> (10.0.0.33:58516 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.277 [info] <0.923.0> connection <0.923.0> (10.0.0.38:33376 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.718 [info] <0.1055.0> accepting AMQP connection <0.1055.0> (10.0.0.50:42088 -> 10.0.0.50:5673) 2026-04-20 05:32:13.720 [info] <0.1055.0> connection <0.1055.0> (10.0.0.50:42088 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:13.769 [info] <0.1066.0> accepting AMQP connection <0.1066.0> (10.0.0.33:58530 -> 10.0.0.50:5673) 2026-04-20 05:32:13.771 [info] <0.1066.0> connection <0.1066.0> (10.0.0.33:58530 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:14.954 [info] <0.1077.0> accepting AMQP connection <0.1077.0> (10.0.0.50:42094 -> 10.0.0.50:5673) 2026-04-20 05:32:14.956 [info] <0.1077.0> connection <0.1077.0> (10.0.0.50:42094 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:32:15.620 [info] <0.1107.0> RabbitMQ is asked to stop... 2026-04-20 05:32:15.695 [info] <0.1107.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:32:15.695 [info] <0.1107.0> Stopping application 'rabbitmq_management' 2026-04-20 05:32:15.697 [warning] <0.615.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:32:15.699 [info] <0.1107.0> Stopping application 'amqp_client' 2026-04-20 05:32:15.700 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:32:15.702 [info] <0.1107.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:32:15.702 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:32:15.704 [info] <0.1107.0> Stopping application 'cowboy' 2026-04-20 05:32:15.704 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:32:15.705 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:32:15.705 [info] <0.1107.0> Stopping application 'cowlib' 2026-04-20 05:32:15.706 [info] <0.1107.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:32:15.706 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:32:15.708 [info] <0.1107.0> Stopping application 'rabbit' 2026-04-20 05:32:15.708 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:32:15.708 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:32:15.708 [info] <0.567.0> stopped TCP listener on [::]:5673 2026-04-20 05:32:15.710 [error] <0.899.0> Error on AMQP connection <0.899.0> (10.0.0.50:42066 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.736.0> Error on AMQP connection <0.736.0> (10.0.0.50:42034 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.1077.0> Error on AMQP connection <0.1077.0> (10.0.0.50:42094 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.857.0> Error on AMQP connection <0.857.0> (10.0.0.33:58496 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.1066.0> Error on AMQP connection <0.1066.0> (10.0.0.33:58530 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.740.0> Error on AMQP connection <0.740.0> (10.0.0.38:33310 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.923.0> Error on AMQP connection <0.923.0> (10.0.0.38:33376 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.846.0> Error on AMQP connection <0.846.0> (10.0.0.38:33332 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.779.0> Error on AMQP connection <0.779.0> (10.0.0.38:33318 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.896.0> Error on AMQP connection <0.896.0> (10.0.0.33:58500 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.908.0> Error on AMQP connection <0.908.0> (10.0.0.33:58506 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.875.0> Error on AMQP connection <0.875.0> (10.0.0.38:33346 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.785.0> Error on AMQP connection <0.785.0> (10.0.0.50:42050 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.710 [error] <0.788.0> Error on AMQP connection <0.788.0> (10.0.0.33:58480 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.711 [error] <0.932.0> Error on AMQP connection <0.932.0> (10.0.0.33:58516 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.711 [error] <0.893.0> Error on AMQP connection <0.893.0> (10.0.0.38:33352 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.711 [error] <0.905.0> Error on AMQP connection <0.905.0> (10.0.0.50:42054 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.711 [error] <0.759.0> Error on AMQP connection <0.759.0> (10.0.0.33:58464 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.711 [error] <0.902.0> Error on AMQP connection <0.902.0> (10.0.0.50:42072 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.711 [error] <0.911.0> Error on AMQP connection <0.911.0> (10.0.0.38:33362 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.711 [error] <0.1055.0> Error on AMQP connection <0.1055.0> (10.0.0.50:42088 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:32:15.722 [error] <0.1059.0> Supervisor {<0.1059.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason noproc in context shutdown_error 2026-04-20 05:32:15.724 [error] <0.930.0> Supervisor {<0.930.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:32:15.733 [info] <0.491.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:32:15.734 [warning] <0.822.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:15.734 [warning] <0.763.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:15.734 [warning] <0.819.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:15.735 [warning] <0.884.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:15.735 [warning] <0.963.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:15.735 [warning] <0.866.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:15.735 [warning] <0.993.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:15.735 [warning] <0.989.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:32:16.216 [warning] lager_file_backend dropped 24 messages in the last second that exceeded the limit of 50 messages/sec 2026-04-20 05:33:57.049 [info] <0.1201.0> Resetting Rabbit forcefully 2026-04-20 05:33:58.124 [info] <0.1215.0> RabbitMQ is asked to stop... 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'rabbitmq_management' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'amqp_client' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'rabbit' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'mnesia' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'rabbit_common' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'sysmon_handler' 2026-04-20 05:33:58.185 [info] <0.1215.0> Stopping application 'os_mon' 2026-04-20 05:33:58.185 [info] <0.1215.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:33:58.185 [info] <0.1215.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:34:04.766 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:34:06.892 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:34:06.892 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:34:06.912 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:34:06.913 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:34:06.925 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:34:06.925 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:34:06.925 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:34:06.930 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:34:06.935 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:34:06.935 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:34:06.939 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:34:06.939 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:34:06.940 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:34:06.940 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:34:06.940 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:34:06.940 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:34:06.940 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:34:06.940 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:34:06.940 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:34:06.941 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:34:06.941 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:34:06.941 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:34:06.941 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:34:06.941 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:34:06.941 [info] <0.240.0> Will wait for 54110 milliseconds before proceeding with registration... 2026-04-20 05:34:46.511 [info] <0.294.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2026-04-20 05:35:01.051 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:35:01.051 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:35:01.053 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:01.058 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:01.058 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:35:01.560 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:01.561 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:01.562 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:35:02.064 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:02.065 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:02.065 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:35:02.568 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:02.568 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:02.569 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:35:03.070 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:03.072 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:03.072 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:35:03.573 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:03.574 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:03.575 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:35:04.076 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:04.077 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:04.077 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:35:04.579 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:04.580 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:04.580 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:35:05.082 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:05.084 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:05.084 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:35:05.586 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:35:05.587 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:35:05.588 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:35:06.089 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:35:06.091 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:35:06.202 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:35:06.202 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:35:06.227 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:35:06.227 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:35:06.260 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:35:06.260 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:35:06.260 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:35:06.260 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:35:06.260 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:35:06.261 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:35:06.261 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:35:06.261 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:35:06.261 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:35:06.261 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:35:06.261 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:35:06.262 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:35:06.263 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:35:06.263 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:35:06.263 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:35:06.263 [info] <0.478.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:35:06.263 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:35:06.267 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:35:06.267 [info] <0.482.0> Starting rabbit_node_monitor 2026-04-20 05:35:06.267 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:35:06.267 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:35:06.268 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:35:06.268 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:35:06.290 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:35:06.290 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:35:06.290 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:35:06.290 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:35:06.290 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:35:06.316 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:35:06.316 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:35:06.316 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:35:06.316 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:35:06.316 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:35:06.317 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:35:06.317 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:35:06.317 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:35:06.317 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:35:06.317 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:35:06.317 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:35:06.317 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:35:06.317 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:35:06.318 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:35:06.318 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:35:06.318 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:35:06.318 [info] <0.240.0> Importing users... 2026-04-20 05:35:06.318 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:35:06.327 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:35:06.331 [info] <0.240.0> Importing vhosts... 2026-04-20 05:35:06.331 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:35:06.354 [info] <0.530.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:35:06.360 [info] <0.530.0> Starting message stores for vhost '/' 2026-04-20 05:35:06.360 [info] <0.534.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:35:06.362 [info] <0.530.0> Started message store of type transient for vhost '/' 2026-04-20 05:35:06.362 [info] <0.537.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:35:06.362 [warning] <0.537.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:35:06.363 [info] <0.530.0> Started message store of type persistent for vhost '/' 2026-04-20 05:35:06.364 [info] <0.240.0> Importing user permissions... 2026-04-20 05:35:06.364 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:35:06.371 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:35:06.371 [info] <0.240.0> Importing parameters... 2026-04-20 05:35:06.371 [info] <0.240.0> Importing global parameters... 2026-04-20 05:35:06.371 [info] <0.240.0> Importing policies... 2026-04-20 05:35:06.382 [info] <0.240.0> Importing queues... 2026-04-20 05:35:06.382 [info] <0.240.0> Importing exchanges... 2026-04-20 05:35:06.382 [info] <0.240.0> Importing bindings... 2026-04-20 05:35:06.382 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:35:06.382 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:35:06.382 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:35:06.382 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:35:06.383 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:35:06.386 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:35:06.393 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:35:06.393 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:35:06.393 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:35:06.393 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:35:06.393 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:35:06.395 [info] <0.583.0> started TCP listener on [::]:5673 2026-04-20 05:35:06.396 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:35:06.396 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:35:06.396 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:35:06.396 [info] <0.585.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:35:06.425 [info] <0.635.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:35:06.425 [info] <0.741.0> Statistics database started. 2026-04-20 05:35:06.425 [info] <0.740.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:35:06.425 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:35:06.523 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:35:06.590 [info] <0.751.0> accepting AMQP connection <0.751.0> (10.0.0.38:39178 -> 10.0.0.50:5673) 2026-04-20 05:35:06.596 [info] <0.751.0> connection <0.751.0> (10.0.0.38:39178 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:35:06.618 [info] <0.771.0> accepting AMQP connection <0.771.0> (10.0.0.38:39190 -> 10.0.0.50:5673) 2026-04-20 05:35:06.618 [info] <0.294.0> RabbitMQ is asked to stop... 2026-04-20 05:35:06.624 [info] <0.771.0> connection <0.771.0> (10.0.0.38:39190 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:35:06.637 [info] <0.751.0> closing AMQP connection <0.751.0> (10.0.0.38:39178 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:35:06.639 [info] <0.771.0> closing AMQP connection <0.771.0> (10.0.0.38:39190 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:35:06.694 [info] <0.294.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:35:06.694 [info] <0.294.0> Stopping application 'rabbitmq_management' 2026-04-20 05:35:06.695 [warning] <0.631.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:35:06.697 [info] <0.294.0> Stopping application 'amqp_client' 2026-04-20 05:35:06.697 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:35:06.698 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:35:06.698 [info] <0.294.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:35:06.700 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:35:06.700 [info] <0.294.0> Stopping application 'cowboy' 2026-04-20 05:35:06.701 [info] <0.294.0> Stopping application 'cowlib' 2026-04-20 05:35:06.701 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:35:06.701 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:35:06.701 [info] <0.294.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:35:06.702 [info] <0.294.0> Stopping application 'rabbit' 2026-04-20 05:35:06.702 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:35:06.702 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:35:06.703 [info] <0.583.0> stopped TCP listener on [::]:5673 2026-04-20 05:35:06.703 [info] <0.507.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:35:06.703 [info] <0.537.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:35:06.716 [info] <0.537.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:35:06.716 [info] <0.534.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:35:06.721 [info] <0.534.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:35:06.724 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:35:06.724 [info] <0.294.0> Stopping application 'mnesia' 2026-04-20 05:35:06.728 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:35:06.731 [info] <0.294.0> Stopping application 'rabbit_common' 2026-04-20 05:35:06.731 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:35:06.731 [info] <0.294.0> Stopping application 'sysmon_handler' 2026-04-20 05:35:06.732 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:35:06.732 [info] <0.294.0> Stopping application 'os_mon' 2026-04-20 05:35:06.734 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:35:06.734 [info] <0.294.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:36:08.495 [info] <0.799.0> Resetting Rabbit forcefully 2026-04-20 05:36:09.525 [info] <0.813.0> RabbitMQ is asked to stop... 2026-04-20 05:36:09.583 [info] <0.813.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'rabbitmq_management' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'amqp_client' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'rabbit' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'mnesia' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'rabbit_common' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'sysmon_handler' 2026-04-20 05:36:09.584 [info] <0.813.0> Stopping application 'os_mon' 2026-04-20 05:36:09.584 [info] <0.813.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:36:09.584 [info] <0.813.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:36:17.248 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:36:19.666 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:36:19.666 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:36:19.688 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:36:19.688 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:36:19.701 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:36:19.701 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:36:19.701 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:36:19.709 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:36:19.720 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:36:19.720 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:36:19.725 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:36:19.725 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:36:19.726 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:36:19.726 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:36:19.726 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:36:19.728 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:36:19.728 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:36:19.728 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:36:19.728 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:36:19.729 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:36:19.729 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:36:19.729 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:36:19.729 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:36:19.729 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:36:19.729 [info] <0.240.0> Will wait for 26873 milliseconds before proceeding with registration... 2026-04-20 05:36:46.603 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:36:46.603 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:36:46.605 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:46.608 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:46.608 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:36:47.111 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:47.112 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:47.112 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:36:47.615 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:47.615 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:47.615 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:36:48.118 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:48.119 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:48.119 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:36:48.621 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:48.621 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:48.622 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:36:49.124 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:49.125 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:49.125 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:36:49.629 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:49.629 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:49.629 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:36:50.132 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:50.132 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:50.132 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:36:50.635 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:50.636 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:50.636 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:36:51.138 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:36:51.138 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:36:51.138 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:36:51.639 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:36:51.642 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:36:51.762 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:36:51.762 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:36:51.793 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:36:51.794 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:36:51.832 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:36:51.832 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:36:51.832 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:36:51.832 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:36:51.833 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:36:51.834 [info] <0.468.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:36:51.835 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:36:51.838 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:36:51.839 [info] <0.472.0> Starting rabbit_node_monitor 2026-04-20 05:36:51.839 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:36:51.839 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:36:51.839 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:36:51.839 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:36:51.861 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:36:51.861 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:36:51.862 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:36:51.862 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:36:51.862 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:36:51.895 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:36:51.895 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:36:51.895 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:36:51.896 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:36:51.896 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:36:51.897 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:36:51.897 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:36:51.897 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:36:51.897 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:36:51.897 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:36:51.897 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:36:51.897 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:36:51.897 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:36:51.898 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:36:51.899 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:36:51.899 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:36:51.900 [info] <0.240.0> Importing users... 2026-04-20 05:36:51.900 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:36:51.909 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:36:51.912 [info] <0.240.0> Importing vhosts... 2026-04-20 05:36:51.912 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:36:51.939 [info] <0.520.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:36:51.947 [info] <0.520.0> Starting message stores for vhost '/' 2026-04-20 05:36:51.947 [info] <0.524.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:36:51.947 [info] <0.520.0> Started message store of type transient for vhost '/' 2026-04-20 05:36:51.948 [info] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:36:51.948 [warning] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:36:51.949 [info] <0.520.0> Started message store of type persistent for vhost '/' 2026-04-20 05:36:51.950 [info] <0.240.0> Importing user permissions... 2026-04-20 05:36:51.950 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:36:51.954 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:36:51.954 [info] <0.240.0> Importing parameters... 2026-04-20 05:36:51.954 [info] <0.240.0> Importing global parameters... 2026-04-20 05:36:51.954 [info] <0.240.0> Importing policies... 2026-04-20 05:36:51.960 [info] <0.240.0> Importing queues... 2026-04-20 05:36:51.960 [info] <0.240.0> Importing exchanges... 2026-04-20 05:36:51.960 [info] <0.240.0> Importing bindings... 2026-04-20 05:36:51.960 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:36:51.960 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:36:51.960 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:36:51.960 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:36:51.960 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:36:51.964 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:36:51.968 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:36:51.968 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:36:51.968 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:36:51.968 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:36:51.968 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:36:51.970 [info] <0.573.0> started TCP listener on [::]:5673 2026-04-20 05:36:51.970 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:36:51.970 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:36:51.970 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:36:51.970 [info] <0.575.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:36:51.999 [info] <0.625.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:36:51.999 [info] <0.731.0> Statistics database started. 2026-04-20 05:36:52.000 [info] <0.730.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:36:52.000 [notice] <0.108.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:36:52.081 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:36:53.493 [info] <0.755.0> RabbitMQ is asked to stop... 2026-04-20 05:36:53.597 [info] <0.755.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:36:53.597 [info] <0.755.0> Stopping application 'rabbitmq_management' 2026-04-20 05:36:53.599 [warning] <0.621.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:36:53.601 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:36:53.601 [info] <0.755.0> Stopping application 'amqp_client' 2026-04-20 05:36:53.603 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:36:53.603 [info] <0.755.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:36:53.604 [info] <0.755.0> Stopping application 'cowboy' 2026-04-20 05:36:53.604 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:36:53.606 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:36:53.606 [info] <0.755.0> Stopping application 'cowlib' 2026-04-20 05:36:53.606 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:36:53.606 [info] <0.755.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:36:53.608 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:36:53.608 [info] <0.755.0> Stopping application 'rabbit' 2026-04-20 05:36:53.608 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:36:53.609 [info] <0.573.0> stopped TCP listener on [::]:5673 2026-04-20 05:36:53.609 [info] <0.497.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:36:53.610 [info] <0.527.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:36:53.615 [info] <0.527.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:36:53.615 [info] <0.524.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:36:53.618 [info] <0.524.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:36:53.621 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:36:53.621 [info] <0.755.0> Stopping application 'mnesia' 2026-04-20 05:36:53.624 [info] <0.755.0> Stopping application 'rabbit_common' 2026-04-20 05:36:53.624 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:36:53.624 [info] <0.755.0> Stopping application 'sysmon_handler' 2026-04-20 05:36:53.624 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:36:53.626 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:36:53.626 [info] <0.755.0> Stopping application 'os_mon' 2026-04-20 05:36:53.627 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:36:53.627 [info] <0.755.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:37:18.654 [info] <0.770.0> Resetting Rabbit forcefully 2026-04-20 05:37:20.177 [info] <0.784.0> RabbitMQ is asked to stop... 2026-04-20 05:37:20.270 [info] <0.784.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:37:20.270 [info] <0.784.0> Stopping application 'rabbitmq_management' 2026-04-20 05:37:20.270 [info] <0.784.0> Stopping application 'amqp_client' 2026-04-20 05:37:20.270 [info] <0.784.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:37:20.270 [info] <0.784.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:37:20.271 [info] <0.784.0> Stopping application 'rabbit' 2026-04-20 05:37:20.271 [info] <0.784.0> Stopping application 'mnesia' 2026-04-20 05:37:20.271 [info] <0.784.0> Stopping application 'rabbit_common' 2026-04-20 05:37:20.271 [info] <0.784.0> Stopping application 'sysmon_handler' 2026-04-20 05:37:20.271 [info] <0.784.0> Stopping application 'os_mon' 2026-04-20 05:37:20.271 [info] <0.784.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:37:20.271 [info] <0.784.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:37:25.983 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:37:27.975 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:37:27.975 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:37:27.993 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:37:27.994 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:37:28.006 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:37:28.006 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:37:28.006 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:37:28.014 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:37:28.022 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:37:28.022 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:37:28.036 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:37:28.036 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:37:28.036 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:37:28.036 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:37:28.036 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:37:28.040 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:37:28.040 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:37:28.040 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:37:28.040 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:37:28.040 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:37:28.040 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:37:28.040 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:37:28.040 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:37:28.040 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:37:28.040 [info] <0.240.0> Will wait for 16177 milliseconds before proceeding with registration... 2026-04-20 05:37:44.218 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:37:44.218 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:37:44.220 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:44.224 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:44.224 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:37:44.727 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:44.728 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:44.728 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:37:45.229 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:45.230 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:45.230 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:37:45.732 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:45.733 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:45.734 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:37:46.235 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:46.236 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:46.236 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:37:46.738 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:46.739 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:46.739 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:37:47.241 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:47.242 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:47.242 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:37:47.744 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:47.745 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:47.745 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:37:48.251 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:48.252 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:48.252 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:37:48.753 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:37:48.754 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:37:48.754 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:37:49.255 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:37:49.259 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:37:49.388 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:37:49.388 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:37:49.414 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:37:49.414 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:37:49.444 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:37:49.444 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:37:49.444 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:37:49.444 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:37:49.444 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:37:49.445 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:37:49.445 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:37:49.446 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:37:49.446 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:37:49.447 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:37:49.447 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:37:49.448 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:37:49.448 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:37:49.448 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:37:49.448 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:37:49.448 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:37:49.448 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:37:49.449 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:37:49.450 [info] <0.462.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:37:49.450 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:37:49.455 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:37:49.455 [info] <0.466.0> Starting rabbit_node_monitor 2026-04-20 05:37:49.455 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:37:49.455 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:37:49.456 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:37:49.456 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:37:49.481 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:37:49.481 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:37:49.481 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:37:49.481 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:37:49.482 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:37:49.506 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:37:49.506 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:37:49.506 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:37:49.507 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:37:49.507 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:37:49.507 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:37:49.508 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:37:49.508 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:37:49.508 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:37:49.508 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:37:49.508 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:37:49.508 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:37:49.508 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:37:49.509 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:37:49.510 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:37:49.510 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:37:49.510 [info] <0.240.0> Importing users... 2026-04-20 05:37:49.510 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:37:49.517 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:37:49.519 [info] <0.240.0> Importing vhosts... 2026-04-20 05:37:49.519 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:37:49.546 [info] <0.514.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:37:49.550 [info] <0.514.0> Starting message stores for vhost '/' 2026-04-20 05:37:49.551 [info] <0.518.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:37:49.552 [info] <0.514.0> Started message store of type transient for vhost '/' 2026-04-20 05:37:49.552 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:37:49.552 [warning] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:37:49.553 [info] <0.514.0> Started message store of type persistent for vhost '/' 2026-04-20 05:37:49.554 [info] <0.240.0> Importing user permissions... 2026-04-20 05:37:49.554 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:37:49.559 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:37:49.559 [info] <0.240.0> Importing parameters... 2026-04-20 05:37:49.559 [info] <0.240.0> Importing global parameters... 2026-04-20 05:37:49.559 [info] <0.240.0> Importing policies... 2026-04-20 05:37:49.568 [info] <0.240.0> Importing queues... 2026-04-20 05:37:49.568 [info] <0.240.0> Importing exchanges... 2026-04-20 05:37:49.568 [info] <0.240.0> Importing bindings... 2026-04-20 05:37:49.568 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:37:49.568 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:37:49.568 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:37:49.569 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:37:49.569 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:37:49.572 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:37:49.576 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:37:49.576 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:37:49.576 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:37:49.576 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:37:49.576 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:37:49.579 [info] <0.567.0> started TCP listener on [::]:5673 2026-04-20 05:37:49.579 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:37:49.579 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:37:49.579 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:37:49.579 [info] <0.569.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:37:49.623 [info] <0.619.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:37:49.623 [info] <0.725.0> Statistics database started. 2026-04-20 05:37:49.623 [info] <0.724.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:37:49.623 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:37:49.709 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:37:50.801 [info] <0.736.0> accepting AMQP connection <0.736.0> (10.0.0.33:41204 -> 10.0.0.50:5673) 2026-04-20 05:37:50.802 [info] <0.739.0> accepting AMQP connection <0.739.0> (10.0.0.50:48180 -> 10.0.0.50:5673) 2026-04-20 05:37:50.803 [info] <0.743.0> accepting AMQP connection <0.743.0> (10.0.0.38:33224 -> 10.0.0.50:5673) 2026-04-20 05:37:50.803 [info] <0.746.0> accepting AMQP connection <0.746.0> (10.0.0.33:41216 -> 10.0.0.50:5673) 2026-04-20 05:37:50.803 [info] <0.749.0> accepting AMQP connection <0.749.0> (10.0.0.38:33234 -> 10.0.0.50:5673) 2026-04-20 05:37:50.803 [info] <0.752.0> accepting AMQP connection <0.752.0> (10.0.0.38:33238 -> 10.0.0.50:5673) 2026-04-20 05:37:50.804 [info] <0.739.0> connection <0.739.0> (10.0.0.50:48180 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.805 [info] <0.743.0> connection <0.743.0> (10.0.0.38:33224 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.806 [info] <0.752.0> connection <0.752.0> (10.0.0.38:33238 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.806 [info] <0.749.0> connection <0.749.0> (10.0.0.38:33234 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.806 [info] <0.771.0> accepting AMQP connection <0.771.0> (10.0.0.50:48190 -> 10.0.0.50:5673) 2026-04-20 05:37:50.807 [info] <0.746.0> connection <0.746.0> (10.0.0.33:41216 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.808 [info] <0.792.0> accepting AMQP connection <0.792.0> (10.0.0.50:48194 -> 10.0.0.50:5673) 2026-04-20 05:37:50.808 [info] <0.736.0> connection <0.736.0> (10.0.0.33:41204 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.808 [info] <0.797.0> accepting AMQP connection <0.797.0> (10.0.0.33:41232 -> 10.0.0.50:5673) 2026-04-20 05:37:50.810 [info] <0.771.0> connection <0.771.0> (10.0.0.50:48190 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.812 [info] <0.792.0> connection <0.792.0> (10.0.0.50:48194 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:50.812 [info] <0.797.0> connection <0.797.0> (10.0.0.33:41232 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.049 [info] <0.900.0> accepting AMQP connection <0.900.0> (10.0.0.50:48204 -> 10.0.0.50:5673) 2026-04-20 05:37:52.052 [info] <0.900.0> connection <0.900.0> (10.0.0.50:48204 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.069 [info] <0.918.0> accepting AMQP connection <0.918.0> (10.0.0.50:48212 -> 10.0.0.50:5673) 2026-04-20 05:37:52.070 [info] <0.918.0> connection <0.918.0> (10.0.0.50:48212 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.072 [info] <0.927.0> accepting AMQP connection <0.927.0> (10.0.0.38:33242 -> 10.0.0.50:5673) 2026-04-20 05:37:52.075 [info] <0.927.0> connection <0.927.0> (10.0.0.38:33242 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.078 [info] <0.945.0> accepting AMQP connection <0.945.0> (10.0.0.33:41248 -> 10.0.0.50:5673) 2026-04-20 05:37:52.081 [info] <0.956.0> accepting AMQP connection <0.956.0> (10.0.0.33:41252 -> 10.0.0.50:5673) 2026-04-20 05:37:52.088 [info] <0.962.0> accepting AMQP connection <0.962.0> (10.0.0.38:33256 -> 10.0.0.50:5673) 2026-04-20 05:37:52.090 [info] <0.959.0> accepting AMQP connection <0.959.0> (10.0.0.38:33250 -> 10.0.0.50:5673) 2026-04-20 05:37:52.092 [info] <0.956.0> connection <0.956.0> (10.0.0.33:41252 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.092 [info] <0.962.0> connection <0.962.0> (10.0.0.38:33256 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.093 [info] <0.945.0> connection <0.945.0> (10.0.0.33:41248 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.095 [info] <0.959.0> connection <0.959.0> (10.0.0.38:33250 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.100 [info] <0.1007.0> accepting AMQP connection <0.1007.0> (10.0.0.50:48220 -> 10.0.0.50:5673) 2026-04-20 05:37:52.102 [info] <0.1007.0> connection <0.1007.0> (10.0.0.50:48220 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:52.109 [info] <0.1031.0> accepting AMQP connection <0.1031.0> (10.0.0.33:41256 -> 10.0.0.50:5673) 2026-04-20 05:37:52.126 [info] <0.1031.0> connection <0.1031.0> (10.0.0.33:41256 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:37:56.809 [info] <0.1074.0> RabbitMQ is asked to stop... 2026-04-20 05:37:56.891 [info] <0.1074.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:37:56.891 [info] <0.1074.0> Stopping application 'rabbitmq_management' 2026-04-20 05:37:56.893 [warning] <0.615.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:37:56.898 [info] <0.1074.0> Stopping application 'amqp_client' 2026-04-20 05:37:56.898 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:37:56.899 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:37:56.899 [info] <0.1074.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:37:56.901 [info] <0.1074.0> Stopping application 'cowboy' 2026-04-20 05:37:56.901 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:37:56.902 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:37:56.902 [info] <0.1074.0> Stopping application 'cowlib' 2026-04-20 05:37:56.903 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:37:56.903 [info] <0.1074.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:37:56.904 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:37:56.904 [info] <0.1074.0> Stopping application 'rabbit' 2026-04-20 05:37:56.905 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:37:56.905 [info] <0.567.0> stopped TCP listener on [::]:5673 2026-04-20 05:37:56.906 [error] <0.918.0> Error on AMQP connection <0.918.0> (10.0.0.50:48212 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.736.0> Error on AMQP connection <0.736.0> (10.0.0.33:41204 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.792.0> Error on AMQP connection <0.792.0> (10.0.0.50:48194 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.945.0> Error on AMQP connection <0.945.0> (10.0.0.33:41248 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.927.0> Error on AMQP connection <0.927.0> (10.0.0.38:33242 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.962.0> Error on AMQP connection <0.962.0> (10.0.0.38:33256 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.1031.0> Error on AMQP connection <0.1031.0> (10.0.0.33:41256 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.1007.0> Error on AMQP connection <0.1007.0> (10.0.0.50:48220 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.739.0> Error on AMQP connection <0.739.0> (10.0.0.50:48180 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.749.0> Error on AMQP connection <0.749.0> (10.0.0.38:33234 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.743.0> Error on AMQP connection <0.743.0> (10.0.0.38:33224 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.746.0> Error on AMQP connection <0.746.0> (10.0.0.33:41216 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.797.0> Error on AMQP connection <0.797.0> (10.0.0.33:41232 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.900.0> Error on AMQP connection <0.900.0> (10.0.0.50:48204 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.959.0> Error on AMQP connection <0.959.0> (10.0.0.38:33250 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.752.0> Error on AMQP connection <0.752.0> (10.0.0.38:33238 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.906 [error] <0.956.0> Error on AMQP connection <0.956.0> (10.0.0.33:41252 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.907 [error] <0.771.0> Error on AMQP connection <0.771.0> (10.0.0.50:48190 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:37:56.916 [info] <0.491.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:37:56.917 [warning] <0.808.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.917 [warning] <0.1032.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.917 [warning] <0.805.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.917 [warning] <0.877.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.917 [warning] <0.818.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.917 [warning] <0.1010.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.917 [warning] <0.814.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.917 [warning] <0.930.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.918 [warning] <0.862.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.918 [warning] <0.990.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.918 [warning] <0.873.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.918 [warning] <0.1025.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:56.918 [warning] <0.909.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:37:57.003 [warning] lager_file_backend dropped 11 messages in the last second that exceeded the limit of 50 messages/sec 2026-04-20 05:37:57.003 [info] <0.1074.0> Stopping application 'rabbit_common' 2026-04-20 05:37:57.003 [info] <0.1074.0> Stopping application 'sysmon_handler' 2026-04-20 05:37:57.003 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:37:57.003 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:37:57.004 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:37:57.004 [info] <0.1074.0> Stopping application 'os_mon' 2026-04-20 05:37:57.006 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:37:57.006 [info] <0.1074.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:38:25.070 [info] <0.1171.0> Resetting Rabbit forcefully 2026-04-20 05:38:26.156 [info] <0.1185.0> RabbitMQ is asked to stop... 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'rabbitmq_management' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'amqp_client' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'rabbit' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'mnesia' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'rabbit_common' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'sysmon_handler' 2026-04-20 05:38:26.249 [info] <0.1185.0> Stopping application 'os_mon' 2026-04-20 05:38:26.249 [info] <0.1185.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:38:26.250 [info] <0.1185.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:38:32.881 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:38:34.429 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:38:34.429 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:38:34.453 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:38:34.453 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:38:34.465 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:38:34.465 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:38:34.466 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:38:34.473 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:38:34.481 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:38:34.481 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:38:34.486 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:38:34.488 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:38:34.488 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:38:34.488 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:38:34.488 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:38:34.489 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:38:34.489 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:38:34.489 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:38:34.489 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:38:34.489 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:38:34.489 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:38:34.489 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:38:34.489 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:38:34.489 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:38:34.489 [info] <0.240.0> Will wait for 26755 milliseconds before proceeding with registration... 2026-04-20 05:39:01.245 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:39:01.245 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:39:01.247 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:01.251 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:01.251 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:39:01.752 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:01.753 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:01.754 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:39:02.256 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:02.257 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:02.257 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:39:02.759 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:02.760 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:02.760 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:39:03.262 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:03.263 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:03.263 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:39:03.765 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:03.766 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:03.766 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:39:04.268 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:04.269 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:04.269 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:39:04.771 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:04.772 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:04.772 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:39:05.274 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:05.274 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:05.274 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:39:05.779 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:39:05.780 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:39:05.781 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:39:06.281 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:39:06.283 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:39:06.410 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:39:06.410 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:39:06.440 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:39:06.441 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:39:06.475 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:39:06.476 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:39:06.476 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:39:06.476 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:39:06.477 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:39:06.478 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:39:06.478 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:39:06.478 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:39:06.478 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:39:06.478 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:39:06.479 [info] <0.468.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:39:06.479 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:39:06.482 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:39:06.483 [info] <0.472.0> Starting rabbit_node_monitor 2026-04-20 05:39:06.483 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:39:06.483 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:39:06.484 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:39:06.484 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:39:06.506 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:39:06.506 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:39:06.506 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:39:06.506 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:39:06.506 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:39:06.530 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:39:06.530 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:39:06.530 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:39:06.530 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:39:06.531 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:39:06.531 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:39:06.531 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:39:06.531 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:39:06.531 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:39:06.532 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:39:06.532 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:39:06.532 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:39:06.532 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:39:06.533 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:39:06.533 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:39:06.533 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:39:06.533 [info] <0.240.0> Importing users... 2026-04-20 05:39:06.533 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:39:06.540 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:39:06.543 [info] <0.240.0> Importing vhosts... 2026-04-20 05:39:06.543 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:39:06.571 [info] <0.520.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:39:06.575 [info] <0.520.0> Starting message stores for vhost '/' 2026-04-20 05:39:06.575 [info] <0.524.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:39:06.576 [info] <0.520.0> Started message store of type transient for vhost '/' 2026-04-20 05:39:06.576 [info] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:39:06.577 [warning] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:39:06.577 [info] <0.520.0> Started message store of type persistent for vhost '/' 2026-04-20 05:39:06.579 [info] <0.240.0> Importing user permissions... 2026-04-20 05:39:06.579 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:39:06.582 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:39:06.582 [info] <0.240.0> Importing parameters... 2026-04-20 05:39:06.582 [info] <0.240.0> Importing global parameters... 2026-04-20 05:39:06.582 [info] <0.240.0> Importing policies... 2026-04-20 05:39:06.589 [info] <0.240.0> Importing queues... 2026-04-20 05:39:06.589 [info] <0.240.0> Importing exchanges... 2026-04-20 05:39:06.589 [info] <0.240.0> Importing bindings... 2026-04-20 05:39:06.589 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:39:06.589 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:39:06.589 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:39:06.589 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:39:06.589 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:39:06.594 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:39:06.598 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:39:06.598 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:39:06.599 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:39:06.599 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:39:06.599 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:39:06.600 [info] <0.573.0> started TCP listener on [::]:5673 2026-04-20 05:39:06.600 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:39:06.600 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:39:06.601 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:39:06.601 [info] <0.575.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:39:06.632 [info] <0.625.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:39:06.632 [info] <0.731.0> Statistics database started. 2026-04-20 05:39:06.632 [info] <0.730.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:39:06.632 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:39:06.797 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:39:06.924 [info] <0.741.0> accepting AMQP connection <0.741.0> (10.0.0.33:39266 -> 10.0.0.50:5673) 2026-04-20 05:39:06.926 [info] <0.745.0> accepting AMQP connection <0.745.0> (10.0.0.50:42252 -> 10.0.0.50:5673) 2026-04-20 05:39:06.927 [info] <0.748.0> accepting AMQP connection <0.748.0> (10.0.0.33:39276 -> 10.0.0.50:5673) 2026-04-20 05:39:06.928 [info] <0.751.0> accepting AMQP connection <0.751.0> (10.0.0.33:39278 -> 10.0.0.50:5673) 2026-04-20 05:39:06.929 [info] <0.755.0> accepting AMQP connection <0.755.0> (10.0.0.50:42262 -> 10.0.0.50:5673) 2026-04-20 05:39:06.929 [info] <0.748.0> connection <0.748.0> (10.0.0.33:39276 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.929 [info] <0.751.0> connection <0.751.0> (10.0.0.33:39278 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.930 [info] <0.745.0> connection <0.745.0> (10.0.0.50:42252 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.930 [info] <0.770.0> accepting AMQP connection <0.770.0> (10.0.0.50:42268 -> 10.0.0.50:5673) 2026-04-20 05:39:06.931 [info] <0.755.0> connection <0.755.0> (10.0.0.50:42262 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.932 [info] <0.770.0> connection <0.770.0> (10.0.0.50:42268 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.932 [info] <0.741.0> connection <0.741.0> (10.0.0.33:39266 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.933 [info] <0.813.0> accepting AMQP connection <0.813.0> (10.0.0.38:43876 -> 10.0.0.50:5673) 2026-04-20 05:39:06.934 [info] <0.816.0> accepting AMQP connection <0.816.0> (10.0.0.38:43892 -> 10.0.0.50:5673) 2026-04-20 05:39:06.935 [info] <0.813.0> connection <0.813.0> (10.0.0.38:43876 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.937 [info] <0.816.0> connection <0.816.0> (10.0.0.38:43892 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:06.947 [info] <0.888.0> accepting AMQP connection <0.888.0> (10.0.0.38:43902 -> 10.0.0.50:5673) 2026-04-20 05:39:06.949 [info] <0.888.0> connection <0.888.0> (10.0.0.38:43902 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:08.994 [info] <0.907.0> accepting AMQP connection <0.907.0> (10.0.0.50:53720 -> 10.0.0.50:5673) 2026-04-20 05:39:08.996 [info] <0.910.0> accepting AMQP connection <0.910.0> (10.0.0.50:53726 -> 10.0.0.50:5673) 2026-04-20 05:39:08.996 [info] <0.907.0> connection <0.907.0> (10.0.0.50:53720 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:08.997 [info] <0.919.0> accepting AMQP connection <0.919.0> (10.0.0.33:44056 -> 10.0.0.50:5673) 2026-04-20 05:39:08.999 [info] <0.910.0> connection <0.910.0> (10.0.0.50:53726 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:09.001 [info] <0.933.0> accepting AMQP connection <0.933.0> (10.0.0.33:44066 -> 10.0.0.50:5673) 2026-04-20 05:39:09.001 [info] <0.919.0> connection <0.919.0> (10.0.0.33:44056 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:09.002 [info] <0.936.0> accepting AMQP connection <0.936.0> (10.0.0.50:53742 -> 10.0.0.50:5673) 2026-04-20 05:39:09.004 [info] <0.933.0> connection <0.933.0> (10.0.0.33:44066 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:09.009 [info] <0.975.0> accepting AMQP connection <0.975.0> (10.0.0.38:43918 -> 10.0.0.50:5673) 2026-04-20 05:39:09.010 [info] <0.978.0> accepting AMQP connection <0.978.0> (10.0.0.38:43920 -> 10.0.0.50:5673) 2026-04-20 05:39:09.010 [info] <0.936.0> connection <0.936.0> (10.0.0.50:53742 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:09.013 [info] <0.978.0> connection <0.978.0> (10.0.0.38:43920 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:09.013 [info] <0.975.0> connection <0.975.0> (10.0.0.38:43918 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:09.014 [info] <0.998.0> accepting AMQP connection <0.998.0> (10.0.0.33:44082 -> 10.0.0.50:5673) 2026-04-20 05:39:09.018 [info] <0.998.0> connection <0.998.0> (10.0.0.33:44082 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:09.056 [info] <0.1051.0> accepting AMQP connection <0.1051.0> (10.0.0.38:43930 -> 10.0.0.50:5673) 2026-04-20 05:39:09.059 [info] <0.1051.0> connection <0.1051.0> (10.0.0.38:43930 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:39:12.567 [info] <0.1081.0> RabbitMQ is asked to stop... 2026-04-20 05:39:12.638 [info] <0.1081.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:39:12.638 [info] <0.1081.0> Stopping application 'rabbitmq_management' 2026-04-20 05:39:12.640 [warning] <0.621.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:39:12.641 [info] <0.1081.0> Stopping application 'amqp_client' 2026-04-20 05:39:12.641 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:39:12.644 [info] <0.1081.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:39:12.644 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:39:12.645 [info] <0.1081.0> Stopping application 'cowboy' 2026-04-20 05:39:12.645 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:39:12.646 [info] <0.1081.0> Stopping application 'cowlib' 2026-04-20 05:39:12.646 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:39:12.646 [info] <0.1081.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:39:12.646 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:39:12.648 [info] <0.1081.0> Stopping application 'rabbit' 2026-04-20 05:39:12.648 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:39:12.648 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:39:12.648 [info] <0.573.0> stopped TCP listener on [::]:5673 2026-04-20 05:39:12.649 [error] <0.919.0> Error on AMQP connection <0.919.0> (10.0.0.33:44056 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.755.0> Error on AMQP connection <0.755.0> (10.0.0.50:42262 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.816.0> Error on AMQP connection <0.816.0> (10.0.0.38:43892 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.936.0> Error on AMQP connection <0.936.0> (10.0.0.50:53742 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.907.0> Error on AMQP connection <0.907.0> (10.0.0.50:53720 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.933.0> Error on AMQP connection <0.933.0> (10.0.0.33:44066 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.741.0> Error on AMQP connection <0.741.0> (10.0.0.33:39266 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.910.0> Error on AMQP connection <0.910.0> (10.0.0.50:53726 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.751.0> Error on AMQP connection <0.751.0> (10.0.0.33:39278 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.998.0> Error on AMQP connection <0.998.0> (10.0.0.33:44082 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.813.0> Error on AMQP connection <0.813.0> (10.0.0.38:43876 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.770.0> Error on AMQP connection <0.770.0> (10.0.0.50:42268 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.978.0> Error on AMQP connection <0.978.0> (10.0.0.38:43920 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.748.0> Error on AMQP connection <0.748.0> (10.0.0.33:39276 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.649 [error] <0.745.0> Error on AMQP connection <0.745.0> (10.0.0.50:42252 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.650 [error] <0.1051.0> Error on AMQP connection <0.1051.0> (10.0.0.38:43930 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.650 [error] <0.975.0> Error on AMQP connection <0.975.0> (10.0.0.38:43918 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.650 [error] <0.888.0> Error on AMQP connection <0.888.0> (10.0.0.38:43902 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:39:12.653 [error] <0.990.0> Supervisor {<0.990.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:39:12.654 [error] <0.839.0> Supervisor {<0.839.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:39:12.656 [error] <0.786.0> Supervisor {<0.786.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:39:12.660 [info] <0.497.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:39:12.662 [warning] <0.801.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.662 [warning] <0.805.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.662 [warning] <0.922.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.662 [warning] <0.958.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.662 [warning] <0.860.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.663 [warning] <0.1009.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.663 [warning] <0.897.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.663 [warning] <0.823.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.663 [warning] <0.810.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:12.663 [warning] <0.1060.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5649-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:39:13.159 [warning] lager_file_backend dropped 22 messages in the last second that exceeded the limit of 50 messages/sec 2026-04-20 05:39:31.839 [info] <0.1168.0> Resetting Rabbit forcefully 2026-04-20 05:39:32.949 [info] <0.1182.0> RabbitMQ is asked to stop... 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'rabbitmq_management' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'amqp_client' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'rabbit' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'mnesia' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'rabbit_common' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'sysmon_handler' 2026-04-20 05:39:33.009 [info] <0.1182.0> Stopping application 'os_mon' 2026-04-20 05:39:33.009 [info] <0.1182.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:39:33.009 [info] <0.1182.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:39:39.578 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:39:41.366 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:39:41.366 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:39:41.390 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:39:41.390 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:39:41.404 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:39:41.404 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:39:41.404 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:39:41.411 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:39:41.417 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:39:41.417 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:39:41.423 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:39:41.423 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:39:41.423 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:39:41.423 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:39:41.423 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:39:41.425 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:39:41.425 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:39:41.425 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:39:41.425 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:39:41.427 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:39:41.427 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:39:41.427 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:39:41.427 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:39:41.427 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:39:41.427 [info] <0.240.0> Will wait for 53911 milliseconds before proceeding with registration... 2026-04-20 05:40:26.565 [info] <0.294.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2026-04-20 05:40:35.338 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:40:35.338 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:40:35.339 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:35.340 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:35.340 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:40:35.844 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:35.844 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:35.845 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:40:36.346 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:36.347 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:36.347 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:40:36.850 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:36.851 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:36.851 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:40:37.354 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:37.354 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:37.354 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:40:37.856 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:37.857 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:37.857 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:40:38.359 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:38.360 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:38.360 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:40:38.862 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:38.863 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:38.863 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:40:39.366 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:39.368 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:39.368 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:40:39.870 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:40:39.872 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:40:39.872 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:40:40.373 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:40:40.375 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:40:40.536 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:40:40.536 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:40:40.566 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:40:40.566 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:40:40.596 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:40:40.596 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:40:40.596 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:40:40.596 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:40:40.596 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:40:40.597 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:40:40.597 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:40:40.597 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:40:40.597 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:40:40.597 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:40:40.597 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:40:40.598 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:40:40.598 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:40:40.599 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:40:40.599 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:40:40.599 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:40:40.599 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:40:40.600 [info] <0.491.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:40:40.600 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:40:40.604 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:40:40.604 [info] <0.495.0> Starting rabbit_node_monitor 2026-04-20 05:40:40.604 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:40:40.605 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:40:40.605 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:40:40.605 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:40:40.631 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:40:40.631 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:40:40.631 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:40:40.631 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:40:40.632 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:40:40.661 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:40:40.662 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:40:40.662 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:40:40.662 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:40:40.662 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:40:40.663 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:40:40.663 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:40:40.663 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:40:40.663 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:40:40.663 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:40:40.663 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:40:40.663 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:40:40.663 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:40:40.664 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:40:40.664 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:40:40.664 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:40:40.664 [info] <0.240.0> Importing users... 2026-04-20 05:40:40.665 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:40:40.670 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:40:40.673 [info] <0.240.0> Importing vhosts... 2026-04-20 05:40:40.673 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:40:40.702 [info] <0.543.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:40:40.706 [info] <0.543.0> Starting message stores for vhost '/' 2026-04-20 05:40:40.707 [info] <0.547.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:40:40.707 [info] <0.543.0> Started message store of type transient for vhost '/' 2026-04-20 05:40:40.707 [info] <0.550.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:40:40.708 [warning] <0.550.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:40:40.708 [info] <0.543.0> Started message store of type persistent for vhost '/' 2026-04-20 05:40:40.709 [info] <0.240.0> Importing user permissions... 2026-04-20 05:40:40.710 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:40:40.714 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:40:40.714 [info] <0.240.0> Importing parameters... 2026-04-20 05:40:40.714 [info] <0.240.0> Importing global parameters... 2026-04-20 05:40:40.714 [info] <0.240.0> Importing policies... 2026-04-20 05:40:40.720 [info] <0.240.0> Importing queues... 2026-04-20 05:40:40.720 [info] <0.240.0> Importing exchanges... 2026-04-20 05:40:40.721 [info] <0.240.0> Importing bindings... 2026-04-20 05:40:40.721 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:40:40.721 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:40:40.721 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:40:40.721 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:40:40.722 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:40:40.728 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:40:40.736 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:40:40.736 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:40:40.736 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:40:40.736 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:40:40.736 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:40:40.738 [info] <0.596.0> started TCP listener on [::]:5673 2026-04-20 05:40:40.738 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:40:40.738 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:40:40.738 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:40:40.738 [info] <0.598.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:40:40.766 [info] <0.648.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:40:40.766 [info] <0.754.0> Statistics database started. 2026-04-20 05:40:40.766 [info] <0.753.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:40:40.767 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:40:40.920 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:40:41.009 [info] <0.294.0> RabbitMQ is asked to stop... 2026-04-20 05:40:41.053 [info] <0.294.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:40:41.053 [info] <0.294.0> Stopping application 'rabbitmq_management' 2026-04-20 05:40:41.054 [warning] <0.604.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:40:41.055 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:40:41.055 [info] <0.294.0> Stopping application 'amqp_client' 2026-04-20 05:40:41.057 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:40:41.057 [info] <0.294.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:40:41.058 [info] <0.294.0> Stopping application 'cowboy' 2026-04-20 05:40:41.058 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:40:41.059 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:40:41.059 [info] <0.294.0> Stopping application 'cowlib' 2026-04-20 05:40:41.059 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:40:41.059 [info] <0.294.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:40:41.061 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:40:41.061 [info] <0.294.0> Stopping application 'rabbit' 2026-04-20 05:40:41.061 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:40:41.061 [info] <0.596.0> stopped TCP listener on [::]:5673 2026-04-20 05:40:41.062 [info] <0.550.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:40:41.062 [info] <0.520.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:40:41.067 [info] <0.550.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:40:41.067 [info] <0.547.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:40:41.076 [info] <0.547.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:40:41.080 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:40:41.080 [info] <0.294.0> Stopping application 'mnesia' 2026-04-20 05:40:41.089 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:40:41.089 [info] <0.294.0> Stopping application 'rabbit_common' 2026-04-20 05:40:41.089 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:40:41.089 [info] <0.294.0> Stopping application 'sysmon_handler' 2026-04-20 05:40:41.091 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:40:41.091 [info] <0.294.0> Stopping application 'os_mon' 2026-04-20 05:40:41.092 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:40:41.092 [info] <0.294.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:41:43.741 [info] <0.777.0> Resetting Rabbit forcefully 2026-04-20 05:41:44.751 [info] <0.791.0> RabbitMQ is asked to stop... 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'rabbitmq_management' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'amqp_client' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'rabbit' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'mnesia' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'rabbit_common' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'sysmon_handler' 2026-04-20 05:41:44.890 [info] <0.791.0> Stopping application 'os_mon' 2026-04-20 05:41:44.890 [info] <0.791.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:41:44.890 [info] <0.791.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:41:51.430 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:41:53.278 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:41:53.279 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:41:53.302 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:41:53.303 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:41:53.315 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:41:53.315 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:41:53.316 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:41:53.321 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:41:53.326 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:41:53.326 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:41:53.332 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:41:53.332 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:41:53.332 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:41:53.332 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:41:53.332 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:41:53.333 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:41:53.333 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:41:53.333 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:41:53.333 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:41:53.333 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:41:53.333 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:41:53.333 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:41:53.333 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:41:53.333 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:41:53.334 [info] <0.240.0> Will wait for 29650 milliseconds before proceeding with registration... 2026-04-20 05:42:22.984 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:42:22.984 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:42:22.985 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:22.994 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:22.994 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:42:23.496 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:23.497 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:23.497 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:42:23.999 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:24.000 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:24.000 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:42:24.502 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:24.503 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:24.503 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:42:25.005 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:25.007 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:25.007 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:42:25.509 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:25.512 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:25.512 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:42:26.014 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:26.015 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:26.015 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:42:26.517 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:26.518 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:26.518 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:42:27.020 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:27.024 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:27.024 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:42:27.526 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:42:27.527 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:42:27.527 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:42:28.028 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:42:28.030 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:42:28.182 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:42:28.182 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:42:28.208 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:42:28.208 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:42:28.245 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:42:28.245 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:42:28.245 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:42:28.245 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:42:28.246 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:42:28.247 [info] <0.468.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:42:28.247 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:42:28.252 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:42:28.253 [info] <0.472.0> Starting rabbit_node_monitor 2026-04-20 05:42:28.253 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:42:28.253 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:42:28.253 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:42:28.253 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:42:28.284 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:42:28.285 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:42:28.285 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:42:28.285 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:42:28.285 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:42:28.315 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:42:28.315 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:42:28.315 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:42:28.315 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:42:28.315 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:42:28.316 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:42:28.316 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:42:28.316 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:42:28.316 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:42:28.316 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:42:28.316 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:42:28.316 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:42:28.316 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:42:28.318 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:42:28.319 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:42:28.319 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:42:28.319 [info] <0.240.0> Importing users... 2026-04-20 05:42:28.319 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:42:28.326 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:42:28.329 [info] <0.240.0> Importing vhosts... 2026-04-20 05:42:28.329 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:42:28.352 [info] <0.520.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:42:28.357 [info] <0.520.0> Starting message stores for vhost '/' 2026-04-20 05:42:28.357 [info] <0.524.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:42:28.358 [info] <0.520.0> Started message store of type transient for vhost '/' 2026-04-20 05:42:28.358 [info] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:42:28.358 [warning] <0.527.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:42:28.359 [info] <0.520.0> Started message store of type persistent for vhost '/' 2026-04-20 05:42:28.360 [info] <0.240.0> Importing user permissions... 2026-04-20 05:42:28.360 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:42:28.363 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:42:28.363 [info] <0.240.0> Importing parameters... 2026-04-20 05:42:28.363 [info] <0.240.0> Importing global parameters... 2026-04-20 05:42:28.363 [info] <0.240.0> Importing policies... 2026-04-20 05:42:28.369 [info] <0.240.0> Importing queues... 2026-04-20 05:42:28.369 [info] <0.240.0> Importing exchanges... 2026-04-20 05:42:28.369 [info] <0.240.0> Importing bindings... 2026-04-20 05:42:28.369 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:42:28.369 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:42:28.369 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:42:28.370 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:42:28.370 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:42:28.374 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:42:28.378 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:42:28.378 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:42:28.378 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:42:28.378 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:42:28.378 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:42:28.380 [info] <0.573.0> started TCP listener on [::]:5673 2026-04-20 05:42:28.380 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:42:28.380 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:42:28.380 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:42:28.380 [info] <0.575.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:42:28.435 [info] <0.625.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:42:28.436 [info] <0.731.0> Statistics database started. 2026-04-20 05:42:28.436 [info] <0.730.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:42:28.436 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:42:28.624 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:42:33.145 [info] <0.742.0> accepting AMQP connection <0.742.0> (10.0.0.50:59246 -> 10.0.0.50:5673) 2026-04-20 05:42:33.146 [info] <0.745.0> accepting AMQP connection <0.745.0> (10.0.0.38:55392 -> 10.0.0.50:5673) 2026-04-20 05:42:33.146 [info] <0.748.0> accepting AMQP connection <0.748.0> (10.0.0.38:55402 -> 10.0.0.50:5673) 2026-04-20 05:42:33.148 [info] <0.754.0> accepting AMQP connection <0.754.0> (10.0.0.50:59256 -> 10.0.0.50:5673) 2026-04-20 05:42:33.149 [info] <0.757.0> accepting AMQP connection <0.757.0> (10.0.0.50:59270 -> 10.0.0.50:5673) 2026-04-20 05:42:33.150 [info] <0.760.0> accepting AMQP connection <0.760.0> (10.0.0.33:60450 -> 10.0.0.50:5673) 2026-04-20 05:42:33.150 [info] <0.767.0> accepting AMQP connection <0.767.0> (10.0.0.33:60454 -> 10.0.0.50:5673) 2026-04-20 05:42:33.150 [info] <0.742.0> connection <0.742.0> (10.0.0.50:59246 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.151 [info] <0.763.0> accepting AMQP connection <0.763.0> (10.0.0.38:55418 -> 10.0.0.50:5673) 2026-04-20 05:42:33.151 [info] <0.745.0> connection <0.745.0> (10.0.0.38:55392 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.152 [info] <0.757.0> connection <0.757.0> (10.0.0.50:59270 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.152 [info] <0.760.0> connection <0.760.0> (10.0.0.33:60450 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.153 [info] <0.754.0> connection <0.754.0> (10.0.0.50:59256 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.154 [info] <0.763.0> connection <0.763.0> (10.0.0.38:55418 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.154 [info] <0.796.0> accepting AMQP connection <0.796.0> (10.0.0.33:60464 -> 10.0.0.50:5673) 2026-04-20 05:42:33.163 [info] <0.767.0> connection <0.767.0> (10.0.0.33:60454 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.164 [info] <0.748.0> connection <0.748.0> (10.0.0.38:55402 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.179 [info] <0.796.0> connection <0.796.0> (10.0.0.33:60464 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.908 [info] <0.908.0> accepting AMQP connection <0.908.0> (10.0.0.33:60468 -> 10.0.0.50:5673) 2026-04-20 05:42:33.910 [info] <0.908.0> connection <0.908.0> (10.0.0.33:60468 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.928 [info] <0.926.0> accepting AMQP connection <0.926.0> (10.0.0.33:60480 -> 10.0.0.50:5673) 2026-04-20 05:42:33.931 [info] <0.926.0> connection <0.926.0> (10.0.0.33:60480 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.942 [info] <0.908.0> closing AMQP connection <0.908.0> (10.0.0.33:60468 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:33.943 [info] <0.926.0> closing AMQP connection <0.926.0> (10.0.0.33:60480 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:33.959 [info] <0.941.0> accepting AMQP connection <0.941.0> (10.0.0.50:59280 -> 10.0.0.50:5673) 2026-04-20 05:42:33.963 [info] <0.941.0> connection <0.941.0> (10.0.0.50:59280 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.977 [info] <0.959.0> accepting AMQP connection <0.959.0> (10.0.0.50:59292 -> 10.0.0.50:5673) 2026-04-20 05:42:33.979 [info] <0.959.0> connection <0.959.0> (10.0.0.50:59292 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:33.987 [info] <0.941.0> closing AMQP connection <0.941.0> (10.0.0.50:59280 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:33.990 [info] <0.959.0> closing AMQP connection <0.959.0> (10.0.0.50:59292 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:34.526 [info] <0.974.0> accepting AMQP connection <0.974.0> (10.0.0.33:60492 -> 10.0.0.50:5673) 2026-04-20 05:42:34.528 [info] <0.974.0> connection <0.974.0> (10.0.0.33:60492 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:34.548 [info] <0.992.0> accepting AMQP connection <0.992.0> (10.0.0.33:60508 -> 10.0.0.50:5673) 2026-04-20 05:42:34.551 [info] <0.992.0> connection <0.992.0> (10.0.0.33:60508 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:34.561 [info] <0.974.0> closing AMQP connection <0.974.0> (10.0.0.33:60492 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:34.562 [info] <0.992.0> closing AMQP connection <0.992.0> (10.0.0.33:60508 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:34.608 [info] <0.1007.0> accepting AMQP connection <0.1007.0> (10.0.0.38:55430 -> 10.0.0.50:5673) 2026-04-20 05:42:34.610 [info] <0.1007.0> connection <0.1007.0> (10.0.0.38:55430 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:34.653 [info] <0.1025.0> accepting AMQP connection <0.1025.0> (10.0.0.38:55436 -> 10.0.0.50:5673) 2026-04-20 05:42:34.655 [info] <0.1025.0> connection <0.1025.0> (10.0.0.38:55436 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:34.672 [info] <0.1007.0> closing AMQP connection <0.1007.0> (10.0.0.38:55430 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:34.673 [info] <0.1025.0> closing AMQP connection <0.1025.0> (10.0.0.38:55436 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:42:36.498 [info] <0.1040.0> accepting AMQP connection <0.1040.0> (10.0.0.33:60512 -> 10.0.0.50:5673) 2026-04-20 05:42:36.498 [info] <0.1043.0> accepting AMQP connection <0.1043.0> (10.0.0.33:60518 -> 10.0.0.50:5673) 2026-04-20 05:42:36.502 [info] <0.1043.0> connection <0.1043.0> (10.0.0.33:60518 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:36.502 [info] <0.1040.0> connection <0.1040.0> (10.0.0.33:60512 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:36.518 [info] <0.1081.0> accepting AMQP connection <0.1081.0> (10.0.0.50:59308 -> 10.0.0.50:5673) 2026-04-20 05:42:36.518 [info] <0.1084.0> accepting AMQP connection <0.1084.0> (10.0.0.50:59322 -> 10.0.0.50:5673) 2026-04-20 05:42:36.520 [info] <0.1081.0> connection <0.1081.0> (10.0.0.50:59308 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:36.521 [info] <0.1084.0> connection <0.1084.0> (10.0.0.50:59322 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:36.857 [info] <0.1135.0> accepting AMQP connection <0.1135.0> (10.0.0.38:58718 -> 10.0.0.50:5673) 2026-04-20 05:42:36.857 [info] <0.1132.0> accepting AMQP connection <0.1132.0> (10.0.0.38:58706 -> 10.0.0.50:5673) 2026-04-20 05:42:36.859 [info] <0.1132.0> connection <0.1132.0> (10.0.0.38:58706 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:36.860 [info] <0.1135.0> connection <0.1135.0> (10.0.0.38:58718 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:36.944 [info] <0.1172.0> accepting AMQP connection <0.1172.0> (10.0.0.50:59338 -> 10.0.0.50:5673) 2026-04-20 05:42:36.946 [info] <0.1172.0> connection <0.1172.0> (10.0.0.50:59338 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:42:37.405 [info] <0.1239.0> RabbitMQ is asked to stop... 2026-04-20 05:42:37.480 [info] <0.1239.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:42:37.480 [info] <0.1239.0> Stopping application 'rabbitmq_management' 2026-04-20 05:42:37.482 [warning] <0.581.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:42:37.485 [info] <0.1239.0> Stopping application 'amqp_client' 2026-04-20 05:42:37.485 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:42:37.486 [info] <0.1239.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:42:37.486 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:42:37.488 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:42:37.488 [info] <0.1239.0> Stopping application 'cowboy' 2026-04-20 05:42:37.489 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:42:37.489 [info] <0.1239.0> Stopping application 'cowlib' 2026-04-20 05:42:37.489 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:42:37.489 [info] <0.1239.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:42:37.491 [info] <0.1239.0> Stopping application 'rabbit' 2026-04-20 05:42:37.491 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:42:37.491 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:42:37.491 [info] <0.573.0> stopped TCP listener on [::]:5673 2026-04-20 05:42:37.492 [error] <0.742.0> Error on AMQP connection <0.742.0> (10.0.0.50:59246 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.760.0> Error on AMQP connection <0.760.0> (10.0.0.33:60450 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.745.0> Error on AMQP connection <0.745.0> (10.0.0.38:55392 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.1132.0> Error on AMQP connection <0.1132.0> (10.0.0.38:58706 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.757.0> Error on AMQP connection <0.757.0> (10.0.0.50:59270 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.1084.0> Error on AMQP connection <0.1084.0> (10.0.0.50:59322 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.1172.0> Error on AMQP connection <0.1172.0> (10.0.0.50:59338 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.767.0> Error on AMQP connection <0.767.0> (10.0.0.33:60454 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.796.0> Error on AMQP connection <0.796.0> (10.0.0.33:60464 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.754.0> Error on AMQP connection <0.754.0> (10.0.0.50:59256 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.748.0> Error on AMQP connection <0.748.0> (10.0.0.38:55402 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.1043.0> Error on AMQP connection <0.1043.0> (10.0.0.33:60518 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.763.0> Error on AMQP connection <0.763.0> (10.0.0.38:55418 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.1081.0> Error on AMQP connection <0.1081.0> (10.0.0.50:59308 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.1040.0> Error on AMQP connection <0.1040.0> (10.0.0.33:60512 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.492 [error] <0.1135.0> Error on AMQP connection <0.1135.0> (10.0.0.38:58718 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:42:37.506 [info] <0.497.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:42:37.506 [warning] <0.1201.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.506 [warning] <0.1154.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5649-1.-8082-0' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.506 [warning] <0.822.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.506 [warning] <0.825.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.506 [warning] <0.1103.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5649-2.-8082-0' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.506 [warning] <0.870.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.506 [warning] <0.1211.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5649-2..config_queue' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.854.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.1192.0> Mirrored queue 'job_request_consumer' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.1229.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.863.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.1220.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5649-2..tftp_queue' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.845.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.858.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:37.507 [warning] <0.839.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:42:38.149 [warning] lager_file_backend dropped 16 messages in the last second that exceeded the limit of 50 messages/sec 2026-04-20 05:42:53.098 [info] <0.1328.0> Resetting Rabbit forcefully 2026-04-20 05:42:54.258 [info] <0.1342.0> RabbitMQ is asked to stop... 2026-04-20 05:42:54.362 [info] <0.1342.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:42:54.362 [info] <0.1342.0> Stopping application 'rabbitmq_management' 2026-04-20 05:42:54.362 [info] <0.1342.0> Stopping application 'amqp_client' 2026-04-20 05:42:54.363 [info] <0.1342.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:42:54.363 [info] <0.1342.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:42:54.363 [info] <0.1342.0> Stopping application 'rabbit' 2026-04-20 05:42:54.363 [info] <0.1342.0> Stopping application 'mnesia' 2026-04-20 05:42:54.363 [info] <0.1342.0> Stopping application 'rabbit_common' 2026-04-20 05:42:54.363 [info] <0.1342.0> Stopping application 'sysmon_handler' 2026-04-20 05:42:54.363 [info] <0.1342.0> Stopping application 'os_mon' 2026-04-20 05:42:54.363 [info] <0.1342.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:42:54.363 [info] <0.1342.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:43:00.725 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:43:02.458 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:43:02.458 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:43:02.476 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:43:02.476 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:43:02.489 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:43:02.489 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:43:02.490 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:43:02.498 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:43:02.504 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:43:02.504 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:43:02.511 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:43:02.511 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:43:02.511 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:43:02.511 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:43:02.511 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:43:02.512 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:43:02.512 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:43:02.512 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:43:02.512 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:43:02.513 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:43:02.513 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:43:02.513 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:43:02.513 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:43:02.513 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:43:02.513 [info] <0.240.0> Will wait for 43084 milliseconds before proceeding with registration... 2026-04-20 05:43:45.598 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:43:45.598 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:43:45.599 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:43:45.603 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:45.603 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:43:46.108 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:43:46.109 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:46.109 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:43:46.611 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:43:46.612 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:46.612 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:43:47.114 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:43:47.115 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:47.115 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:43:47.617 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:43:47.618 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:47.618 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:43:48.120 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:43:48.121 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:48.121 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:43:48.623 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:43:48.624 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:48.624 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:43:49.182 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:43:49.183 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:49.183 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:43:49.238 [info] <0.316.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2026-04-20 05:43:49.685 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:43:49.685 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:49.686 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:43:50.200 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {error,mnesia_not_running} 2026-04-20 05:43:50.201 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:43:50.201 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:43:50.702 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:43:50.704 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:43:50.828 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:43:50.829 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:43:50.857 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:43:50.857 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:43:50.888 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:43:50.889 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:43:50.889 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:43:50.889 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:43:50.890 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:43:50.890 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:43:50.890 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:43:50.890 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:43:50.891 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:43:50.893 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:43:50.893 [info] <0.480.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:43:50.893 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:43:50.898 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:43:50.898 [info] <0.484.0> Starting rabbit_node_monitor 2026-04-20 05:43:50.898 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:43:50.898 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:43:50.899 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:43:50.899 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:43:50.921 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:43:50.921 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:43:50.921 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:43:50.921 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:43:50.923 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:43:50.969 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:43:50.969 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:43:50.969 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:43:50.969 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:43:50.969 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:43:50.970 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:43:50.970 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:43:50.970 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:43:50.970 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:43:50.970 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:43:50.970 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:43:50.970 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:43:50.974 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:43:50.975 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:43:50.975 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:43:50.975 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:43:50.975 [info] <0.240.0> Importing users... 2026-04-20 05:43:50.975 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:43:50.984 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:43:50.993 [info] <0.240.0> Importing vhosts... 2026-04-20 05:43:50.993 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:43:51.027 [info] <0.564.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:43:51.038 [info] <0.564.0> Starting message stores for vhost '/' 2026-04-20 05:43:51.038 [info] <0.572.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:43:51.040 [info] <0.564.0> Started message store of type transient for vhost '/' 2026-04-20 05:43:51.040 [info] <0.576.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:43:51.041 [warning] <0.576.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:43:51.042 [info] <0.564.0> Started message store of type persistent for vhost '/' 2026-04-20 05:43:51.413 [info] <0.240.0> Importing user permissions... 2026-04-20 05:43:51.413 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:43:51.428 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:43:51.428 [info] <0.240.0> Importing parameters... 2026-04-20 05:43:51.428 [info] <0.240.0> Importing global parameters... 2026-04-20 05:43:51.428 [info] <0.240.0> Importing policies... 2026-04-20 05:43:51.442 [info] <0.240.0> Importing queues... 2026-04-20 05:43:51.442 [info] <0.240.0> Importing exchanges... 2026-04-20 05:43:51.442 [info] <0.240.0> Importing bindings... 2026-04-20 05:43:51.442 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:43:51.442 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:43:51.442 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:43:51.443 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:43:51.443 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:43:51.454 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:43:51.464 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:43:51.464 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:43:51.464 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:43:51.464 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:43:51.464 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:43:51.465 [info] <0.484.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-3' up 2026-04-20 05:43:51.467 [info] <0.753.0> started TCP listener on [::]:5673 2026-04-20 05:43:51.467 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:43:51.467 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:43:51.467 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:43:51.467 [info] <0.755.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:43:51.499 [info] <0.484.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-3' up 2026-04-20 05:43:51.500 [info] <0.806.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:43:51.501 [info] <0.912.0> Statistics database started. 2026-04-20 05:43:51.501 [info] <0.911.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:43:51.501 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:43:51.732 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:43:51.765 [info] <0.316.0> RabbitMQ is asked to stop... 2026-04-20 05:43:51.818 [info] <0.316.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:43:51.818 [info] <0.316.0> Stopping application 'rabbitmq_management' 2026-04-20 05:43:51.819 [warning] <0.802.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:43:51.821 [info] <0.316.0> Stopping application 'amqp_client' 2026-04-20 05:43:51.821 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:43:51.822 [info] <0.316.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:43:51.822 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:43:51.824 [info] <0.316.0> Stopping application 'cowboy' 2026-04-20 05:43:51.824 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:43:51.825 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:43:51.825 [info] <0.316.0> Stopping application 'cowlib' 2026-04-20 05:43:51.825 [info] <0.316.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:43:51.825 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:43:51.826 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:43:51.826 [info] <0.316.0> Stopping application 'rabbit' 2026-04-20 05:43:51.826 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:43:51.826 [info] <0.753.0> stopped TCP listener on [::]:5673 2026-04-20 05:43:51.827 [info] <0.517.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:43:51.827 [info] <0.576.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:43:51.831 [info] <0.576.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:43:51.831 [info] <0.572.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:43:51.837 [info] <0.572.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:43:51.840 [info] <0.316.0> Stopping application 'mnesia' 2026-04-20 05:43:51.840 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:43:51.844 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:43:51.844 [info] <0.316.0> Stopping application 'rabbit_common' 2026-04-20 05:43:51.844 [info] <0.316.0> Stopping application 'sysmon_handler' 2026-04-20 05:43:51.844 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:43:51.845 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:43:51.845 [info] <0.316.0> Stopping application 'os_mon' 2026-04-20 05:43:51.846 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:43:51.846 [info] <0.316.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:44:00.324 [info] <0.936.0> Resetting Rabbit forcefully 2026-04-20 05:44:01.486 [info] <0.950.0> RabbitMQ is asked to stop... 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'rabbitmq_management' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'amqp_client' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'rabbit' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'mnesia' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'rabbit_common' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'sysmon_handler' 2026-04-20 05:44:01.555 [info] <0.950.0> Stopping application 'os_mon' 2026-04-20 05:44:01.555 [info] <0.950.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:44:01.555 [info] <0.950.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:44:08.150 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:44:09.625 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:44:09.625 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:44:09.643 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:44:09.644 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:44:09.657 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:44:09.657 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:44:09.657 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:44:09.662 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:44:09.669 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:44:09.669 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:44:09.676 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:44:09.676 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:44:09.676 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:44:09.676 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:44:09.676 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:44:09.678 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:44:09.678 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:44:09.678 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:44:09.678 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:44:09.678 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:44:09.678 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:44:09.678 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:44:09.678 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:44:09.678 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:44:09.679 [info] <0.240.0> Will wait for 21303 milliseconds before proceeding with registration... 2026-04-20 05:44:30.982 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:44:30.982 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:44:30.984 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:30.988 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:30.988 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:44:31.490 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:31.492 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:31.492 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:44:31.993 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:31.994 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:31.994 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:44:32.496 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:32.497 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:32.497 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:44:32.999 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:33.000 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:33.000 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:44:33.502 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:33.503 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:33.503 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:44:34.005 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:34.006 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:34.006 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:44:34.508 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:34.510 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:34.510 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:44:35.012 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:35.013 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:35.013 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:44:35.515 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:44:35.516 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,tables_not_present} 2026-04-20 05:44:35.516 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:44:36.017 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:44:36.019 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:44:36.144 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:44:36.144 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:44:36.187 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:44:36.187 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:44:36.225 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:44:36.225 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:44:36.225 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:44:36.225 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:44:36.226 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:44:36.227 [info] <0.462.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:44:36.227 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:44:36.234 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:44:36.234 [info] <0.466.0> Starting rabbit_node_monitor 2026-04-20 05:44:36.235 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:44:36.235 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:44:36.236 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:44:36.236 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:44:36.260 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:44:36.260 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:44:36.260 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:44:36.260 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:44:36.262 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:44:36.291 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:44:36.291 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:44:36.291 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:44:36.291 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:44:36.292 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:44:36.292 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:44:36.292 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:44:36.292 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:44:36.292 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:44:36.292 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:44:36.292 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:44:36.292 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:44:36.293 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:44:36.294 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:44:36.294 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:44:36.295 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:44:36.295 [info] <0.240.0> Importing users... 2026-04-20 05:44:36.295 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:44:36.304 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:44:36.307 [info] <0.240.0> Importing vhosts... 2026-04-20 05:44:36.307 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:44:36.333 [info] <0.514.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:44:36.342 [info] <0.514.0> Starting message stores for vhost '/' 2026-04-20 05:44:36.342 [info] <0.518.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:44:36.343 [info] <0.514.0> Started message store of type transient for vhost '/' 2026-04-20 05:44:36.343 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:44:36.344 [warning] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:44:36.344 [info] <0.514.0> Started message store of type persistent for vhost '/' 2026-04-20 05:44:36.346 [info] <0.240.0> Importing user permissions... 2026-04-20 05:44:36.346 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:44:36.350 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:44:36.350 [info] <0.240.0> Importing parameters... 2026-04-20 05:44:36.350 [info] <0.240.0> Importing global parameters... 2026-04-20 05:44:36.350 [info] <0.240.0> Importing policies... 2026-04-20 05:44:36.357 [info] <0.240.0> Importing queues... 2026-04-20 05:44:36.357 [info] <0.240.0> Importing exchanges... 2026-04-20 05:44:36.358 [info] <0.240.0> Importing bindings... 2026-04-20 05:44:36.358 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:44:36.358 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:44:36.359 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:44:36.359 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:44:36.359 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:44:36.364 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:44:36.369 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:44:36.369 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:44:36.369 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:44:36.369 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:44:36.369 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:44:36.371 [info] <0.567.0> started TCP listener on [::]:5673 2026-04-20 05:44:36.371 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:44:36.371 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:44:36.371 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:44:36.371 [info] <0.569.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:44:36.403 [info] <0.619.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:44:36.404 [info] <0.725.0> Statistics database started. 2026-04-20 05:44:36.404 [info] <0.724.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:44:36.404 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:44:36.525 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-04-20 05:44:37.528 [info] <0.736.0> accepting AMQP connection <0.736.0> (10.0.0.50:48804 -> 10.0.0.50:5673) 2026-04-20 05:44:37.529 [info] <0.740.0> accepting AMQP connection <0.740.0> (10.0.0.50:48808 -> 10.0.0.50:5673) 2026-04-20 05:44:37.530 [info] <0.743.0> accepting AMQP connection <0.743.0> (10.0.0.50:48812 -> 10.0.0.50:5673) 2026-04-20 05:44:37.530 [info] <0.746.0> accepting AMQP connection <0.746.0> (10.0.0.33:56164 -> 10.0.0.50:5673) 2026-04-20 05:44:37.530 [info] <0.749.0> accepting AMQP connection <0.749.0> (10.0.0.33:56170 -> 10.0.0.50:5673) 2026-04-20 05:44:37.530 [info] <0.752.0> accepting AMQP connection <0.752.0> (10.0.0.38:55250 -> 10.0.0.50:5673) 2026-04-20 05:44:37.531 [info] <0.755.0> accepting AMQP connection <0.755.0> (10.0.0.33:56176 -> 10.0.0.50:5673) 2026-04-20 05:44:37.531 [info] <0.758.0> accepting AMQP connection <0.758.0> (10.0.0.38:55260 -> 10.0.0.50:5673) 2026-04-20 05:44:37.532 [info] <0.761.0> accepting AMQP connection <0.761.0> (10.0.0.38:55270 -> 10.0.0.50:5673) 2026-04-20 05:44:37.533 [info] <0.740.0> connection <0.740.0> (10.0.0.50:48808 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.537 [info] <0.749.0> connection <0.749.0> (10.0.0.33:56170 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.538 [info] <0.736.0> connection <0.736.0> (10.0.0.50:48804 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.538 [info] <0.743.0> connection <0.743.0> (10.0.0.50:48812 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.538 [info] <0.752.0> connection <0.752.0> (10.0.0.38:55250 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.538 [info] <0.746.0> connection <0.746.0> (10.0.0.33:56164 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.538 [info] <0.761.0> connection <0.761.0> (10.0.0.38:55270 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.538 [info] <0.755.0> connection <0.755.0> (10.0.0.33:56176 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:37.539 [info] <0.758.0> connection <0.758.0> (10.0.0.38:55260 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:44:39.901 [info] <0.913.0> RabbitMQ is asked to stop... 2026-04-20 05:44:39.986 [info] <0.913.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:44:39.986 [info] <0.913.0> Stopping application 'rabbitmq_management' 2026-04-20 05:44:39.988 [warning] <0.615.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:44:39.990 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:44:39.990 [info] <0.913.0> Stopping application 'amqp_client' 2026-04-20 05:44:39.991 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:44:39.991 [info] <0.913.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:44:39.993 [info] <0.913.0> Stopping application 'cowboy' 2026-04-20 05:44:39.993 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:44:39.994 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:44:39.994 [info] <0.913.0> Stopping application 'cowlib' 2026-04-20 05:44:39.994 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:44:39.994 [info] <0.913.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:44:39.996 [info] <0.913.0> Stopping application 'rabbit' 2026-04-20 05:44:39.996 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:44:39.996 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:44:39.996 [info] <0.567.0> stopped TCP listener on [::]:5673 2026-04-20 05:44:39.997 [error] <0.746.0> Error on AMQP connection <0.746.0> (10.0.0.33:56164 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.743.0> Error on AMQP connection <0.743.0> (10.0.0.50:48812 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.749.0> Error on AMQP connection <0.749.0> (10.0.0.33:56170 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.752.0> Error on AMQP connection <0.752.0> (10.0.0.38:55250 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.740.0> Error on AMQP connection <0.740.0> (10.0.0.50:48808 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.761.0> Error on AMQP connection <0.761.0> (10.0.0.38:55270 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.755.0> Error on AMQP connection <0.755.0> (10.0.0.33:56176 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.758.0> Error on AMQP connection <0.758.0> (10.0.0.38:55260 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.997 [error] <0.736.0> Error on AMQP connection <0.736.0> (10.0.0.50:48804 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:44:39.998 [error] <0.784.0> Supervisor {<0.784.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:44:39.998 [info] <0.491.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:44:39.999 [warning] <0.834.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:39.999 [warning] <0.837.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:39.999 [warning] <0.891.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:39.999 [warning] <0.842.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:39.999 [warning] <0.824.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:40.000 [warning] <0.828.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:40.000 [warning] <0.847.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-2' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:40.000 [warning] <0.820.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:40.000 [warning] <0.831.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-3.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:44:40.003 [info] <0.521.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-04-20 05:44:40.009 [info] <0.521.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-04-20 05:44:40.010 [info] <0.518.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-04-20 05:44:40.013 [info] <0.518.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-04-20 05:44:40.022 [info] <0.913.0> Stopping application 'mnesia' 2026-04-20 05:44:40.022 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-04-20 05:44:40.025 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:44:40.025 [info] <0.913.0> Stopping application 'rabbit_common' 2026-04-20 05:44:40.025 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-04-20 05:44:40.025 [info] <0.913.0> Stopping application 'sysmon_handler' 2026-04-20 05:44:40.026 [info] <0.913.0> Stopping application 'os_mon' 2026-04-20 05:44:40.026 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-04-20 05:44:40.027 [info] <0.913.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:44:40.027 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-04-20 05:45:06.628 [info] <0.974.0> Resetting Rabbit forcefully 2026-04-20 05:45:07.732 [info] <0.988.0> RabbitMQ is asked to stop... 2026-04-20 05:45:07.876 [info] <0.988.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:45:07.876 [info] <0.988.0> Stopping application 'rabbitmq_management' 2026-04-20 05:45:07.876 [info] <0.988.0> Stopping application 'amqp_client' 2026-04-20 05:45:07.877 [info] <0.988.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:45:07.877 [info] <0.988.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:45:07.877 [info] <0.988.0> Stopping application 'rabbit' 2026-04-20 05:45:07.877 [info] <0.988.0> Stopping application 'mnesia' 2026-04-20 05:45:07.877 [info] <0.988.0> Stopping application 'rabbit_common' 2026-04-20 05:45:07.877 [info] <0.988.0> Stopping application 'sysmon_handler' 2026-04-20 05:45:07.877 [info] <0.988.0> Stopping application 'os_mon' 2026-04-20 05:45:07.877 [info] <0.988.0> Successfully stopped RabbitMQ and its dependencies 2026-04-20 05:45:07.877 [info] <0.988.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-04-20 05:45:14.573 [info] <0.8.0> Log file opened with Lager 2026-04-20 05:45:16.283 [info] <0.8.0> Feature flags: list of feature flags found: 2026-04-20 05:45:16.283 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-04-20 05:45:16.305 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-04-20 05:45:16.306 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 2026-04-20 05:45:16.318 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-04-20 05:45:16.318 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-04-20 05:45:16.318 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-04-20 05:45:16.323 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2026-04-20 05:45:16.327 [info] <0.248.0> Enabling free disk space monitoring 2026-04-20 05:45:16.327 [info] <0.248.0> Disk free limit set to 50MB 2026-04-20 05:45:16.331 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-04-20 05:45:16.332 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-04-20 05:45:16.332 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-04-20 05:45:16.332 [info] <0.252.0> FHC read buffering: OFF 2026-04-20 05:45:16.332 [info] <0.252.0> FHC write buffering: ON 2026-04-20 05:45:16.332 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-04-20 05:45:16.332 [info] <0.241.0> Will use 4 processes for default worker pool 2026-04-20 05:45:16.332 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-04-20 05:45:16.332 [info] <0.240.0> Running boot step database defined by app rabbit 2026-04-20 05:45:16.333 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-04-20 05:45:16.333 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-04-20 05:45:16.333 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:45:16.333 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-04-20 05:45:16.333 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-04-20 05:45:16.333 [info] <0.240.0> Will wait for 14491 milliseconds before proceeding with registration... 2026-04-20 05:45:30.824 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-2, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:45:30.824 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1, contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 2026-04-20 05:45:30.825 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:30.830 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:30.830 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-04-20 05:45:31.332 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:31.334 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:31.334 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-04-20 05:45:31.836 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:31.838 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:31.838 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-04-20 05:45:32.344 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:32.345 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:32.345 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-04-20 05:45:32.846 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:32.847 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:32.847 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-04-20 05:45:33.349 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:33.350 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:33.350 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-04-20 05:45:33.853 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:33.854 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:33.854 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-04-20 05:45:34.356 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:34.357 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:34.357 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-04-20 05:45:34.860 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:34.861 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:34.861 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-04-20 05:45:35.362 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-1: {badrpc,nodedown} 2026-04-20 05:45:35.363 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5649-3: {error,mnesia_not_running} 2026-04-20 05:45:35.363 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-04-20 05:45:35.864 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5649-1,contrail@cn-jenkins-deploy-platform-ansible-os-5649-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-04-20 05:45:35.866 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-04-20 05:45:35.964 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:45:35.964 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:45:35.990 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:45:35.990 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:45:36.019 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-04-20 05:45:36.019 [info] <0.240.0> Successfully synced tables from a peer 2026-04-20 05:45:36.019 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-04-20 05:45:36.020 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-04-20 05:45:36.021 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-04-20 05:45:36.021 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-04-20 05:45:36.021 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-04-20 05:45:36.021 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-04-20 05:45:36.021 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-04-20 05:45:36.021 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-04-20 05:45:36.021 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-04-20 05:45:36.021 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-04-20 05:45:36.022 [info] <0.456.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-04-20 05:45:36.022 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-04-20 05:45:36.025 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-04-20 05:45:36.025 [info] <0.460.0> Starting rabbit_node_monitor 2026-04-20 05:45:36.025 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-04-20 05:45:36.025 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-04-20 05:45:36.026 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-04-20 05:45:36.026 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-04-20 05:45:36.046 [info] <0.240.0> message_store upgrades: 1 to apply 2026-04-20 05:45:36.047 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-04-20 05:45:36.047 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-04-20 05:45:36.047 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-04-20 05:45:36.047 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-04-20 05:45:36.071 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-04-20 05:45:36.071 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-04-20 05:45:36.071 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-04-20 05:45:36.071 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-04-20 05:45:36.071 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-04-20 05:45:36.072 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-04-20 05:45:36.072 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-04-20 05:45:36.072 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-04-20 05:45:36.072 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-04-20 05:45:36.072 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-04-20 05:45:36.072 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-04-20 05:45:36.072 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-04-20 05:45:36.073 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-04-20 05:45:36.073 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-04-20 05:45:36.073 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-04-20 05:45:36.073 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-04-20 05:45:36.073 [info] <0.240.0> Importing users... 2026-04-20 05:45:36.073 [info] <0.240.0> Creating user 'guest' 2026-04-20 05:45:36.080 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-04-20 05:45:36.083 [info] <0.240.0> Importing vhosts... 2026-04-20 05:45:36.083 [info] <0.240.0> Adding vhost '/' 2026-04-20 05:45:36.105 [info] <0.508.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5649-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-04-20 05:45:36.110 [info] <0.508.0> Starting message stores for vhost '/' 2026-04-20 05:45:36.110 [info] <0.512.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:45:36.111 [info] <0.508.0> Started message store of type transient for vhost '/' 2026-04-20 05:45:36.111 [info] <0.515.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-04-20 05:45:36.112 [warning] <0.515.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-04-20 05:45:36.113 [info] <0.508.0> Started message store of type persistent for vhost '/' 2026-04-20 05:45:36.114 [info] <0.240.0> Importing user permissions... 2026-04-20 05:45:36.114 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-04-20 05:45:36.117 [info] <0.240.0> Importing topic permissions... 2026-04-20 05:45:36.117 [info] <0.240.0> Importing parameters... 2026-04-20 05:45:36.117 [info] <0.240.0> Importing global parameters... 2026-04-20 05:45:36.117 [info] <0.240.0> Importing policies... 2026-04-20 05:45:36.123 [info] <0.240.0> Importing queues... 2026-04-20 05:45:36.124 [info] <0.240.0> Importing exchanges... 2026-04-20 05:45:36.124 [info] <0.240.0> Importing bindings... 2026-04-20 05:45:36.124 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-04-20 05:45:36.124 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-04-20 05:45:36.124 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-04-20 05:45:36.124 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-04-20 05:45:36.124 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-04-20 05:45:36.130 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:45:36.134 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' 2026-04-20 05:45:36.134 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-04-20 05:45:36.134 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-04-20 05:45:36.134 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-04-20 05:45:36.134 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-04-20 05:45:36.136 [info] <0.561.0> started TCP listener on [::]:5673 2026-04-20 05:45:36.136 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-04-20 05:45:36.136 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-04-20 05:45:36.136 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-04-20 05:45:36.136 [info] <0.563.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-04-20 05:45:36.164 [info] <0.613.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-04-20 05:45:36.165 [info] <0.719.0> Statistics database started. 2026-04-20 05:45:36.165 [info] <0.718.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-04-20 05:45:36.165 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-04-20 05:45:36.260 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-04-20 05:45:39.720 [info] <0.730.0> accepting AMQP connection <0.730.0> (10.0.0.50:43658 -> 10.0.0.50:5673) 2026-04-20 05:45:39.722 [info] <0.734.0> accepting AMQP connection <0.734.0> (10.0.0.50:43666 -> 10.0.0.50:5673) 2026-04-20 05:45:39.725 [info] <0.734.0> connection <0.734.0> (10.0.0.50:43666 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:39.725 [info] <0.739.0> accepting AMQP connection <0.739.0> (10.0.0.33:36172 -> 10.0.0.50:5673) 2026-04-20 05:45:39.726 [info] <0.730.0> connection <0.730.0> (10.0.0.50:43658 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:39.728 [info] <0.739.0> connection <0.739.0> (10.0.0.33:36172 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:39.731 [info] <0.766.0> accepting AMQP connection <0.766.0> (10.0.0.33:36184 -> 10.0.0.50:5673) 2026-04-20 05:45:39.735 [info] <0.766.0> connection <0.766.0> (10.0.0.33:36184 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:39.747 [info] <0.813.0> accepting AMQP connection <0.813.0> (10.0.0.38:60422 -> 10.0.0.50:5673) 2026-04-20 05:45:39.747 [info] <0.816.0> accepting AMQP connection <0.816.0> (10.0.0.38:60430 -> 10.0.0.50:5673) 2026-04-20 05:45:39.750 [info] <0.813.0> connection <0.813.0> (10.0.0.38:60422 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:39.750 [info] <0.816.0> connection <0.816.0> (10.0.0.38:60430 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:39.835 [info] <0.853.0> accepting AMQP connection <0.853.0> (10.0.0.50:43682 -> 10.0.0.50:5673) 2026-04-20 05:45:39.837 [info] <0.853.0> connection <0.853.0> (10.0.0.50:43682 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.259 [info] <0.919.0> accepting AMQP connection <0.919.0> (10.0.0.50:43696 -> 10.0.0.50:5673) 2026-04-20 05:45:40.260 [info] <0.922.0> accepting AMQP connection <0.922.0> (10.0.0.50:43710 -> 10.0.0.50:5673) 2026-04-20 05:45:40.261 [info] <0.925.0> accepting AMQP connection <0.925.0> (10.0.0.50:43716 -> 10.0.0.50:5673) 2026-04-20 05:45:40.263 [info] <0.928.0> accepting AMQP connection <0.928.0> (10.0.0.38:60436 -> 10.0.0.50:5673) 2026-04-20 05:45:40.264 [info] <0.931.0> accepting AMQP connection <0.931.0> (10.0.0.38:60440 -> 10.0.0.50:5673) 2026-04-20 05:45:40.266 [info] <0.922.0> connection <0.922.0> (10.0.0.50:43710 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.267 [info] <0.919.0> connection <0.919.0> (10.0.0.50:43696 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.267 [info] <0.925.0> connection <0.925.0> (10.0.0.50:43716 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.267 [info] <0.931.0> connection <0.931.0> (10.0.0.38:60440 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.267 [info] <0.928.0> connection <0.928.0> (10.0.0.38:60436 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.269 [info] <0.962.0> accepting AMQP connection <0.962.0> (10.0.0.38:60444 -> 10.0.0.50:5673) 2026-04-20 05:45:40.269 [info] <0.967.0> accepting AMQP connection <0.967.0> (10.0.0.33:36196 -> 10.0.0.50:5673) 2026-04-20 05:45:40.269 [info] <0.970.0> accepting AMQP connection <0.970.0> (10.0.0.33:36200 -> 10.0.0.50:5673) 2026-04-20 05:45:40.275 [info] <0.962.0> connection <0.962.0> (10.0.0.38:60444 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.275 [info] <0.1001.0> accepting AMQP connection <0.1001.0> (10.0.0.33:36212 -> 10.0.0.50:5673) 2026-04-20 05:45:40.276 [info] <0.967.0> connection <0.967.0> (10.0.0.33:36196 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.276 [info] <0.970.0> connection <0.970.0> (10.0.0.33:36200 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.277 [info] <0.1017.0> accepting AMQP connection <0.1017.0> (10.0.0.50:43724 -> 10.0.0.50:5673) 2026-04-20 05:45:40.279 [info] <0.1001.0> connection <0.1001.0> (10.0.0.33:36212 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.279 [info] <0.1017.0> connection <0.1017.0> (10.0.0.50:43724 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.305 [info] <0.1099.0> accepting AMQP connection <0.1099.0> (10.0.0.50:43738 -> 10.0.0.50:5673) 2026-04-20 05:45:40.308 [info] <0.1099.0> connection <0.1099.0> (10.0.0.50:43738 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:40.316 [info] <0.1099.0> closing AMQP connection <0.1099.0> (10.0.0.50:43738 -> 10.0.0.50:5673, vhost: '/', user: 'guest') 2026-04-20 05:45:40.316 [info] <0.1110.0> accepting AMQP connection <0.1110.0> (10.0.0.50:43748 -> 10.0.0.50:5673) 2026-04-20 05:45:40.327 [info] <0.1110.0> connection <0.1110.0> (10.0.0.50:43748 -> 10.0.0.50:5673): user 'guest' authenticated and granted access to vhost '/' 2026-04-20 05:45:41.094 [info] <0.1131.0> RabbitMQ is asked to stop... 2026-04-20 05:45:41.175 [info] <0.1131.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-04-20 05:45:41.175 [info] <0.1131.0> Stopping application 'rabbitmq_management' 2026-04-20 05:45:41.176 [warning] <0.569.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-04-20 05:45:41.178 [info] <0.1131.0> Stopping application 'amqp_client' 2026-04-20 05:45:41.178 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-04-20 05:45:41.179 [info] <0.1131.0> Stopping application 'rabbitmq_web_dispatch' 2026-04-20 05:45:41.179 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-04-20 05:45:41.180 [info] <0.1131.0> Stopping application 'cowboy' 2026-04-20 05:45:41.180 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-04-20 05:45:41.181 [info] <0.1131.0> Stopping application 'cowlib' 2026-04-20 05:45:41.181 [info] <0.1131.0> Stopping application 'rabbitmq_management_agent' 2026-04-20 05:45:41.181 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-04-20 05:45:41.181 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-04-20 05:45:41.183 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-04-20 05:45:41.183 [info] <0.1131.0> Stopping application 'rabbit' 2026-04-20 05:45:41.183 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-04-20 05:45:41.183 [info] <0.561.0> stopped TCP listener on [::]:5673 2026-04-20 05:45:41.184 [error] <0.967.0> Error on AMQP connection <0.967.0> (10.0.0.33:36196 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.931.0> Error on AMQP connection <0.931.0> (10.0.0.38:60440 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.928.0> Error on AMQP connection <0.928.0> (10.0.0.38:60436 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.922.0> Error on AMQP connection <0.922.0> (10.0.0.50:43710 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.813.0> Error on AMQP connection <0.813.0> (10.0.0.38:60422 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.970.0> Error on AMQP connection <0.970.0> (10.0.0.33:36200 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.816.0> Error on AMQP connection <0.816.0> (10.0.0.38:60430 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.734.0> Error on AMQP connection <0.734.0> (10.0.0.50:43666 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.925.0> Error on AMQP connection <0.925.0> (10.0.0.50:43716 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.1110.0> Error on AMQP connection <0.1110.0> (10.0.0.50:43748 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.919.0> Error on AMQP connection <0.919.0> (10.0.0.50:43696 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.1001.0> Error on AMQP connection <0.1001.0> (10.0.0.33:36212 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.962.0> Error on AMQP connection <0.962.0> (10.0.0.38:60444 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.853.0> Error on AMQP connection <0.853.0> (10.0.0.50:43682 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.184 [error] <0.1017.0> Error on AMQP connection <0.1017.0> (10.0.0.50:43724 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.185 [error] <0.766.0> Error on AMQP connection <0.766.0> (10.0.0.33:36184 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.185 [error] <0.730.0> Error on AMQP connection <0.730.0> (10.0.0.50:43658 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.185 [error] <0.739.0> Error on AMQP connection <0.739.0> (10.0.0.33:36172 -> 10.0.0.50:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-04-20 05:45:41.186 [error] <0.1034.0> Supervisor {<0.1034.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:45:41.187 [error] <0.822.0> Supervisor {<0.822.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:45:41.192 [error] <0.855.0> Supervisor {<0.855.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-04-20 05:45:41.196 [info] <0.485.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5649-2' because the vhost is stopping 2026-04-20 05:45:41.197 [warning] <0.976.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.197 [warning] <0.1032.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5649-1.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.197 [warning] <0.981.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-1' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.197 [warning] <0.1049.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.198 [warning] <0.774.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5649-3.-8082-0' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.198 [warning] <0.1059.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-5649-2.' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.199 [warning] <0.779.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5649-2.-8082-0' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.199 [warning] <0.1046.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5649-3' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.199 [warning] <0.892.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5649-2..config_queue' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:41.199 [warning] <0.873.0> Mirrored queue 'job_request_consumer' in vhost '/': Stopping all nodes on master shutdown since no synchronised slave is available 2026-04-20 05:45:42.165 [warning] lager_file_backend dropped 22 messages in the last second that exceeded the limit of 50 messages/sec