2026-04-06 02:19:53,105 [myid:] - INFO [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg 2026-04-06 02:19:53,126 [myid:] - INFO [main:QuorumPeerConfig@441] - clientPortAddress is 10.0.0.27:2181 2026-04-06 02:19:53,128 [myid:] - INFO [main:QuorumPeerConfig@448] - secureClientPort is not set 2026-04-06 02:19:53,128 [myid:] - INFO [main:QuorumPeerConfig@464] - observerMasterPort is not set 2026-04-06 02:19:53,129 [myid:] - INFO [main:QuorumPeerConfig@481] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider 2026-04-06 02:19:53,143 [myid:2] - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3 2026-04-06 02:19:53,143 [myid:2] - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0 2026-04-06 02:19:53,143 [myid:2] - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled. 2026-04-06 02:19:53,145 [myid:2] - INFO [main:ManagedUtil@46] - Log4j 1.2 jmx support not found; jmx disabled. 2026-04-06 02:19:53,146 [myid:2] - INFO [main:QuorumPeerMain@152] - Starting quorum peer, myid=2 2026-04-06 02:19:53,176 [myid:2] - INFO [main:ServerMetrics@62] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@3b2c72c2 2026-04-06 02:19:53,179 [myid:2] - INFO [main:DigestAuthenticationProvider@47] - ACL digest algorithm is: SHA1 2026-04-06 02:19:53,180 [myid:2] - INFO [main:DigestAuthenticationProvider@61] - zookeeper.DigestAuthenticationProvider.enabled = true 2026-04-06 02:19:53,186 [myid:2] - INFO [main:ServerCnxnFactory@169] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 2026-04-06 02:19:53,187 [myid:2] - WARN [main:ServerCnxnFactory@309] - maxCnxns is not configured, using default value 0. 2026-04-06 02:19:53,191 [myid:2] - INFO [main:NIOServerCnxnFactory@652] - Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 8 worker threads, and 64 kB direct buffers. 2026-04-06 02:19:53,206 [myid:2] - INFO [main:NIOServerCnxnFactory@660] - binding to port /10.0.0.27:2181 2026-04-06 02:19:53,213 [myid:2] - INFO [main:QuorumPeer@797] - zookeeper.quorumCnxnTimeoutMs=-1 2026-04-06 02:19:53,219 [myid:2] - INFO [main:X509Util@77] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2026-04-06 02:19:53,226 [myid:2] - INFO [main:FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : true 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@1747] - Local sessions disabled 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@1758] - Local session upgrading disabled 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@1725] - tickTime set to 2000 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@1769] - minSessionTimeout set to 4000 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@1780] - maxSessionTimeout set to 40000 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@1805] - initLimit set to 5 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@1992] - syncLimit set to 2 2026-04-06 02:19:53,254 [myid:2] - INFO [main:QuorumPeer@2007] - connectToLearnerMasterLimit set to 0 2026-04-06 02:19:53,282 [myid:2] - INFO [main:ZookeeperBanner@42] - 2026-04-06 02:19:53,282 [myid:2] - INFO [main:ZookeeperBanner@42] - ______ _ 2026-04-06 02:19:53,284 [myid:2] - INFO [main:ZookeeperBanner@42] - |___ / | | 2026-04-06 02:19:53,284 [myid:2] - INFO [main:ZookeeperBanner@42] - / / ___ ___ | | __ ___ ___ _ __ ___ _ __ 2026-04-06 02:19:53,285 [myid:2] - INFO [main:ZookeeperBanner@42] - / / / _ \ / _ \ | |/ / / _ \ / _ \ | '_ \ / _ \ | '__| 2026-04-06 02:19:53,285 [myid:2] - INFO [main:ZookeeperBanner@42] - / /__ | (_) | | (_) | | < | __/ | __/ | |_) | | __/ | | 2026-04-06 02:19:53,285 [myid:2] - INFO [main:ZookeeperBanner@42] - /_____| \___/ \___/ |_|\_\ \___| \___| | .__/ \___| |_| 2026-04-06 02:19:53,285 [myid:2] - INFO [main:ZookeeperBanner@42] - | | 2026-04-06 02:19:53,285 [myid:2] - INFO [main:ZookeeperBanner@42] - |_| 2026-04-06 02:19:53,285 [myid:2] - INFO [main:ZookeeperBanner@42] - 2026-04-06 02:19:53,287 [myid:2] - INFO [main:Environment@98] - Server environment:zookeeper.version=3.7.1-a2fb57c55f8e59cdd76c34b357ad5181df1258d5, built on 2022-05-07 06:45 UTC 2026-04-06 02:19:53,287 [myid:2] - INFO [main:Environment@98] - Server environment:host.name=cn-jenkins-deploy-platform-ansible-os-5596-2. 2026-04-06 02:19:53,287 [myid:2] - INFO [main:Environment@98] - Server environment:java.version=11.0.16 2026-04-06 02:19:53,287 [myid:2] - INFO [main:Environment@98] - Server environment:java.vendor=Oracle Corporation 2026-04-06 02:19:53,287 [myid:2] - INFO [main:Environment@98] - Server environment:java.home=/usr/local/openjdk-11 2026-04-06 02:19:53,288 [myid:2] - INFO [main:Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.7.1-bin/bin/../build/classes:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-jute-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/snappy-java-1.1.7.7.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-reload4j-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-api-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_common-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/reload4j-1.2.19.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-unix-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-classes-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-resolver-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-handler-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-codec-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-buffer-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/metrics-core-4.1.12.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-ajax-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-servlet-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-server-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-security-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-io-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-http-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-databind-2.13.2.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-core-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-annotations-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/commons-cli-1.4.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/audience-annotations-0.12.0.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf: 2026-04-06 02:19:53,288 [myid:2] - INFO [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib 2026-04-06 02:19:53,288 [myid:2] - INFO [main:Environment@98] - Server environment:java.io.tmpdir=/tmp 2026-04-06 02:19:53,289 [myid:2] - INFO [main:Environment@98] - Server environment:java.compiler= 2026-04-06 02:19:53,289 [myid:2] - INFO [main:Environment@98] - Server environment:os.name=Linux 2026-04-06 02:19:53,289 [myid:2] - INFO [main:Environment@98] - Server environment:os.arch=amd64 2026-04-06 02:19:53,289 [myid:2] - INFO [main:Environment@98] - Server environment:os.version=5.15.0-100-generic 2026-04-06 02:19:53,289 [myid:2] - INFO [main:Environment@98] - Server environment:user.name=zookeeper 2026-04-06 02:19:53,289 [myid:2] - INFO [main:Environment@98] - Server environment:user.home=/home/zookeeper 2026-04-06 02:19:53,289 [myid:2] - INFO [main:Environment@98] - Server environment:user.dir=/apache-zookeeper-3.7.1-bin 2026-04-06 02:19:53,290 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.free=243MB 2026-04-06 02:19:53,290 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.max=1000MB 2026-04-06 02:19:53,290 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.total=250MB 2026-04-06 02:19:53,290 [myid:2] - INFO [main:ZooKeeperServer@138] - zookeeper.enableEagerACLCheck = false 2026-04-06 02:19:53,290 [myid:2] - INFO [main:ZooKeeperServer@151] - zookeeper.digest.enabled = true 2026-04-06 02:19:53,290 [myid:2] - INFO [main:ZooKeeperServer@155] - zookeeper.closeSessionTxn.enabled = true 2026-04-06 02:19:53,291 [myid:2] - INFO [main:ZooKeeperServer@1505] - zookeeper.flushDelay=0 2026-04-06 02:19:53,291 [myid:2] - INFO [main:ZooKeeperServer@1514] - zookeeper.maxWriteQueuePollTime=0 2026-04-06 02:19:53,292 [myid:2] - INFO [main:ZooKeeperServer@1523] - zookeeper.maxBatchSize=1000 2026-04-06 02:19:53,292 [myid:2] - INFO [main:ZooKeeperServer@260] - zookeeper.intBufferStartingSizeBytes = 1024 2026-04-06 02:19:53,298 [myid:2] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2026-04-06 02:19:53,299 [myid:2] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2026-04-06 02:19:53,301 [myid:2] - INFO [main:ZKDatabase@133] - zookeeper.snapshotSizeFactor = 0.33 2026-04-06 02:19:53,302 [myid:2] - INFO [main:ZKDatabase@153] - zookeeper.commitLogCount=500 2026-04-06 02:19:53,321 [myid:2] - INFO [main:QuorumPeer@2071] - Using insecure (non-TLS) quorum communication 2026-04-06 02:19:53,322 [myid:2] - INFO [main:QuorumPeer@2077] - Port unification disabled 2026-04-06 02:19:53,322 [myid:2] - INFO [main:QuorumPeer@180] - multiAddress.enabled set to false 2026-04-06 02:19:53,322 [myid:2] - INFO [main:QuorumPeer@205] - multiAddress.reachabilityCheckEnabled set to true 2026-04-06 02:19:53,322 [myid:2] - INFO [main:QuorumPeer@192] - multiAddress.reachabilityCheckTimeoutMs set to 1000 2026-04-06 02:19:53,323 [myid:2] - INFO [main:QuorumPeer@2532] - QuorumPeer communication is not secured! (SASL auth disabled) 2026-04-06 02:19:53,323 [myid:2] - INFO [main:QuorumPeer@2557] - quorum.cnxn.threads.size set to 20 2026-04-06 02:19:53,334 [myid:2] - INFO [main:SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED 2026-04-06 02:19:53,334 [myid:2] - INFO [main:FileTxnSnapLog@479] - Snapshotting: 0x0 to /data/version-2/snapshot.0 2026-04-06 02:19:53,346 [myid:2] - INFO [main:ZKDatabase@290] - Snapshot loaded in 21 ms, highest zxid is 0x0, digest is 1371985504 2026-04-06 02:19:53,346 [myid:2] - INFO [main:QuorumPeer@1157] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2026-04-06 02:19:53,359 [myid:2] - INFO [main:QuorumPeer@1185] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2026-04-06 02:19:53,377 [myid:2] - INFO [main:QuorumPeer@2574] - Using 4000ms as the quorum cnxn socket timeout 2026-04-06 02:19:53,407 [myid:2] - INFO [main:QuorumCnxManager$Listener@924] - Election port bind maximum retries is 3 2026-04-06 02:19:53,427 [myid:2] - INFO [main:FastLeaderElection@89] - zookeeper.fastleader.minNotificationInterval=200 2026-04-06 02:19:53,428 [myid:2] - INFO [main:FastLeaderElection@91] - zookeeper.fastleader.maxNotificationInterval=60000 2026-04-06 02:19:53,465 [myid:2] - INFO [main:ZKAuditProvider@42] - ZooKeeper audit is disabled. 2026-04-06 02:19:53,477 [myid:2] - INFO [ListenerHandler-/10.0.0.27:3888:QuorumCnxManager$Listener$ListenerHandler@1071] - 2 is accepting connections now, my election bind port: /10.0.0.27:3888 2026-04-06 02:19:53,483 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@1438] - LOOKING 2026-04-06 02:19:53,496 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):FastLeaderElection@945] - New election. My id = 2, proposed zxid=0x0 2026-04-06 02:19:53,563 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-1:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.249:3888 java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.base/java.net.SocksSocketImpl.connect(Unknown Source) at java.base/java.net.Socket.connect(Unknown Source) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) 2026-04-06 02:19:53,565 [myid:2] - INFO [QuorumConnectionThread-[myid=2]-2:QuorumCnxManager@514] - Have smaller server identifier, so dropping the connection: (myId:2 --> sid:3) 2026-04-06 02:19:53,567 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:2, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2026-04-06 02:19:53,567 [myid:2] - INFO [ListenerHandler-/10.0.0.27:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.33:40228 2026-04-06 02:19:53,601 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:3, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2026-04-06 02:19:53,614 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2026-04-06 02:19:53,631 [myid:2] - INFO [ListenerHandler-/10.0.0.27:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.249:51842 2026-04-06 02:19:53,659 [myid:2] - WARN [SendWorker:1:QuorumCnxManager$SendWorker@1300] - Send worker leaving thread id 1 my id = 2 2026-04-06 02:19:53,671 [myid:2] - WARN [RecvWorker:1:QuorumCnxManager$RecvWorker@1402] - Connection broken for id 1, my id = 2 java.net.SocketException: Socket closed at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.io.BufferedInputStream.fill(Unknown Source) at java.base/java.io.BufferedInputStream.read(Unknown Source) at java.base/java.io.DataInputStream.readInt(Unknown Source) at org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1390) 2026-04-06 02:19:53,672 [myid:2] - WARN [RecvWorker:1:QuorumCnxManager$RecvWorker@1408] - Interrupting SendWorker thread from RecvWorker. sid: 1. myId: 2 2026-04-06 02:19:53,719 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:1, n.state:LOOKING, n.leader:1, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2026-04-06 02:19:53,748 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:1, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2026-04-06 02:19:53,948 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@902] - Peer state changed: following 2026-04-06 02:19:53,949 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@1520] - FOLLOWING 2026-04-06 02:19:53,953 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@130] - leaderConnectDelayDuringRetryMs: 100 2026-04-06 02:19:53,953 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@131] - TCP NoDelay set to: true 2026-04-06 02:19:53,953 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@132] - zookeeper.learner.asyncSending = false 2026-04-06 02:19:53,953 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@133] - zookeeper.learner.closeSocketAsync = false 2026-04-06 02:19:53,954 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):BlueThrottle@141] - Weighed connection throttling is disabled 2026-04-06 02:19:53,955 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1306] - minSessionTimeout set to 4000 2026-04-06 02:19:53,956 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1315] - maxSessionTimeout set to 40000 2026-04-06 02:19:53,956 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ResponseCache@45] - getData response cache size is initialized with value 400. 2026-04-06 02:19:53,956 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ResponseCache@45] - getChildren response cache size is initialized with value 400. 2026-04-06 02:19:53,957 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60 2026-04-06 02:19:53,959 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15 2026-04-06 02:19:53,959 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6 2026-04-06 02:19:53,959 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5 2026-04-06 02:19:53,959 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5 2026-04-06 02:19:53,959 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false 2026-04-06 02:19:53,961 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1542] - The max bytes for all large requests are set to 104857600 2026-04-06 02:19:53,967 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1556] - The large request threshold is set to -1 2026-04-06 02:19:53,968 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false 2026-04-06 02:19:53,968 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = [] 2026-04-06 02:19:53,968 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@361] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /data/version-2 snapdir /data/version-2 2026-04-06 02:19:53,969 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Follower@77] - FOLLOWING - LEADER ELECTION TOOK - 473 MS 2026-04-06 02:19:53,971 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - discovery 2026-04-06 02:19:53,987 [myid:2] - INFO [LeaderConnector-/10.0.0.33:2888:Learner$LeaderConnector@384] - Successfully connected to leader, using address: /10.0.0.33:2888 2026-04-06 02:19:54,070 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - synchronization 2026-04-06 02:19:54,084 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@565] - Getting a diff from the leader 0x0 2026-04-06 02:19:54,084 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization - diff 2026-04-06 02:19:54,088 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@737] - Learner received NEWLEADER message 2026-04-06 02:19:54,089 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@1875] - Dynamic reconfig is disabled, we don't store the last seen config. 2026-04-06 02:19:54,093 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization 2026-04-06 02:19:54,097 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):CommitProcessor@491] - Configuring CommitProcessor with readBatchSize -1 commitBatchSize 1 2026-04-06 02:19:54,097 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):CommitProcessor@452] - Configuring CommitProcessor with 4 worker threads. 2026-04-06 02:19:54,108 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):FollowerRequestProcessor@59] - Initialized FollowerRequestProcessor with zookeeper.follower.skipLearnerRequestToNextProcessor as false 2026-04-06 02:19:54,112 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestThrottler@75] - zookeeper.request_throttler.shutdownTimeout = 10000 2026-04-06 02:19:54,262 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@721] - Learner received UPTODATE message 2026-04-06 02:19:54,263 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - broadcast 2026-04-06 02:20:45,040 [myid:2] - WARN [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Follower@169] - Got zxid 0x100000001 expected 0x1 2026-04-06 02:20:45,040 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.100000001 2026-04-06 02:20:45,065 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990000 2026-04-06 02:20:45,147 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010000 2026-04-06 02:20:45,256 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990001 2026-04-06 02:20:45,284 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010001 2026-04-06 02:20:45,461 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0000 2026-04-06 02:20:45,561 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0001 2026-04-06 02:20:45,673 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0002 2026-04-06 02:20:45,848 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010002 2026-04-06 02:20:46,030 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010003 2026-04-06 02:20:46,092 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010004 2026-04-06 02:20:46,101 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010005 2026-04-06 02:20:46,138 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0003 2026-04-06 02:20:46,378 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990002 2026-04-06 02:20:46,513 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010006 2026-04-06 02:20:47,227 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990003 2026-04-06 02:21:02,713 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010007 2026-04-06 02:21:06,658 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0004 2026-04-06 02:21:06,784 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010008 2026-04-06 02:21:07,291 [myid:2] - WARN [NIOWorkerThread-2:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.27:59950, session = 0x200001d0f010005 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) 2026-04-06 02:21:07,357 [myid:2] - WARN [NIOWorkerThread-1:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.33:48422, session = 0x200001d0f010008 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) 2026-04-06 02:21:10,483 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990004 2026-04-06 02:21:12,416 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010009 2026-04-06 02:21:17,991 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0005 2026-04-06 02:21:18,021 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0006 2026-04-06 02:21:18,147 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0007 2026-04-06 02:21:18,269 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990005 2026-04-06 02:23:12,287 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0008 2026-04-06 02:23:12,464 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0009 2026-04-06 02:23:12,483 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f01000a 2026-04-06 02:23:13,293 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f01000b 2026-04-06 02:23:13,481 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f01000c 2026-04-06 02:23:13,506 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990006 2026-04-06 02:23:19,855 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990007 2026-04-06 02:23:19,932 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c000a 2026-04-06 02:23:20,164 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f01000d 2026-04-06 02:23:23,637 [myid:2] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x200001d0f01000b 2026-04-06 02:23:24,684 [myid:2] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x200001d0f01000c 2026-04-06 02:23:56,892 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f01000e 2026-04-06 02:23:57,443 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c000b 2026-04-06 02:23:58,478 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f01000f 2026-04-06 02:24:02,704 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990008 2026-04-06 02:24:02,830 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010010 2026-04-06 02:24:03,076 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990009 2026-04-06 02:24:03,207 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c000c 2026-04-06 02:24:03,337 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff599000a 2026-04-06 02:24:03,535 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff599000b 2026-04-06 02:24:12,763 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff599000c 2026-04-06 02:24:13,169 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff599000d 2026-04-06 02:24:13,428 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c000d 2026-04-06 02:24:22,865 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c000e 2026-04-06 02:24:23,010 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff599000e 2026-04-06 02:24:23,109 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff599000f 2026-04-06 02:24:23,272 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990010 2026-04-06 02:24:23,326 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c000f 2026-04-06 02:24:23,330 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0010 2026-04-06 02:24:23,465 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0011 2026-04-06 02:24:23,486 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010011 2026-04-06 02:24:23,540 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0012 2026-04-06 02:24:23,688 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990011 2026-04-06 02:24:24,012 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990012 2026-04-06 02:24:24,266 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0013 2026-04-06 02:30:59,729 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0014 2026-04-06 02:30:59,808 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990013 2026-04-06 02:30:59,812 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990014 2026-04-06 02:30:59,836 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010012 2026-04-06 02:30:59,839 [myid:2] - INFO [NIOWorkerThread-6:FourLetterCommands@223] - The list of known four letter word commands is : [{1936881266=srvr, 1937006964=stat, 2003003491=wchc, 1685417328=dump, 1668445044=crst, 1936880500=srst, 1701738089=envi, 1668247142=conf, -720899=telnet close, 1751217000=hash, 2003003507=wchs, 2003003504=wchp, 1684632179=dirs, 1668247155=cons, 1835955314=mntr, 1769173615=isro, 1920298859=ruok, 1735683435=gtmk, 1937010027=stmk}] 2026-04-06 02:30:59,839 [myid:2] - INFO [NIOWorkerThread-6:FourLetterCommands@224] - The list of enabled four letter word commands is : [[wchs, stat, wchp, dirs, stmk, conf, ruok, mntr, srvr, wchc, envi, srst, isro, dump, gtmk, telnet close, crst, hash, cons]] 2026-04-06 02:30:59,839 [myid:2] - INFO [NIOWorkerThread-6:NIOServerCnxn@514] - Processing stat command from /10.0.0.249:53324 2026-04-06 02:30:59,842 [myid:2] - INFO [NIOWorkerThread-6:StatCommand@52] - Stat command output 2026-04-06 02:30:59,847 [myid:2] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x200001d0f010012 2026-04-06 02:30:59,857 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0015 2026-04-06 02:35:34,124 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0016 2026-04-06 02:35:34,205 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010013 2026-04-06 02:35:44,187 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990015 2026-04-06 03:00:56,513 [myid:2] - WARN [NIOWorkerThread-8:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.249:44598, session = 0x200001d0f010013 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) 2026-04-06 03:01:05,931 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990016 2026-04-06 03:01:06,006 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010014 2026-04-06 03:01:15,974 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990017 2026-04-06 03:18:28,154 [myid:2] - WARN [NIOWorkerThread-3:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.249:58056, session = 0x200001d0f010014 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) 2026-04-06 03:18:36,432 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990018 2026-04-06 03:18:36,516 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0017 2026-04-06 03:18:46,471 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001d0f010015 2026-04-06 03:18:48,916 [myid:2] - WARN [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Follower@128] - Exception when following the leader java.io.EOFException at java.base/java.io.DataInputStream.readInt(Unknown Source) at org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:96) at org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:86) at org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:134) at org.apache.zookeeper.server.quorum.Learner.readPacket(Learner.java:228) at org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.java:124) at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1522) 2026-04-06 03:18:48,918 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Follower@142] - Disconnected from leader (with address: /10.0.0.33:2888). Was connected for 3534930ms. Sync state: true 2026-04-06 03:18:48,918 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Follower@286] - shutdown Follower 2026-04-06 03:18:48,947 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@835] - shutting down 2026-04-06 03:18:48,947 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestThrottler@258] - Shutting down 2026-04-06 03:18:48,947 [myid:2] - INFO [RequestThrottler:RequestThrottler@219] - Draining request throttler queue 2026-04-06 03:18:48,948 [myid:2] - INFO [RequestThrottler:RequestThrottler@195] - RequestThrottler shutdown. Dropped 0 requests 2026-04-06 03:18:48,950 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):FollowerRequestProcessor@172] - Shutting down 2026-04-06 03:18:48,951 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):CommitProcessor@632] - Shutting down 2026-04-06 03:18:48,951 [myid:2] - INFO [FollowerRequestProcessor:2:FollowerRequestProcessor@128] - FollowerRequestProcessor exited loop! 2026-04-06 03:18:48,958 [myid:2] - INFO [CommitProcessor:2:CommitProcessor@420] - CommitProcessor exited loop! 2026-04-06 03:18:48,961 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):FinalRequestProcessor@684] - shutdown of request processor complete 2026-04-06 03:18:48,974 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: looking 2026-04-06 03:18:48,975 [myid:2] - WARN [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@1568] - PeerState set to LOOKING 2026-04-06 03:18:48,975 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@1438] - LOOKING 2026-04-06 03:18:48,975 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):FastLeaderElection@945] - New election. My id = 2, proposed zxid=0x100001a0b 2026-04-06 03:18:48,977 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:2, n.round:0x2, n.peerEpoch:0x1, n.zxid:0x100001a0b, message format version:0x2, n.config version:0x0 2026-04-06 03:18:48,980 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:1, n.state:FOLLOWING, n.leader:3, n.round:0x1, n.peerEpoch:0x1, n.zxid:0x0, message format version:0x2, n.config version:0x0 2026-04-06 03:18:48,981 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:3, n.state:LEADING, n.leader:3, n.round:0x1, n.peerEpoch:0x1, n.zxid:0x0, message format version:0x2, n.config version:0x0 2026-04-06 03:18:48,982 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@902] - Peer state changed: following 2026-04-06 03:18:48,982 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@1520] - FOLLOWING 2026-04-06 03:20:27,168 [myid:2] - WARN [SyncThread:2:FileTxnLog@393] - fsync-ing the write ahead log in SyncThread:2 took 103097ms which will adversely effect operation latency.File size is 67108880 bytes. See the ZooKeeper troubleshooting guide 2026-04-06 03:20:27,168 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1306] - minSessionTimeout set to 4000 2026-04-06 03:20:27,168 [myid:2] - WARN [SyncThread:2:SendAckRequestProcessor@65] - Closing connection to leader, exception during packet send java.net.SocketException: Socket closed at java.base/java.net.SocketOutputStream.socketWrite(Unknown Source) at java.base/java.net.SocketOutputStream.write(Unknown Source) at java.base/java.io.BufferedOutputStream.flushBuffer(Unknown Source) at java.base/java.io.BufferedOutputStream.flush(Unknown Source) at org.apache.zookeeper.server.quorum.Learner.writePacketNow(Learner.java:206) at org.apache.zookeeper.server.quorum.Learner.writePacket(Learner.java:195) at org.apache.zookeeper.server.quorum.SendAckRequestProcessor.flush(SendAckRequestProcessor.java:63) at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:248) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169) 2026-04-06 03:20:27,169 [myid:2] - ERROR [SyncThread:2:ZooKeeperCriticalThread@49] - Severe unrecoverable error, from thread : SyncThread:2 java.lang.NullPointerException at org.apache.zookeeper.server.quorum.SendAckRequestProcessor.flush(SendAckRequestProcessor.java:67) at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:248) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169) 2026-04-06 03:20:27,169 [myid:2] - INFO [SyncThread:2:ZooKeeperServerListenerImpl@43] - Thread SyncThread:2 exits, error code 1 2026-04-06 03:20:27,168 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1315] - maxSessionTimeout set to 40000 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ResponseCache@45] - getData response cache size is initialized with value 400. 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ResponseCache@45] - getChildren response cache size is initialized with value 400. 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5 2026-04-06 03:20:27,174 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false 2026-04-06 03:20:27,175 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1542] - The max bytes for all large requests are set to 104857600 2026-04-06 03:20:27,175 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@1556] - The large request threshold is set to -1 2026-04-06 03:20:27,175 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false 2026-04-06 03:20:27,175 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = [] 2026-04-06 03:20:27,175 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):ZooKeeperServer@361] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /data/version-2 snapdir /data/version-2 2026-04-06 03:20:27,175 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Follower@77] - FOLLOWING - LEADER ELECTION TOOK - 98200 MS 2026-04-06 03:20:27,175 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - discovery 2026-04-06 03:20:27,170 [myid:2] - INFO [SyncThread:2:SyncRequestProcessor@224] - SyncRequestProcessor exited! 2026-04-06 03:20:27,177 [myid:2] - INFO [LeaderConnector-/10.0.0.33:2888:Learner$LeaderConnector@384] - Successfully connected to leader, using address: /10.0.0.33:2888 2026-04-06 03:20:27,188 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - synchronization 2026-04-06 03:20:27,191 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@565] - Getting a diff from the leader 0x100001b5f 2026-04-06 03:20:27,191 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization - diff 2026-04-06 03:20:27,198 [myid:2] - WARN [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@637] - Got zxid 0x100001a0c expected 0x1 2026-04-06 03:20:27,215 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@737] - Learner received NEWLEADER message 2026-04-06 03:20:27,232 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@1875] - Dynamic reconfig is disabled, we don't store the last seen config. 2026-04-06 03:20:27,307 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization 2026-04-06 03:20:27,307 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):CommitProcessor@491] - Configuring CommitProcessor with readBatchSize -1 commitBatchSize 1 2026-04-06 03:20:27,307 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):CommitProcessor@452] - Configuring CommitProcessor with 4 worker threads. 2026-04-06 03:20:27,308 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):FollowerRequestProcessor@59] - Initialized FollowerRequestProcessor with zookeeper.follower.skipLearnerRequestToNextProcessor as false 2026-04-06 03:20:27,316 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Learner@721] - Learner received UPTODATE message 2026-04-06 03:20:27,356 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - broadcast 2026-04-06 03:20:27,432 [myid:2] - WARN [QuorumPeer[myid=2](plain=10.0.0.27:2181)(secure=disabled):Follower@169] - Got zxid 0x100001b63 expected 0x1 2026-04-06 03:20:34,073 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0018 2026-04-06 03:20:35,986 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c0019 2026-04-06 04:09:36,130 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c001a 2026-04-06 04:09:36,270 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c001b 2026-04-06 04:09:46,191 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c001c 2026-04-06 04:37:41,965 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c001d 2026-04-06 04:37:42,029 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000547ed60000 2026-04-06 04:37:59,164 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000547ed60001 2026-04-06 04:37:59,237 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff5990019 2026-04-06 04:38:14,854 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c001e 2026-04-06 04:38:14,912 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x300001e510c001f 2026-04-06 05:04:08,263 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ff599001a