lhotari commented on pull request #190: URL: https://github.com/apache/pulsar-helm-chart/pull/190#issuecomment-1017624305
here's the [bookie-init failure](https://gist.githubusercontent.com/lhotari/1762ae76483596a3d49d9c0df1e4bb6d/raw/cdb58eb085b336fa961e9283807698552ca536ee/pulsar-ci-bookie-init-and-zk-logs.txt): ``` [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:45:47.975 [main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 1048575 Bytes [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:45:47.983 [main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=false [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:45:48.046 [main-SendThread(pulsar-ci-zookeeper:2281)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server pulsar-ci-zookeeper/10.244.1.11:2281. [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:45:48.047 [main-SendThread(pulsar-ci-zookeeper:2281)] INFO org.apache.zookeeper.ClientCnxn - SASL config status: Will not attempt to authenticate using SASL (unknown error) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:45:49.113 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - SSL handler added for channel: [id: 0xe111b4a0] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:45:49.166 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /10.244.1.20:39420, server: pulsar-ci-zookeeper/10.244.1.11:2281 [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:45:49.172 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is connected: [id: 0xe111b4a0, L:/10.244.1.20:39420 - R:pulsar-ci-zookeeper/10.244.1.11:2281] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:03.784 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is disconnected: [id: 0xe111b4a0, L:/10.244.1.20:39420 ! R:pulsar-ci-zookeeper/10.244.1.11:2281] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:03.786 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is told closing [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:03.810 [main-SendThread(pulsar-ci-zookeeper:2281)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for sever pulsar-ci-zookeeper/10.244.1.11:2281, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] org.apache.zookeeper.ClientCnxn$EndOfStreamException: channel for sessionid 0x0 is lost [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.zookeeper.ClientCnxnSocketNetty.doTransport(ClientCnxnSocketNetty.java:285) ~[org.apache.zookeeper-zookeeper-3.6.3.jar:3.6.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) [org.apache.zookeeper-zookeeper-3.6.3.jar:3.6.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:05.650 [main-SendThread(pulsar-ci-zookeeper:2281)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server pulsar-ci-zookeeper/10.244.1.11:2281. [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:05.653 [main-SendThread(pulsar-ci-zookeeper:2281)] INFO org.apache.zookeeper.ClientCnxn - SASL config status: Will not attempt to authenticate using SASL (unknown error) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:20.277 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - SSL handler added for channel: [id: 0x20cc85f5] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:20.285 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /10.244.1.20:39662, server: pulsar-ci-zookeeper/10.244.1.11:2281 [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:20.289 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is connected: [id: 0x20cc85f5, L:/10.244.1.20:39662 - R:pulsar-ci-zookeeper/10.244.1.11:2281] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:30.746 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server pulsar-ci-zookeeper/10.244.1.11:2281, session id = 0x1000003b111025b, negotiated timeout = 30000 [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:32.021 [main-EventThread] INFO org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase - ZooKeeper client is connected now. [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:35.658 [main] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is told closing [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:37.603 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is disconnected: [id: 0x20cc85f5, L:/10.244.1.20:39662 ! R:pulsar-ci-zookeeper/10.244.1.11:2281] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:37.603 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x1000003b111025b [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:37.603 [main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x1000003b111025b closed [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:37.608 [main] ERROR org.apache.bookkeeper.meta.zk.ZKMetadataDriverBase - Failed to create zookeeper client to pulsar-ci-zookeeper:2281 [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) ~[org.apache.zookeeper-zookeeper-3.6.3.jar:3.6.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase.waitForConnection(ZooKeeperWatcherBase.java:159) ~[org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.zookeeper.ZooKeeperClient$Builder.build(ZooKeeperClient.java:260) ~[org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.zk.ZKMetadataDriverBase.initialize(ZKMetadataDriverBase.java:207) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.zk.ZKMetadataBookieDriver.initialize(ZKMetadataBookieDriver.java:60) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.MetadataDrivers.runFunctionWithMetadataBookieDriver(MetadataDrivers.java:345) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.MetadataDrivers.runFunctionWithRegistrationManager(MetadataDrivers.java:372) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.tools.cli.commands.bookies.InstanceIdCommand.apply(InstanceIdCommand.java:49) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell$WhatIsInstanceId.runCmd(BookieShell.java:1492) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell$MyCommand.runCmd(BookieShell.java:238) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell.run(BookieShell.java:2275) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell.main(BookieShell.java:2366) [org.apache.bookkeeper-bookkeeper-server-4.14.3.jar:4.14.3] [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] Exception in thread "main" com.google.common.util.concurrent.UncheckedExecutionException: Failed to create zookeeper client to pulsar-ci-zookeeper:2281 [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.tools.cli.commands.bookies.InstanceIdCommand.apply(InstanceIdCommand.java:61) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell$WhatIsInstanceId.runCmd(BookieShell.java:1492) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell$MyCommand.runCmd(BookieShell.java:238) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell.run(BookieShell.java:2275) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.bookie.BookieShell.main(BookieShell.java:2366) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] Caused by: org.apache.bookkeeper.meta.exceptions.MetadataException: Failed to create zookeeper client to pulsar-ci-zookeeper:2281 [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.zk.ZKMetadataDriverBase.initialize(ZKMetadataDriverBase.java:227) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.zk.ZKMetadataBookieDriver.initialize(ZKMetadataBookieDriver.java:60) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.MetadataDrivers.runFunctionWithMetadataBookieDriver(MetadataDrivers.java:345) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.MetadataDrivers.runFunctionWithRegistrationManager(MetadataDrivers.java:372) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.tools.cli.commands.bookies.InstanceIdCommand.apply(InstanceIdCommand.java:49) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] ... 4 more [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase.waitForConnection(ZooKeeperWatcherBase.java:159) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.zookeeper.ZooKeeperClient$Builder.build(ZooKeeperClient.java:260) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] at org.apache.bookkeeper.meta.zk.ZKMetadataDriverBase.initialize(ZKMetadataDriverBase.java:207) [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] ... 8 more [pod/pulsar-ci-bookie-init-pcxzk/pulsar-ci-bookie-init] 14:46:37.603 [epollEventLoopGroup-2-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is told closing ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
