Ted - i'm not seeing any difference in the Non-working & working clusters ..
Another thing, seem like there is some issue with the connectivity .. the console consumer gets disconnected /usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-consumer.sh --new-consumer --topic mmtest1 --bootstrap-server host1:9093 --property print.key=true --property print.value=true --property key.deserializer=org.apache.kafka.common.serialization.StringDeserializer --property value.deserializer=org.apache.kafka.common.serialization.StringDeserializer [2017-12-21 21:02:48,803] WARN Bootstrap broker host1:9093 disconnected (org.apache.kafka.clients.NetworkClient) [2017-12-21 21:02:48,981] WARN Bootstrap broker host1:9093 disconnected (org.apache.kafka.clients.NetworkClient) [2017-12-21 21:02:49,159] WARN Bootstrap broker host1:9093 disconnected (org.apache.kafka.clients.NetworkClient) On Thu, Dec 21, 2017 at 12:49 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Since you're using a Vendor's distro, can you post on their community page > ? > > BTW do you notice any difference in settings between the working cluster > and this cluster ? > > Cheers > > On Thu, Dec 21, 2017 at 12:27 PM, sham singh <singh.shammi2...@gmail.com> > wrote: > > > Hello All - > > I'm getting this error, when publishing messages to Kafka topic using SSL > > mode, > > > > Command to publish messages : > > > > */usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh --messages > > 1000000 --message-size 1000 --topics mmtest4 \* > > *--broker-list <host1>:9093,<host2>:9093,<host3>:9093, \* > > *--threads 1 --compression-codec 3 --batch-size 10000 \* > > *--security-protocol SSL --show-detailed-stats* > > > > > > > > *[2017-12-21 19:48:49,846] WARN Fetching topic metadata with correlation > id > > 11 for topics [Set(mmtest4)] from broker [BrokerEndPoint(0,<host1>, > 9093)] > > failed (kafka.client.ClientUtils$)* > > *java.io.EOFException* > > * at > > org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel( > > NetworkReceive.java:99)* > > * at > > kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:140)* > > * at kafka.network.BlockingChannel.receive(BlockingChannel.scala:131)* > > * at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:84)* > > * at > > kafka.producer.SyncProducer.kafka$producer$SyncProducer$$ > > doSend(SyncProducer.scala:81)* > > * at kafka.producer.SyncProducer.send(SyncProducer.scala:126)* > > * at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)* > > * at > > kafka.producer.BrokerPartitionInfo.updateInfo( > > BrokerPartitionInfo.scala:83)* > > * at > > kafka.producer.BrokerPartitionInfo.getBrokerPartitionInfo( > > BrokerPartitionInfo.scala:50)* > > * at > > kafka.producer.async.DefaultEventHandler.kafka$producer$async$ > > DefaultEventHandler$$getPartitionListForTopic( > > DefaultEventHandler.scala:206)* > > * at > > kafka.producer.async.DefaultEventHandler$$anonfun$ > > partitionAndCollate$1.apply(DefaultEventHandler.scala:170)* > > * at > > kafka.producer.async.DefaultEventHandler$$anonfun$ > > partitionAndCollate$1.apply(DefaultEventHandler.scala:169)* > > * at > > scala.collection.mutable.ResizableArray$class.foreach( > > ResizableArray.scala:59)* > > * at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)* > > * at > > kafka.producer.async.DefaultEventHandler.partitionAndCollate( > > DefaultEventHandler.scala:169)* > > * at > > kafka.producer.async.DefaultEventHandler.dispatchSerializedData( > > DefaultEventHandler.scala:101)* > > * at > > kafka.producer.async.DefaultEventHandler.handle( > > DefaultEventHandler.scala:78)* > > * at > > kafka.producer.async.ProducerSendThread.tryToHandle( > > ProducerSendThread.scala:106)* > > * at > > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply( > > ProducerSendThread.scala:89)* > > * at > > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply( > > ProducerSendThread.scala:69)* > > * at scala.collection.Iterator$class.foreach(Iterator.scala:727)* > > * at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)* > > * at > > kafka.producer.async.ProducerSendThread.processEvents( > > ProducerSendThread.scala:68)* > > * at > > kafka.producer.async.ProducerSendThread.run( > ProducerSendThread.scala:46)* > > Seems SSL is setup correctly, when i run the following command, i get > > expected result -> > > *openssl s_client -debug -connect host1:9093 -tls1* > > > > Setting done in the server.properties (using Ambari) -> > > *listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093* > > * advertised.listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093* > > * ssl.truststore.location=/etc/kafka/truststore/kafka.server. > > truststore.jks* > > * ssl.truststore.password=password* > > * ssl.keystore.location=/etc/kafka/truststore//kafka. > server.keystore.jks* > > * ssl.keystore.password=password* > > * ssl.key.password=password* > > These setting seem to be working on another environment, however - on > this > > env (Prod), > > it seem to be giving the error shown above. > > Any ideas on what need to be done to debug/fix the error ? > > >
