Kafka error:- The requested operation can not be performed on a file with user-mapped section open.

2020-07-12 Thread Gagan Sabharwal
Hi team, I started 3 kafka servers on same machine listening to ports 9092,9093 and 9094 having their dedicated LOG and Data directories. I have created a topic with 1 partition and a replication factor of 3. Here is the code. NewTopic topic = new NewTopic("Queue", 1, (short) 3); Then I wrote

Re: Kafka error - append operation on partition

2018-11-15 Thread Faisal Durrani
I went through the logs segment of the topic and i see that the data from the producerID still exists in the topic and the new messages received are well with in the retention period ( 336 hr). Starting offset: 359 offset: 359 position: 0 CreateTime: 1541667838856 isvalid: true keysize: 39 valuesi

Kafka error - append operation on partition

2018-11-15 Thread Faisal Durrani
Hi Users, Apologies if this question has been asked before but i have not been able to find the answer. I am seeing this error in the Kafka logs : [ReplicaManager broker=1001] Error processing append operation on partition TABLE-0 (kafka.server.ReplicaManager) org.apache.kafka.common.errors.Unk

Re: kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-05-02 Thread Guozhang Wang
> Original message From: Guozhang Wang > Date: 4/26/18 1:56 PM (GMT-05:00) To: users@kafka.apache.org Subject: > Re: kafka error after upgrading to 1.1.0: “the state store…may have > migrated to another instance” > Hello, > > Thanks for

Re: kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread dizzy0ny
5:00) To: users@kafka.apache.org Subject: Re: kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance” Hello, Thanks for reporting this issue, did you know which line gets fired and throw the InvalidStateStoreException since you listed two place

Re: kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread Guozhang Wang
Hello, Thanks for reporting this issue, did you know which line gets fired and throw the InvalidStateStoreException since you listed two places here? 1) if (!streamThread.isRunningAndNotRebalancing()) 2) if (!store.isOpen()) >From the description that "the above code is not finding the store f

kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread mahendra.b.singh
My stream app produces streams by subscribing to changes from our database by using confluent connect, does some calculation and then publishes their own stream/topic. When starting the app, i attempt to get each of the stream store the app publishes. This code simply tries to get the store usi

kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread dizzy0ny
My stream app produces streams by subscribing to changes from our database by using confluent connect, does some calculation and then publishes their own stream/topic. When starting the app, i attempt to get each of the stream store the app publishes. This code simply tries to get the store usi

Re: Kafka ERROR after upgrade to Kafka 1.0.0 version : java.lang.OutOfMemoryError: Java heap space

2017-11-21 Thread Ismael Juma
Hi Vinay, The issue you describe looks like KAFKA-6185. You can either build the latest code in the 1.0 branch (which includes the fix) or downgrade to 0.11.0.2. Regards, Ismael On Tue, Nov 21, 2017 at 2:01 PM, Vinay Kumar wrote: > Hi, > > I upgraded Kafka from 0.10.2.1 to 1.0.0 version. And o

Kafka ERROR after upgrade to Kafka 1.0.0 version : java.lang.OutOfMemoryError: Java heap space

2017-11-21 Thread Vinay Kumar
Hi, I upgraded Kafka from 0.10.2.1 to 1.0.0 version. And only from then, I'm seeing the kafka service going down because of below issue: ERROR [KafkaApi-1] Error when handling request ; (kafka.server.KafkaApis) {replica_id=-1,max_wait_time=500,min_bytes=1,topics=[{topic= ,partitions=[{partiti

About the Kafka error code 15 problem

2017-08-03 Thread zhangmin...@xbsafe.cn
zhangmin...@xbsafe.cn

Re: Kafka error after SSL enabled - Bootstrap broker-name :6667 disconnected (org.apache.kafka.clients.NetworkClient)

2017-07-24 Thread karan alang
further update -> i recreated the certificates & here is the result of the verification (i read in one post that the CN should match the FQDN, else it gives the error, any ideas on how to debug this ? openssl s_client -debug -connect nwk2-bdp-kafka-04.gdcs-qa.apple.com:6667 -tls1 CONNECTED(0

Re: Kafka error after SSL enabled - Bootstrap broker-name :6667 disconnected (org.apache.kafka.clients.NetworkClient)

2017-07-24 Thread karan alang
Here is what i see the logs .. So, it seems the Kafka Broker is starting up with SSL, however - when the Controller is not able to connect to the Broker server.log > > [2017-07-24 20:57:19,461] INFO [ThrottledRequestReaper-Produce], Starting > (kafka.server.ClientQuotaManager$ThrottledRequestReap

Kafka error after SSL enabled - Bootstrap broker-name :6667 disconnected (org.apache.kafka.clients.NetworkClient)

2017-07-24 Thread karan alang
Hello - i've enabled SSL for Kafka, and Kafka is starting up fine with SSL enable. However, when i run the Kafka console producer, it is give me error as shown below -> 1. Command : 2. 3. /usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-producer.sh --broker-list nwk2-bdp-kafka-05.gdcs-qa

Re: Kafka error: FATAL Fatal error during KafkaServerStartable startup.after enabling security

2016-05-31 Thread Alex Loddengaard
Hi Kiran, can you enable SASL logging? Do it with "-Dsun.security.krb5.debug=true". Alex On Fri, May 27, 2016 at 8:15 PM, kiran kumar wrote: > Hi Alex, > > Thanks for the response. > > Here is the latest log. looks like it is failing at session establishment > after connection establishment suc

Re: Kafka error: FATAL Fatal error during KafkaServerStartable startup.after enabling security

2016-05-27 Thread kiran kumar
Hi Alex, Thanks for the response. Here is the latest log. looks like it is failing at session establishment after connection establishment successful. I have enabled sasl debug and attached the log. [2016-05-27 23:03:39,280] INFO TGT valid starting at:Fri May 27 23:03:39 EDT 2016 (org.ap

Re: Kafka error: FATAL Fatal error during KafkaServerStartable startup.after enabling security

2016-05-27 Thread Alex Loddengaard
Hi Kiran, Can you attach your configuration files not in a .zip? Most likely your broker isn't using the correct hostname:port to connect to ZooKeeper. Although if you're using ZooKeeper SASL, you may have a SASL misconfiguration. Set the `sun.security.krb5.debug` JVM property to `true` to get SA

Re: Kafka Error while doing SSL authentication on 0.9.0

2016-03-15 Thread Harsha
Are you sure broker side ssl configs are properly set. One quick way to test is to use openssl to connect to the broker openssl s_client -debug -connect localhost:9093 -tls1 make sure you change the port where the broker is running the SSL. More details are here http://kafka.apache.org/documentati

Kafka Error while doing SSL authentication on 0.9.0

2016-03-09 Thread Ranjan Baral
i getting below warning while doing produce from client side which is connecting to server side which contains SSL based authentication. *[2016-03-10 07:09:13,018] WARN The configuration ssl.keystore.location = /etc/pki/tls/certs/keystore-hpfs.jks was supplied but isn't a known config. (org.apache

Kafka error code: 7 (RequestTimedOut)

2016-02-24 Thread ANKUR JOHRI
I have a Kafka infrastructure in which there is 1 topic (T) with 1 partition and replication factor 2. There are 2 brokers - B1 and B2 in the associated zookeeper. The two brokers are on two different hosts - host 1 and host 2. The leader is on host1, which is defined to be local in context of a p

Kafka error code: 7 (RequestTimedOut)

2016-02-24 Thread Ankur Johri
Hi, I have a Kafka infrastructure in which there is 1 topic (T) with 1 partition and replication factor 2. There are 2 brokers - B1 and B2 in the associated zookeeper. The two brokers are on two different hosts - host 1 and host 2. The leader is on host1, which is defined to be local in context

Re: No Kafka Error when no Server

2016-01-26 Thread Gwen Shapira
Producer.send() by itself will not throw anything. You need to either wait on the future: producer.send().get() Or to use it with a callback that logs the error. On Tue, Jan 26, 2016 at 8:50 AM, Joe San wrote: > Is this strange or wierd? I had no Kafka or Zookeeper running on my local > machin

No Kafka Error when no Server

2016-01-26 Thread Joe San
Is this strange or wierd? I had no Kafka or Zookeeper running on my local machine and I was expecting an exception, but for some strange reason, I do not see any errors: try { logger.info(s"kafka producer obtained is ${producer}") producer.send( new ProducerRecord[String, String](producerC

kafka error

2015-09-29 Thread Hema Bhatia
I keep seeing this error while creating topic : Error is: replication factor: 3 larger than available brokers: 2 I have 4 kafka nodes, and replication factor of 3. 2 nodes on datacenter 1, 2 on datacenter 2 running kafka 0.8.2.0.

Kafka error

2015-01-25 Thread Mahesh Sankaran
Hi all, I am currently working on logstash to mongodb.logstash's input (producer) is kafka and output (consumer) is mongodb.It is worked fine for past two days.Today it is not working and i got the following error.i googled this error,still didnt find any correct solution.kindly help me to

Re: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-31 Thread Jun Rao
gt; Thanks, > Pradeep Simha > Technical Lead > > -Original Message- > From: Jun Rao [mailto:jun...@gmail.com] > Sent: Thursday, July 31, 2014 10:00 AM > To: users@kafka.apache.org > Subject: Re: Apache Kafka error on windows - Couldnot find or load main > class Quoru

RE: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread pradeep.simha
: Thursday, July 31, 2014 10:00 AM To: users@kafka.apache.org Subject: Re: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain Is zookeeper jar in your classpath? Thanks, Jun On Wed, Jul 30, 2014 at 6:13 AM, wrote: > Hi Team, > > I just downloaded Kafka 2

Re: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread Jun Rao
Is zookeeper jar in your classpath? Thanks, Jun On Wed, Jul 30, 2014 at 6:13 AM, wrote: > Hi Team, > > I just downloaded Kafka 2.8.0 from Apache website, and I am trying to > setup using the instructions given on the website. But when I try to start > zookeper server, I am getting below error

RE: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread pradeep.simha
: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain Hi Team, I just downloaded Kafka 2.8.0 from Apache website, and I am trying to setup using the instructions given on the website. But when I try to start zookeper server, I am getting below error: Error: Could not

Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread pradeep.simha
Hi Team, I just downloaded Kafka 2.8.0 from Apache website, and I am trying to setup using the instructions given on the website. But when I try to start zookeper server, I am getting below error: Error: Could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain M