Hi team,
I started 3 kafka servers on same machine listening to ports 9092,9093 and 9094
having their dedicated LOG and Data directories.
I have created a topic with 1 partition and a replication factor of 3. Here is
the code.
NewTopic topic = new NewTopic("Queue", 1, (short) 3);
Then I wrote
I went through the logs segment of the topic and i see that the data from
the producerID still exists in the topic and the new messages received are
well with in the retention period ( 336 hr).
Starting offset: 359
offset: 359 position: 0 CreateTime: 1541667838856 isvalid: true keysize: 39
valuesi
Hi Users,
Apologies if this question has been asked before but i have not been able
to find the answer.
I am seeing this error in the Kafka logs :
[ReplicaManager broker=1001] Error processing append operation on
partition TABLE-0 (kafka.server.ReplicaManager)
org.apache.kafka.common.errors.Unk
> Original message From: Guozhang Wang
> Date: 4/26/18 1:56 PM (GMT-05:00) To: users@kafka.apache.org Subject:
> Re: kafka error after upgrading to 1.1.0: “the state store…may have
> migrated to another instance”
> Hello,
>
> Thanks for
5:00) To: users@kafka.apache.org Subject: Re:
kafka error after upgrading to 1.1.0: “the state store…may have migrated to
another instance”
Hello,
Thanks for reporting this issue, did you know which line gets fired and
throw the InvalidStateStoreException since you listed two place
Hello,
Thanks for reporting this issue, did you know which line gets fired and
throw the InvalidStateStoreException since you listed two places here?
1) if (!streamThread.isRunningAndNotRebalancing())
2) if (!store.isOpen())
>From the description that "the above code is not finding the store f
My stream app produces streams by subscribing to changes from our database by
using confluent connect, does some calculation and then publishes their own
stream/topic.
When starting the app, i attempt to get each of the stream store the app
publishes. This code simply tries to get the store usi
My stream app produces streams by subscribing to changes from our database by
using confluent connect, does some calculation and then publishes their own
stream/topic.
When starting the app, i attempt to get each of the stream store the app
publishes. This code simply tries to get the store usi
Hi Vinay,
The issue you describe looks like KAFKA-6185. You can either build the
latest code in the 1.0 branch (which includes the fix) or downgrade to
0.11.0.2.
Regards,
Ismael
On Tue, Nov 21, 2017 at 2:01 PM, Vinay Kumar wrote:
> Hi,
>
> I upgraded Kafka from 0.10.2.1 to 1.0.0 version. And o
Hi,
I upgraded Kafka from 0.10.2.1 to 1.0.0 version. And only from then, I'm
seeing the kafka service going down because of below issue:
ERROR [KafkaApi-1] Error when handling request ; (kafka.server.KafkaApis)
{replica_id=-1,max_wait_time=500,min_bytes=1,topics=[{topic=
,partitions=[{partiti
zhangmin...@xbsafe.cn
further update -> i recreated the certificates & here is the result of the
verification
(i read in one post that the CN should match the FQDN, else it gives the
error, any ideas on how to debug this ?
openssl s_client -debug -connect nwk2-bdp-kafka-04.gdcs-qa.apple.com:6667 -tls1
CONNECTED(0
Here is what i see the logs ..
So, it seems the Kafka Broker is starting up with SSL, however - when the
Controller is not able to connect to the Broker
server.log
>
> [2017-07-24 20:57:19,461] INFO [ThrottledRequestReaper-Produce], Starting
> (kafka.server.ClientQuotaManager$ThrottledRequestReap
Hello - i've enabled SSL for Kafka, and Kafka is starting up fine with SSL
enable.
However, when i run the Kafka console producer, it is give me error as
shown below ->
1. Command :
2.
3. /usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-producer.sh --broker-list
nwk2-bdp-kafka-05.gdcs-qa
Hi Kiran, can you enable SASL logging? Do it with
"-Dsun.security.krb5.debug=true".
Alex
On Fri, May 27, 2016 at 8:15 PM, kiran kumar wrote:
> Hi Alex,
>
> Thanks for the response.
>
> Here is the latest log. looks like it is failing at session establishment
> after connection establishment suc
Hi Alex,
Thanks for the response.
Here is the latest log. looks like it is failing at session establishment
after connection establishment successful. I have enabled sasl debug and
attached the log.
[2016-05-27 23:03:39,280] INFO TGT valid starting at:Fri May 27
23:03:39 EDT 2016 (org.ap
Hi Kiran,
Can you attach your configuration files not in a .zip?
Most likely your broker isn't using the correct hostname:port to connect to
ZooKeeper. Although if you're using ZooKeeper SASL, you may have a SASL
misconfiguration. Set the `sun.security.krb5.debug` JVM property to `true`
to get SA
Are you sure broker side ssl configs are properly set. One quick way to
test is to use openssl to connect to the broker
openssl s_client -debug -connect localhost:9093 -tls1
make sure you change the port where the broker is running the SSL.
More details are here
http://kafka.apache.org/documentati
i getting below warning while doing produce from client side which is
connecting to server side which contains SSL based authentication.
*[2016-03-10 07:09:13,018] WARN The configuration ssl.keystore.location =
/etc/pki/tls/certs/keystore-hpfs.jks was supplied but isn't a known config.
(org.apache
I have a Kafka infrastructure in which there is 1 topic (T) with 1 partition
and replication factor 2. There are 2 brokers - B1 and B2 in the associated
zookeeper. The two brokers are on two different hosts - host 1 and host 2.
The leader is on host1, which is defined to be local in context of a p
Hi,
I have a Kafka infrastructure in which there is 1 topic (T) with 1
partition and replication factor 2. There are 2 brokers - B1 and B2 in the
associated zookeeper. The two brokers are on two different hosts - host 1
and host 2. The leader is on host1, which is defined to be local in context
Producer.send() by itself will not throw anything.
You need to either wait on the future:
producer.send().get()
Or to use it with a callback that logs the error.
On Tue, Jan 26, 2016 at 8:50 AM, Joe San wrote:
> Is this strange or wierd? I had no Kafka or Zookeeper running on my local
> machin
Is this strange or wierd? I had no Kafka or Zookeeper running on my local
machine and I was expecting an exception, but for some strange reason, I do
not see any errors:
try {
logger.info(s"kafka producer obtained is ${producer}")
producer.send(
new ProducerRecord[String, String](producerC
I keep seeing this error while creating topic :
Error is: replication factor: 3 larger than available brokers: 2
I have 4 kafka nodes, and replication factor of 3.
2 nodes on datacenter 1, 2 on datacenter 2 running kafka 0.8.2.0.
Hi all,
I am currently working on logstash to mongodb.logstash's input
(producer) is kafka and output (consumer) is mongodb.It is worked fine for
past two days.Today it is not working and i got the following error.i
googled this error,still didnt find any correct solution.kindly help me to
gt; Thanks,
> Pradeep Simha
> Technical Lead
>
> -Original Message-
> From: Jun Rao [mailto:jun...@gmail.com]
> Sent: Thursday, July 31, 2014 10:00 AM
> To: users@kafka.apache.org
> Subject: Re: Apache Kafka error on windows - Couldnot find or load main
> class Quoru
: Thursday, July 31, 2014 10:00 AM
To: users@kafka.apache.org
Subject: Re: Apache Kafka error on windows - Couldnot find or load main class
QuorumPeerMain
Is zookeeper jar in your classpath?
Thanks,
Jun
On Wed, Jul 30, 2014 at 6:13 AM, wrote:
> Hi Team,
>
> I just downloaded Kafka 2
Is zookeeper jar in your classpath?
Thanks,
Jun
On Wed, Jul 30, 2014 at 6:13 AM, wrote:
> Hi Team,
>
> I just downloaded Kafka 2.8.0 from Apache website, and I am trying to
> setup using the instructions given on the website. But when I try to start
> zookeper server, I am getting below error
: Apache Kafka error on windows - Couldnot find or load main class
QuorumPeerMain
Hi Team,
I just downloaded Kafka 2.8.0 from Apache website, and I am trying to setup
using the instructions given on the website. But when I try to start zookeper
server, I am getting below error:
Error: Could not
Hi Team,
I just downloaded Kafka 2.8.0 from Apache website, and I am trying to setup
using the instructions given on the website. But when I try to start zookeper
server, I am getting below error:
Error: Could not find or load main class
org.apache.zookeeper.server.quorum.QuorumPeerMain
M
30 matches
Mail list logo