ollowers.
>
>
> On Mon, Apr 28, 2014 at 11:50 AM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > After restarting it start working fine.
> >
> > What i understand from this scenario is:
> >
> > There must be atleast 2 brokers in i
in synchronization process and
meanwhile a node goes down then topic may go to unstable state.
Please let me know if i am missing anything.
On Mon, Apr 28, 2014 at 9:19 PM, Hanish Bansal <
hanish.bansal.agar...@gmail.com> wrote:
> After restarting it start working fine.
>
> Wh
gt; On Sun, Apr 27, 2014 at 11:58 PM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi All,
> >
> > I have 3 nodes kafka cluster with below configuration:
> >
> > Replication factor: 2
> > Number of partitions: 6
> >
> >
partition: 3leader: -1 replicas: 1,0 isr:
topic: notification partition: 4leader: 2 replicas: 2,1
isr: 2
topic: notification partition: 5leader: 2 replicas: 0,2
isr: 2,0
Please let me know why i am facing this behaviour ?
--
*Thanks & Regards*
*Ha
> > >
> > > > >
> > > > > On Tue, Jan 14, 2014 at 2:29 PM, Guozhang Wang >
> > > > wrote:
> > > > >
> > > > > > Hanish and Francois,
> > > > > >
> > > > > &
>
> > > > >
> > > > > On Tue, Dec 17, 2013 at 2:39 PM, Francois Langelier <
> > > > > francois.langel...@mate1inc.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I installed zookeeper and kafka 8.0 following the quick start (
> > > > > > https://kafka.apache.org/documentation.html#quickstart) and
> when i
> > > try
> > > > > to
> > > > > > kill my leader, i got a lot of exception in my producer and
> > consumer
> > > > > > consoles.
> > > > > >
> > > > > > Then, after the exceptions stop printing, some of the messages I
> > > > produce
> > > > > in
> > > > > > my console don't print in my consumer console...
> > > > > >
> > > > > > The exception I get is "java.net.ConnectException : Connection
> > > > refused".
> > > > > >
> > > > > > Did someone already had this problem?
> > > > > >
> > > > > > Thank you!
> > > > > >
> > > > > > PS: I have 3 brokers running on my system.
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > -- Guozhang
> > >
> >
>
>
>
> --
> -- Guozhang
>
--
*Thanks & Regards*
*Hanish Bansal*
esolve this in incoming releases ?
Thanks in advance !!
--
*Regards*
*Hanish Bansal*
;
>
> On Mon, Dec 30, 2013 at 7:56 PM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > As default zookeeper.session.timeout.ms is 6000 and i look into the
> > details
> > this value is negotiable. We try to set this value to less than 4000 to
>
sers@kafka.apache.org
> > Subject: Re: ConsumerRebalanceFailedException
> >
> > If the consumer is not shut down properly, it will take
> > zookeeper.session.timeout.ms before the consumer is deregistered from
> ZK.
> > If you restart the consumer before that, rebalances may fail.
> &g
0
If i kill the consumer and start that again after 5-6 sec then it started
working properly without throwing any exception.
If i start consumer immediately after killing that then
ConsumerRebalanceFailedException occurs.
Please help !!
--
*Thanks & Regards*
*Hanish Bansal*
a and describe the process to reproduce?
>
> Guozhang
>
>
> On Mon, Dec 23, 2013 at 7:42 PM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Sorry last message was sent by mistake.
> >
> > Hi Guazhang,
> >
> > Please find my c
w-notes-on-kafka-and-jepsen
>
> Guozhang
>
>
>
>
> On Sun, Dec 22, 2013 at 10:38 PM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi Guazhang,
> >
> > When both nodes are alive then topic isr status is:
> >
> > topic
tus which is:
> If you want to read more I would recommend this blog about Kafka's
> guarantee:
>
> http://blog.empathybox.com/post/62279088548/a-few-notes-on-kafka-and-jepsen
>
> Guozhang
>
>
>
>
> On Sun, Dec 22, 2013 at 10:38 PM, Hanish Bansal <
> hani
is alive for %s. Elect leader %d from live brokers %s.
> There's potential data loss."
>
> Guozhang
>
>
> On Fri, Dec 20, 2013 at 9:11 AM, Jun Rao wrote:
>
> > Could you reproduce this easily? If so, could you file a jira and
> describe
> > the steps?
&
Yes, please go ahead.
>
>
> On Thu, Dec 19, 2013 at 2:30 AM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi Guazhang,
> >
> > Can I try it now with trunk HEAD kafka code after applying the patch
> > KAFKA-1188.patch<
> >
&g
s of re-giggling and the time there is going to be related to how
> > many partitions and brokers you have.
> >
> > On Wed, Dec 18, 2013 at 2:49 PM, Robert Rodgers
> > wrote:
> >
> > > what happens if the physical machine dies or the kernel panics?
> > &
case) using 6 producer instances from a single
> box sending to 3 kafka servers.
>
> e.g.
>
>
> send ( msg ) {
> producers[ producer-index.getAndIncrement() % producer_count ].send(msg)
> }
>
> Regards,
> Gerrit
>
>
> On Wed, Dec 18, 2013 at 11:24 AM, Han
> > >
> > > Did you "kill -9" one of the brokers only or bouncing them iteratively?
> > >
> > > Guozhang
> > >
> > >
> > > On Wed, Dec 18, 2013 at 8:02 AM, Joe Stein
> wrote:
> > >
> > &g
of the brokers only or bouncing them iteratively?
> >
> > Guozhang
> >
> >
> > On Wed, Dec 18, 2013 at 8:02 AM, Joe Stein wrote:
> >
> > > How many replicas do you have?
> > >
> > >
> > > On Wed, Dec 18, 2013 a
age.send.max.retries" in
> producer config.
>
> Regards,
> Pushkar
>
>
> On Wed, Dec 18, 2013 at 5:34 PM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi All,
> >
> > We are having kafka cluster of 2 nodes. (using 0.8.0 fi
t; then still
facing data loss even after configuring request.required.acks to -1.
Any suggestions?
--
*Thanks & Regards*
*Hanish Bansal*
oss partitions.
> >
> >
> >
> https://github.com/gerritjvv/pseidon/blob/master/pseidon-kafka/java/pseidon/kafka/util/RoundRobinPartitioner.java
> >
> >
> >
> >
> >
> > On Tue, Dec 17, 2013 at 5:32 PM, Hanish Bansal <
> > hanish.bansal.agar...
ample if i insert 1000 messages then all 1000 messages will go either
node1 or node2. Data is not evenly distributed on both nodes.
Expected: 500 messages should go to node1 and 500 messages should go to
node2.
Any suggestion why i am facing this behavior?
--
*Thanks & Regards*
*Hanish Bansal*
binary up on the download page, same like if you
> were using the python or c++ client with the broker another scala version
> is alright for the client
>
> On Thu, Dec 12, 2013 at 7:25 AM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi Joe,
> &
**
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********/
>
>
> On Thu, Dec 12, 20
?
Thanks in advance !!
--
*Thanks & Regards*
*Hanish Bansal*
gt; partition. But no total throughput I think
> >>>>
> >>>> 发自我的 iPhone
> >>>>
> >>>>> 在 Nov 15, 2013，8:08 AM，"Maier, Dr. Andreas" <
> andreas.ma...@asideas.de>
> >>>> 写道：
> >>>>>
> >>>>> Hello,
> >>>>>
> >>>>> Is it possible to see the list of topics in Kafka using JMX
> >>>>> like it is possible using the kafka-list-topic.sh command?
> >>>>>
> >>>>> In addition is it possible to see the number of messages
> >>>>> stored for a topic in kafka using JMX?
> >>>>>
> >>>>> I couldn't find anything about that in the documentation:
> >>>>> http://kafka.apache.org/documentation.html#monitoring.
> >>>>>
> >>>>> Sincerely,
> >>>>> Andreas Maier
> >>>>>
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> *Moniii*
> >>
> >>
> >
> >
> > --
> > *Moniii*
>
>
--
*Thanks & Regards*
*Hanish Bansal*
No. We are using binary of kafka "0.8.0 Beta1 Release".
On Wed, Oct 30, 2013 at 8:26 PM, Jun Rao wrote:
> Are you running the latest code from the 0.8 branch?
>
> Thanks,
>
> Jun
>
>
> On Tue, Oct 29, 2013 at 10:47 PM, Hanish Bansal <
> hanish.bansa
No, it doesn't throw any exception. Consumer goes to halt state and after
restarting it again starts consuming the data.
On Wed, Oct 30, 2013 at 9:37 AM, Jun Rao wrote:
> Any exception/error from the consumer?
>
> Thanks,
>
> Jun
>
>
> On Tue, Oct 29, 2
Hi All,
We are running kafka-0.8, If kafka node machine's network is restarted or
lost for some time, then high level consumer stop reading data from kafka
even after the network is restarted/working.
--
*Thanks & Regards*
*Hanish Bansal*
gt; > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > NOTE: This message may contain information that is confidential,
> > > > proprietary, privileged or otherwise protected by law. The message is
> > > > intended solely for the named addressee. If received in error, please
> > > > destroy and notify the sender. Any use of this email is prohibited
> when
> > > > received in error. Impetus does not represent, warrant and/or
> > guarantee,
> > > > that the integrity of this communication has been maintained nor that
> > the
> > > > communication is free of errors, virus, interception or interference.
> > > >
> > >
> >
> >
> >
> > --
> > Thanks,
> > Raja.
> >
>
--
*Thanks & Regards*
*Hanish Bansal*
or all
> leaders are on one broker, not all metrics (e.g., produce/fetch rate) will
> show up on both brokers.
>
> Thanks,
>
> Jun
>
>
> On Mon, Jul 29, 2013 at 6:04 AM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi All,
> >
> &
will it be visible on
jconsole or not ?
On Wed, Jul 3, 2013 at 1:06 PM, Hanish Bansal <
hanish.bansal.agar...@gmail.com> wrote:
> Thanks Jun
>
>
> On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao wrote:
>
>> In 0.8, there are more mbeans than 0.7.
>>
>> Thanks,
t; Jun
>
>
> On Thu, Jul 4, 2013 at 7:53 PM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi All,
> >
> > I am using *Kafka-0.7.2 *in distributed mode.
> >
> > Now i want to upgrade Kafka version to recent stable release-*0.8 B
Hi Jun,
Thanks a lot for your reply.
You can figure out the instance from the
> config dir in the command line.
>
What does this mean? Can you explain a bit how can it be figured out?
Regards,
Hanish
> On Thu, Jul 4, 2013 at 7:20 AM, Hanish Bansal <
> hanish.bansal.agar...@g
upgrade whole cluster to new Kafka version then will it be consistent
with previous data ?
--
*Thanks & Regards*
*Hanish Bansal*
configurations i.e. their home directories will be different.
I want to start a specific Kafka instance if any one of the two gets
killed. So I wanted to know which Kafka instance is down.
So, how I can I get the PID of a particular Kafka instance ?
Thanks in advance.
--
*Thanks & Regards*
*Ha
Apologise for putting query in wrong mailing-list by mistake.
On Thu, Jul 4, 2013 at 2:07 PM, Hanish Bansal <
hanish.bansal.agar...@gmail.com> wrote:
> Hi All,
>
> I am using HBase in distributed mode. A number of master and regionserver
> nodes are running on different machin
upgrade HBase and on another machines
old HBase version are running. Will it create any problem?
If i upgrade whole cluster to new HBase version then will it be consistent
with previous data?
--
*Thanks & Regards*
*Hanish Bansal*
Thanks Jun
On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao wrote:
> In 0.8, there are more mbeans than 0.7.
>
> Thanks,
>
> Jun
>
>
> On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Okay i'll try for sa
morning. What is the best way to monitor kafka through jmx or by
> > >> enabling kafka.csv.metrics.reporter.enabled?
> > >> What are the important metrics in JMX to watch for and/or graph?
> > >> What are the important metrics in csv files to watch for and/or graph?
> > >>
> > >> Thanks,
> > >> Vadim
> >
>
--
*Thanks & Regards*
*Hanish Bansal*
Jun
>
>
> On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi
> >
> > I am getting various kafka parameters (like NumFetchRequests,
> > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in
&
cess);
System.out.println(query1.getResults());
Please let me know what i am missing?
--
*Thanks & Regards*
*Hanish Bansal*
a 0.8 Failover Behavior".
>
> Let us know how it works for you.
>
> Cheers!
>
> Florin
>
> On 6/24/13 4:21 AM, "Hanish Bansal"
> wrote:
>
> >Hi
> >
> >I am implementing autostart service for kafka which will check kafka's
> >st
that kafka is running but not giving any response for
sometime ?
Any suggestion will be helpful.
--
*Thanks & Regards*
*Hanish Bansal*
Thanks for response :)
Its really helpful.
On Thu, Jun 20, 2013 at 3:59 AM, Jun Rao wrote:
> TotalFetchRequestMs is probably not important. AvgFetchRequestMs and
> MaxFetchRequestMs
> are and they are in millisecs.
>
> Thanks,
>
> Jun
>
>
> On Wed, Jun 19,
Tue, Jun 18, 2013 at 9:55 AM, Jun Rao wrote:
> Correct, except that they are millisecs.
>
> Thanks,
>
> Jun
>
>
> On Mon, Jun 17, 2013 at 1:29 AM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi Jun
> >
> > As per my unde
right or missing something ?
On Sun, Jun 16, 2013 at 9:25 AM, Jun Rao wrote:
> The important metrics are byte rate and message rate in both the clients
> and the broker.
>
> Thanks,
>
> Jun
>
>
> On Sat, Jun 15, 2013 at 9:44 AM, Hanish Bansal <
> hanish.bansal.agar.
ervice is up.
>
> Thanks,
>
> Jun
>
>
> On Fri, Jun 14, 2013 at 8:22 AM, Hanish Bansal <
> hanish.bansal.agar...@gmail.com> wrote:
>
> > Hi
> >
> > I'm trying to fetch Kafka stats using JMX and able to fetch the
> parameters
> > mentioned
hanks & Regards*
*Hanish Bansal*
chRequests();
socketServerStats.getProduceRequestsPerSecond();
But its not giving any values.
Any suggestion will be helpful for me.
--
*Thanks & Regards*
*Hanish Bansal*
51 matches
Mail list logo
