Hey Onur,
I was just watching your talk on rebalancing from last year -
https://www.youtube.com/watch?v=QaeXDh12EhE
Nice talk!.
I think I have an idea as to why it takes 1 hr in my case based on the talk
in the video. In my case with 32 boxes / consumers from the same group, I
believe the current
Yes
On Fri, Feb 17, 2017 at 10:06 PM, Jeff Widman wrote:
> Will this new release use a new consumer?
>
> On Feb 16, 2017 11:33 PM, wrote:
>
> > You can't integrate 3.1.1 REST Proxy with a secure cluster because it
> uses
> > the old consumer API (hence zookeeper dependency). The 3.2 REST Proxy
Will this new release use a new consumer?
On Feb 16, 2017 11:33 PM, wrote:
> You can't integrate 3.1.1 REST Proxy with a secure cluster because it uses
> the old consumer API (hence zookeeper dependency). The 3.2 REST Proxy will
> allow you to integrate with a secure cluster because it is update
Hi,
Regrading
0. "frequent rebalance and dying of threads": did you see any warn / error
log entries or exceptions when threads die or rebalance is triggered?
The exception we get is CommitFailedException and then on partition revoke
also it throws CommitFailedException and stream thread is killed
Can you reproduce this with the latest version of Kafka?
best,
Colin
On Wed, Feb 15, 2017, at 22:29, 揣立武 wrote:
>
> Hi,all! Our program uses the high level consumer api(the version is
> 0.8.x). Sometimes the program will throw an exception in the 42th row in
> kafka.utils.IteratorTemplate class
Hi Sachin,
0. "frequent rebalance and dying of threads": did you see any warn / error
log entries or exceptions when threads die or rebalance is triggered?
My guess is that you are likely hitting this issue: https://issues.apache.o
rg/jira/browse/KAFKA-3775
The scenario is that, when you are sta
Hi,
Just to be clear, HDFS doesn't use HTTP or HTTPS as its primary
transport mechanism. Instead, HDFS uses the Hadoop RPC transport
mechanism. So in general, it should not be necessary to configure SSL
to connect a client to HDFS.
HDFS does "support SSL" in the sense that the HDFS web UI can b
Hi
It seems that your keytab doesn't have the principal you configured your
"client" section to use. Post your jaas here if you want further help but
basically you should be able to do
kinit -V -k -t
On 18 Feb. 2017 3:56 am, "Raghav" wrote:
Hi
I am trying to setup a simple setup with one K
Hello Ara,
I'm wondering what this KTable is used for (e.g. join, aggregation, etc)?
And is the usage of TTL is because your computational logic can safely
ignore key-value pairs that has existed for 24 hours, or is it purely for
bounding the state store space usage (for this end, what is your cur
Hi Kafka Users,
We are using kafka 0.9.0.1 and frequently we have seen below exception which
causes the broker to die.We even increased the MaxDirectMemory to 1G but still
see this.
2017-02-16 00:55:57,750] ERROR Processor got uncaught exception.
(kafka.network.Processor)
java.lang.OutOfMemoryE
Hi,
Based on a quick look at the code, the log.flush.interval.messages
setting affects how frequently we call fsync on the underlying
filesystem. As you mentioned, by default this is set to Long.MAX_VALUE,
which effectively disables it.
Keep in mind that the underlying operating system will flus
Hi
I am trying to setup a simple setup with one Kafka broker, and zookeeper on
the same VM. One producer and one consumer on each VM. I have setup a KDC
on cents VM.
I am trying to following this guide:
http://docs.confluent.io/2.0.0/kafka/sasl.html#kerberos
When I start Kafka, it errors out wit
Is it possible that using the same group name for two topics could cause a
conflict?
I have a situation where Im seeing vast numbers of records (more than 2x)
get duplicated in a topic. I was looking at consumer lag using
'kafka-consumer-groups ... --new-consumer' and noticed that I had another
ap
Hi Deepak,
Could you tell us a bit more on what your app is doing (e.g., aggregates, or
joins)? Also which version of Kafka are you using?
Have you changed any default configs?
Thanks
Eno
> On 17 Feb 2017, at 05:30, Deepak Pengoria wrote:
>
> Hi,
> I ran my application on AWS machine having
Hi,
according to the feedback, I've updated the KIP:
- We have added and ordered the scenarios, scopes and executions of the
Reset Offset tool.
- Consider it as an extension to the current `ConsumerGroupCommand` tool
- Execution will be possible without generating JSON files.
https://cwiki.apach
Hi,
I am now starting with rocksdb monitoring and comparing 2 identical streams
with 2 identical input topics.
Case1
Single partition topic with single thread streams apps running 0.10.1.1
This case is pretty stable with hardly any cpu wait time noticed.
Case 2
12 partition topic with 3 instances
Hi,
I ran my application on AWS machine having 32GB ram. This application is
written in Java using Kafka-Streaming low level api. When I ran it for 72
hours or more and load (messages) are keep on pumping to kafka-topic then
entire memory i.e. 32 GB of aws machine gets exhausted. While I ran my jav
I look forward to that release ! Thanks Hans
On 17 Feb. 2017 6:33 pm, wrote:
> You can't integrate 3.1.1 REST Proxy with a secure cluster because it uses
> the old consumer API (hence zookeeper dependency). The 3.2 REST Proxy will
> allow you to integrate with a secure cluster because it is upda
18 matches
Mail list logo
