Hi Jun,
I did put in only one topic while starting the consumer and have used the same
API "createMessageStreams".
As for the trace level logs of kafka consumer, we will send that to you soon.
Thanks again for replying.
Nihit
On 10-Jul-2013, at 10:38 PM, Jun Rao wrote:
> Also, just so that w
Thanks Jun, done. I've created KAFKA-972 issue for that.
Regards
On Thu, Jul 11, 2013 at 1:16 AM, Jun Rao wrote:
> That's actually not expected. We should only return live brokers to the
> client. It seems that we never clear the live broker cache in the brokers.
> This is a bug. Could you fil
Yes.
Thanks,
Jun
On Wed, Jul 10, 2013 at 10:55 PM, Ryan Chan wrote:
> We are already using "zk.connect" to connect zookeeper and registered
> multiple brokers (same topic/partitions), so when a consumer request ZK, is
> load balancing already done?
>
>
>
> Thanks
>
The consumer iterator by default blocks if there are no new messages. You
can configure it to be non-blocking. See consumer.timeout.ms
http://kafka.apache.org/08/configuration.html
Thanks,
Jun
On Wed, Jul 10, 2013 at 11:55 PM, Ankit Jain wrote:
> Hi all,
>
> I have a Kafka 0.8 cluster of two n
Hm... the cache may explain some odd behavior I was seeing in our
cluster yesterday.
The zookeeper information for which nodes were In Sync Replicas was
different that the data I received from a metadata request response.
Zookeeper said two nodes were ISR and the metadata response said only
the le
We need to improve how the metadata caching works in kafka. Currently, we
have multiple places where we send the updated metadata to the individual
brokers from the controller when the state of the metadata changes. This
is hard to track. What we need to implement is to let the metadata
structure i
Hi
We have integrated kafka consumer and producer into our java application.
We've noticed some issues when loading classes. And it seems it is caused by
different JDK versions. So I wonder which version of JDK is recommended
for developing kafka clients.
Regards,
Libo
As i know , don't care, is it right?
but if you need version, recommend 1.6
because i have been using it since last year with kafka 0.7
2013. 7. 12. 오전 4:01 "Yu, Libo " 작성:
> Hi
>
> We have integrated kafka consumer and producer into our java application.
> We've noticed some issues when load
Probably it is very incomplete. I copied over much of the content from 0.7
that is still applicable, but I added the following:
1. A section on data centers and mirroring
2. Removed the cut-and-pasted scala code in the monitoring section and just
gave a high-level description of what we monitor
3.
What I am talking about is kafka 0.8. There should be a version requirement
as you cannot expect scala byte code is compatible with all version JVMs.
Regards,
Libo
-Original Message-
From: 김정민 [mailto:mins...@gmail.com]
Sent: Thursday, July 11, 2013 3:34 PM
To: users@kafka.apache.org
Cc
We are using java 1.6. We have not tested against 1.7 at LinkedIn thought
theoretically it should work. We will probably migrate to 1.7 reasonably
soon.
-Jay
On Thu, Jul 11, 2013 at 12:01 PM, Yu, Libo wrote:
> Hi
>
> We have integrated kafka consumer and producer into our java application.
> W
Thank you, Jay.
When talking about flush rates, I think you mean the opposite of what was
said here:
"However very high application flush rates can lead to high latency when
the flush does occur."
should be
However very low application flush rates (infrequent flushes) can lead to
high latency w
Ack, thanks! Fixed.
-Jay
On Thu, Jul 11, 2013 at 2:22 PM, Roger Hoover wrote:
> Thank you, Jay.
>
> When talking about flush rates, I think you mean the opposite of what was
> said here:
>
> "However very high application flush rates can lead to high latency when
> the flush does occur."
>
> sh
Hi all,
I was wondering if anybody here has and was willing to share experience
about designing and operating complex multi-datacenter/multi-cluster
Kafka deployments in which data must flow from and to several distinct
Kafka clusters with more complex semantics than what MirrorMaker
provides.
Th
Hi,
So, is it possible to configure the weighting? I believe this need to be
done on the zookeeper side, can you give me some hints?
Thanks.
On Thu, Jul 11, 2013 at 11:50 PM, Jun Rao wrote:
> Yes.
>
> Thanks,
>
> Jun
>
>
> On Wed, Jul 10, 2013 at 10:55 PM, Ryan Chan wrote:
>
> > We are alr
We we have at LinkedIn is an extra aggregate cluster per data center. We
use mirror maker to copy data from the local cluster in each of the data
centers to the aggregate one.
Thanks,
Jun
On Thu, Jul 11, 2013 at 5:18 PM, Maxime Petazzoni wrote:
> Hi all,
>
> I was wondering if anybody here ha
Currently, the balancing logic in the high level consumer is not
configurable. There is a low level SimpleConsumer that you can use to gain
more control, but it needs more coding.
Thanks,
Jun
On Thu, Jul 11, 2013 at 9:05 PM, Ryan Chan wrote:
> Hi,
>
> So, is it possible to configure the weigh
17 matches
Mail list logo
