Hi,
Does anyone have a pointer for a good Kafka-Camel library ?
I've been trying the one available here :
https://github.com/BreizhBeans/camel-kafka but it has some annoying limitations
like the choice of the serializer.
I'm about to create something from scratch or fork an existing project, s
Hi,
I'd like a few details about consumers (high level) and producers (both sync
and async), I'm using Kafka 0.7.2.
Basically, who and how is managing network disconnection / outage ? For
example, I've been playing with sync producer, and I realized that it can't be
created when there's a netw
Yes, this is fixed in 0.8. The plan is to only fix blocker issues in 0.7.
The workaround of this issue is to manually create the topic dir on disk on
the new broker.
Thanks,
Jun
On Mon, Apr 29, 2013 at 5:47 PM, Matthew Rathbone wrote:
> Hey guys,
>
> I think I remember this being a known issue
Hey guys,
I think I remember this being a known issue, but thought I should ping the
list anyway.
I just added a new broker to the cluster (0.7.1), but it won't start
receiving data until I manually create the topic directories in the log
directory.
Is there a patch for this I can use? I presume
Thanks. I also updated your producer example to reflect a recent config
change (broker.list => metadata.broker.list).
Jun
On Mon, Apr 29, 2013 at 11:19 AM, Chris Curtin wrote:
> Thanks, I missed that the addition of consumers can cause a re-balance.
> Thought it was only on Leader changes.
>
>
I'm getting an error when I execute "./sbt publish-package":
[error] javadoc: error - invalid flag: -Xlint:deprecation
I'm using jdk1.7.0_21.
Steps to Reproduce:
git clone https://git-wip-us.apache.org/repos/asf/kafka.git
cd kafka
git checkout -b 0.8 remotes/origin/0.8
./sbt publish-local
Am I d
Thanks, I missed that the addition of consumers can cause a re-balance.
Thought it was only on Leader changes.
I've updated the wording in the example.
I'll pull down the beta and test my application then change the names on
the properties.
Thanks,
Chris
On Mon, Apr 29, 2013 at 11:58 AM, Jun
Our sbt already supports publishing to a maven endpoint. Not sure if that
works with Apache maven repo. We may need to manually upload to Apache
maven repo.
Thanks,
Jun
On Mon, Apr 29, 2013 at 9:19 AM, Soby Chacko wrote:
> Any status on the mavenization of 0.8?
>
>
> On Mon, Apr 29, 2013 at 1
Any status on the mavenization of 0.8?
On Mon, Apr 29, 2013 at 11:04 AM, Jun Rao wrote:
> Yes.
>
> Thanks,
>
> Jun
>
>
> On Mon, Apr 29, 2013 at 6:13 AM, Oleg Ruchovets >wrote:
>
> > Does Kafka 0.8 become official beta?
> >
> >
> > On Mon, Apr 29, 2013 at 8:52 AM, Jun Rao wrote:
> >
> > > We
Basically, every time a consumer joins a group, every consumer in the
groups gets a ZK notification and each of them tries to own a subset of the
total number of partitions. A given partition is only assigned to one of
the consumers in the same group. Once the ownership is determined, each
consumer
Jun, can you explain this a little better? I thought when using Consumer
Groups that on startup Kafka connects to ZooKeeper and finds the last read
offset for every partition in the topic being requested for the group. That
is then the starting point for the consumer threads.
If a second process s
Yes.
Thanks,
Jun
On Mon, Apr 29, 2013 at 6:13 AM, Oleg Ruchovets wrote:
> Does Kafka 0.8 become official beta?
>
>
> On Mon, Apr 29, 2013 at 8:52 AM, Jun Rao wrote:
>
> > We have updated the 0.8 documentation in our website (
> > http://kafka.apache.org/index.html). Please review the docs. We
Chris,
Thanks for the writeup. Looks great overall. A couple of comments.
1. At the beginning, it sounds like that one can't run multiple processes
of consumers in the same group. This is actually not true. We can create
multiple instances of consumers for the same group in the same JVM or
differ
Does Kafka 0.8 become official beta?
On Mon, Apr 29, 2013 at 8:52 AM, Jun Rao wrote:
> We have updated the 0.8 documentation in our website (
> http://kafka.apache.org/index.html). Please review the docs. We have the
> following blockers for the 0.8 beta release:
>
> additional docs:
> * exampl
Just added the High Level Consumer example.
On Mon, Apr 29, 2013 at 1:52 AM, Jun Rao wrote:
> We have updated the 0.8 documentation in our website (
> http://kafka.apache.org/index.html). Please review the docs. We have the
> following blockers for the 0.8 beta release:
>
> additional docs:
> *
Hi Jun,
I finished and published it this morning:
https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example
One question: when documenting the ConsumerConfig parameters I couldn't
find a description for the 'auto.commit.interval.ms' setting. I found one
for 'autocommit.interval.ms
16 matches
Mail list logo
