Hi Ewen,
Thanks for your response. I'll experiment and benchmark it with the normal
proxy and NGinx as well and update the results.
Regards,
prabcs
On Mon, Jul 27, 2015 at 11:10 PM, Ewen Cheslack-Postava
wrote:
> Hi Prabhjot,
>
> Confluent has a REST proxy with docs that may give some guidance
You need the jline JAR file that ships with ZooKeeper.
Chris
IBM Tivoli Systems
Research Triangle Park, NC
(919) 224-2240
Internet: barl...@us.ibm.com
From: Prabhjot Bharaj
To: users@kafka.apache.org, u...@zookeeper.apache.org
Date: 07/29/2015 01:13 PM
Subject:Connection to z
I'm a user of Kafka/ZooKeeper not one of its developers, so I can't give
you a technical explanation. I do agree that Kafka should ship the jline
JAR if its zookeeper-shell depends on it.
Chris
From: Prabhjot Bharaj
To: u...@zookeeper.apache.org, d...@kafka.apache.org
Cc: users@k
Mirror Maker does not have specific restrictions on cluster size.
The error you saw was because consumer was not able to talk to the broker.
Can you try to use kafka-console-consumer to consume some data from your
source cluster and see if it works? It should be under KAFKA_HOME/bin/
Jiangjie (Be
?My understanding is that the group id indicated to a consumer constructor is
an arbitrary string of my own choosing on the client side, at the time of
construction, which will "group" committed offsets for any set of such
consumers. But the offsets() function, which is merely a query function
I got it. It has been tricky getting both consumer classes to work since they
are not very similar. I configured one incorrectly because they take the
arguments in different orders (in one topic comes before group and in the other
that order is reversed). Now that it works, I can also see tha
Have you tried not setting a group_id in SimpleConsumer? If you have stored
offsets in ZK for that group, and those offsets still exist on the server,
the consumer will use them and not 'reset'. My hunch is that is your
problem. You might also consider enabling kafka debug logs (though not for
the
Sure. It would be great if you could as well explain the reason why the
absence of the jar creates this problem
Also, I'm surprised that zookeeper that comes bundled with kafka 0.8.2 does
not have the jline jar
Regards,
prabcs
On Wed, Jul 29, 2015 at 10:45 PM, Chris Barlock wrote:
> You need t
Hi folks,
*/kafka/bin# ./zookeeper-shell.sh localhost:2182/*
*Connecting to localhost:2182/*
*Welcome to ZooKeeper!*
*JLine support is disabled*
*WATCHER::*
*WatchedEvent state:SyncConnected type:None path:null*
**
I'm running 5 node zookeeper cluster on 5-node kafka cluster (each kafk
Thanks. I got it to work if I use KafkaConsumer. I doesn't yet work with
SimpleConsumer, and that includes seeking to 0,0. I'm curious what that isn't
getting it going. It's frustrating because SimpleConsumer supports seek while
KafkaConsumer doesn't offer a seek function, but at the same ti
Are you using mumrah/kafka-python? I think so from context but I know
there's at least one other implementation rattling around these days. (-:
If that's what you're using, I can see two potential problems you might be
having. You can set the offset to some approximation of wherever you
Oh, I'm sorry. If I use the KafkaConsumer class instead of the SimpleConsumer
class (as you suggested) it works. Frustratingly, SimpleConsumer will take the
auto_offset_reset parameter without complaining that no such parameter exists,
yet it doesn't work properly! But KafkaConsumer works, so
I'm still not getting the necessary behavior. If I run on the command line, I
get a series of messages:
$ ./kafka-console-consumer.sh --zookeeper w.x.y.z:p --topic test
--from-beginning
Test
test
tests
asdf
If I exclude the --from-beginning argument then it hangs, which indic
On Tue, Jul 28, 2015 at 11:29 PM, Nilesh Chhapru <
nilesh.chha...@ugamsolutions.com> wrote:
> Hi Ewen,
>
> Thanks for reply.
> The assumptions that you made for replication and partitions are
> correct, 120 is total number of partitions and replication factor is 1
> for all the topics.
>
> Does th
14 matches
Mail list logo
