Hi
I have a doubt on the parallelism. Why the number of parallel consumer
consuming messages from a topic is restricted on the number of partitions
configured for a topic?
Why should this be the case. Why should the partition affect the number of
parallel consumers?
Thanks
Bala
Sorry.
Since I used maven for dependency, Kafka is included as JAR.
In this case, are there any way to turn off it?
Thanks
Regards
Dongkyoung.
2014-03-05 13:21 GMT+09:00 Jun Rao :
> Just change config/log4j/properties inside Kafka.
>
> Thanks,
>
> Jun
>
>
> On Tue, Mar 4, 2014 at 4:09 PM, 김동경
Hi Bala,
The way Kafka works, each partition is a sequence of messages in the order that
they were produced, and each message has a position (offset) in this sequence.
Kafka brokers don't keep track of which consumer has seen which messages.
Instead, each consumer keeps track of the latest offs
Hi
This is a n00b question.
How do I install it? I'm trying to use it with mysql but sbt start says
"Caused by: java.lang.ClassNotFoundException: com.mysql.jdbc.Driver". I
have a /usr/share/java/mysql-connector-java.jar file and
/usr/share/java/mysql.jar. As it wasn't working, thought about putti
Hi Tomàs, just create a *lib* dir in kafka-web-console's root directory and
put in the necessary JARs, Play will take care of the rest:
http://www.playframework.com/documentation/2.0/Anatomy.
Claude
On Wed, Mar 5, 2014 at 10:50 AM, Tomas Nunez wrote:
> Hi
>
> This is a n00b question.
>
> How d
Jun's suggested design is the closest you can get to achieving a AZ failure
with mirroring. However, one thing I'd like to point out about the
getOffsetsBefore API is the fact that it gives you the approximate offset
for a particular time t. For example, if you ask for an offset of a message
produc
Hi! This is the ezmlm program. I'm managing the
users@kafka.apache.org mailing list.
I'm working for my owner, who can be reached
at users-ow...@kafka.apache.org.
Acknowledgment: The address
arch...@mail-archive.com
was already on the users mailing list when I received
your request, and rema
Just see which log4j property file is included in the java classpath. If
it's not there, you could add one to your classpath.
Thanks,
Jun
On Wed, Mar 5, 2014 at 3:13 AM, 김동경 wrote:
> Sorry.
> Since I used maven for dependency, Kafka is included as JAR.
> In this case, are there any way to tur
Hi, I am new with kafka and using kafka 0.8 to build a distributed queuing
system in amazon web service cluster.
I have 4 machines Z1, B1, B2 and B3. 1 Zookeeper instance is running on Z1
and 3 different brokers are running on B1,B2 and B3 respectively.
I am running 3 producers on 3 broker mach
Hey guys,
I took a stab at updating the docs for the 0.8.1 release. In particular, I
added a section on log compaction:
http://kafka.apache.org/081/documentation.html#compaction
I also updated the configs. This is all under 081, I will flip this over to
be the main documentation when 0.8.1 is rel
Claude,
FYI I've submitted a few issues for you to look at/consider.
Dan
On Saturday, March 1, 2014, Claude Mamo wrote:
> Announcing the first release of Kafka Web Console:
> https://github.com/claudemamo/kafka-web-console/tree/v1.0. Tested on
> Chrome.
>
> Enjoy,
>
> Claude
>
> I am assuming this will reduce the inter-machine message transfer and will
> improve the performance.
>
> My questions are :
>
> 1) Does it really help in improving performance, when message is produced
> and consumed from same machine in a distributed environment.
I doubt that it helps a whol
Thanks Martin.
I got it. The design is considered for Performance improvement. Will there not
be any harm if I have some consumers consuming from the same partitions, if I
can tolerate slowness/performance degradation?
Regards
Bala
-Original Message-
From: Martin Kleppmann [mailto:mklep
Hi,
I have 2 questions about the partition number and key.
1. The produceRequest will explicitly include a partitionNumber, and
messageSet which contains messages with key(can be NULL, used to calculate
partitionNumber when specified). I am assuming all the messages in the
messageSet will be
> I have 2 questions about the partition number and key.
> 1. The produceRequest will explicitly include a partitionNumber, and
> messageSet which contains messages with key(can be NULL, used to calculate
> partitionNumber when specified). I am assuming all the messages in the
> messageSet wil
I understand replication uses a multi-fetch concept to maintain the replicas of
each partition. I have a use case where it might be beneficial to grab a
“batch” of messages from a kafka topic and process them as one unit into a
source system – in my use case, sending the messages to a Flume sour
On Thu, Mar 06, 2014 at 02:27:34AM +, Sandon Jacobs wrote:
> I understand replication uses a multi-fetch concept to maintain the replicas
> of each partition. I have a use case where it might be beneficial to grab a
> “batch” of messages from a kafka topic and process them as one unit into a
Great!
On Thu, Mar 6, 2014 at 12:35 AM, Dan Hoffman wrote:
> Claude,
>
> FYI I've submitted a few issues for you to look at/consider.
>
> Dan
>
> On Saturday, March 1, 2014, Claude Mamo wrote:
>
> > Announcing the first release of Kafka Web Console:
> > https://github.com/claudemamo/kafka-web-
18 matches
Mail list logo
