*'Not that partitioning means Kafka only provides a total order over
messages within a partition. This combined with the ability to partition
data by key is sufficient for the vast majority of applications. However,
if you require a total order over messages this can be achieved with a
topic that h
Publisher (using librdkafka C api) has sent both gzip and snappy compressed
messages. I find that the java Simple Consumer (
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example#)
is unable to read the snappy ones, while the High Level one is. Is this
expected? Is ther
Publisher (using librdkafka C api) has sent both gzip and snappy compressed
messages. I find that the java Simple Consumer (
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example#)
is unable to read the snappy ones, while the High Level one is. Is this
expected? Is ther
On Wed, Feb 26, 2014 at 5:58 PM, Dan Hoffman
> >
> wrote:
>
> > Publisher (using librdkafka C api) has sent both gzip and snappy
> compressed
> > messages. I find that the java Simple Consumer (
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA
The kafka-console-consumer is fine.
On Wednesday, February 26, 2014, Neha Narkhede
wrote:
> Actually I meant the simple consumer shell that ships with kafka in the bin
> directory.
>
>
> On Wed, Feb 26, 2014 at 6:17 PM, Dan Hoffman wrote:
>
> > I haven't tried
gt;
> On Wed, Feb 26, 2014 at 5:40 PM, Dan Hoffman wrote:
>
> > Publisher (using librdkafka C api) has sent both gzip and snappy
> compressed
> > messages. I find that the java Simple Consumer (
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+
ast parameter in the following call larger (say to
> 1,000,000).
>
> .addFetch(a_topic, a_partition, readOffset, 10)
>
> Thanks,
>
> Jun
>
>
> On Wed, Feb 26, 2014 at 9:32 PM, Dan Hoffman wrote:
>
> > I'm not sure what you mean - could you be more speci
Let's say I have a running cluster and users/apps are pounding away at it.
Is there a quick and easy way to measure its current throughput? I know
there are utilities for generating volume to get stats, but I'd like to
simply get some stats about its current operation. Is there a good way to
do
gt;
> On Thu, Feb 27, 2014 at 7:50 PM, Dan Hoffman wrote:
>
> > Let's say I have a running cluster and users/apps are pounding away at
> it.
> > Is there a quick and easy way to measure its current throughput? I
> know
> > there are utilities for generatin
ance of an existing Kafka cluster?
The jmx beans will expose the metrics per broker. You would need some
utility to aggregate across all brokers in a cluster.
Thanks,
Neha
On Thu, Feb 27, 2014 at 8:31 PM, Dan Hoffman wrote:
> Are the numbers for the entire cluster or just the broker connecte
Claude,
FYI I've submitted a few issues for you to look at/consider.
Dan
On Saturday, March 1, 2014, Claude Mamo wrote:
> Announcing the first release of Kafka Web Console:
> https://github.com/claudemamo/kafka-web-console/tree/v1.0. Tested on
> Chrome.
>
> Enjoy,
>
> Claude
>
Hi - am I right in that for this tool to be effective, consumers must be
using the high level consumer or otherwise keeping their offsets in
zookeeper? Is there any way to track performance without that?
On Fri, Mar 7, 2014 at 3:08 PM, Steve Morin wrote:
> Very nice
>
> > On Mar 7, 2014, at 11
Curious- does your impl require Cygwin? If not, I'd love to use it
On Wednesday, March 19, 2014, Tianning Zhang
wrote:
> Dear all,
>
> I am writing to this list to check if there is any new progress concerning
> 0.8 Windows C++ clients and if there are experiences we can share.
>
> My company (
eparate generic part from our proprietary resources/Apis
> and make it public,
>
> KR
>
> Tianning
>
> ------------
> Dan Hoffman > schrieb am Mi,
> 19.3.2014:
>
> Betreff: Re: Kafka C++ Windows Client for 0.8 Releases
> An: &q
Hi- wondering if anyone knows of a working .net API for kafka. Last time I
checked only .7 was available. At this point only publishing/no consumption
required.
Has anyone implemented anything? We'd like to restrict access to
individual topics, etc
Why not use the snappy/gzip compression?
On Saturday, March 22, 2014, Vishal Kapoor
wrote:
> Hello,
>
> We are in the process of building a general purpose messaging system, our
> messages are in xml format to start with, and usually are longer than 1 mb,
> what are the best practices around bre
17 matches
Mail list logo
