w
> > could I change this Kafka behaviour during runtime?
> > A problem for the future. Say that dictionaries are so big that they
> don't
> > fit in memory. Are there any patterns for bookkeeping internal data
> > structures and how route to them?
> >
> > T
basically use
> > daemon that parses a log file and send the lines to the Kafka cluster
> > (something like a tail file.log but instead of redirecting the output to
> > the console: send it to kafka)
> >
> > Does anyone knows about something like that?
> >
> &
asure the producer and consumer performance.
>
> --
> Regards
> Selvakumar.V
>
--
David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
<https://twitter.com/dmoralesdf>
<http://www.stratio.com/>
Vía de las dos Castillas, 33, Ática 4, 3ª Planta
28224 Pozuelo de
pure
> wrote:
>
> > Hello
> >
> > I am looking for a reference about shipping kafka as part of Enterprise
> on
> > prem product. Does anyone know if Kafka can be redistributed safely
> and/or
> > is found secure enough to ship as part of enterprise pr
That would be great... we will work on the new kafka version ASAP.
Regards.
2015-02-11 19:45 GMT+01:00 Joe Stein :
> Cool!!!
>
> Maybe on the eco system confluence page we should have a packaging and/or
> distro section
>
> ~ Joestein
>
> On Wed, Feb 11, 2015 a
your packaging script? Deb package for
> kafka 0.8.2 (or any other version for that matter) is sorely missed.
>
> Thanks,
>
> 2015-02-11 21:34 GMT+03:00 David Morales :
> > Regarding RPM/DEB packages, we, at stratio.com, have a public repository
> > which
rote:
>
> > Good evening. Can someone suggest existing framework that allows to
> > reliably load data from kafka into relation database like Oracle in real
> > time?
> >
> > Thanks so much in advance,
> > Vadim
> >
>
--
David Morales de Frías ::
/sparkta/development/
We are open to your ideas and contributors are welcome.
Regards.
--
David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
<https://twitter.com/dmoralesdf>
<http://www.stratio.com/>
Vía de las dos Castillas, 33, Ática 4, 3ª Planta
28224 Pozuelo de Alarcón, Mad
Take a look at the real-time aggregation engine that we offer at Stratio.
Fully open - source, no coding, kafka integration out of the box, based on
spark...
http://docs.stratio.com/modules/sparkta/development/
Regards
El 31/07/2015 16:57, "Todd Snyder" escribió:
> Flume is one of the options
This is a very nice intro to spark and kafka, with some valuable details
about partitioning and parallelism
http://www.michael-noll.com/blog/2014/10/01/kafka-spark-streaming-integration-example-tutorial/
2014-12-05 21:31 GMT+01:00 sanjeeb kumar :
> Hi Team,
> I am able to install Kafka in Ub
Hi there,
I'm trying to create a topic from java code, by calling CreateTopicCommand:
*ZkClient zkClient = new ZkClient(zookeeperCluster, 3, 3);*
*CreateTopicCommand.createTopic(zkClient, topic,
numPartitions.intValue(),replicationFactor.intValue(), "");*
*zkClient.close();*
The prog
erCluster, 3, 3);*
Thanks
2014-02-25 17:25 GMT+01:00 Jun Rao :
> Is the ZK connection string + namespace the same btw the code and the
> script?
>
> Thanks,
>
> Jun
>
>
> On Tue, Feb 25, 2014 at 3:01 AM, David Morales de Frías <
> dmora...@paradigmatecnologico.co
okers in the
> cluster is less than the replication factor at topic creation time.
>
> Thanks,
> Neha
>
>
> On Tue, Feb 25, 2014 at 8:39 AM, David Morales de Frías <
> dmora...@paradigmatecnologico.com> wrote:
>
> > This is the code that i can see i
(),
replicationFactor.intValue(), "");
zkClient.close();
Regards.
2014-02-25 18:50 GMT+01:00 David Morales de Frías <
dmora...@paradigmatecnologico.com>:
> Nope... i have checked this and replication factor is 1. Anyway, when i
> tried to increase this param, an exception
Maybe these pictures can help you:
https://kafka.apache.org/images/log_anatomy.png
http://www.michael-noll.com/blog/uploads/kafka-topics-partitions-replicas.png
http://www.michael-noll.com/blog/uploads/kafka-cluster-overview.png
And of course, this post might help too:
http://www.michael-noll.co
Hi there,
If i start a consumer in a non-existent topic (auto-create true) before the
producer, the consumer never gets the messages.
These are the steps:
1) kafka-console-consumer --topic newTopic (it doesn't exist)
2) kafka-console-producer --topic newTopic
3) Send some messages
4) I can see t
0.8, thanks.
2014-03-06 18:27 GMT+01:00 Jun Rao :
> Which version of Kafka are you using?
>
> Thanks,
>
> Jun
>
>
> On Thu, Mar 6, 2014 at 2:10 AM, David Morales de Frías <
> dmora...@paradigmatecnologico.com> wrote:
>
> > Hi there,
> >
> &g
t; while rebalancing and issuing fetch requests for the topic.
>
> Could you try to run this from scratch (following the quickstart). Ensure
> that the broker and zookeeper have been started successfully.
>
> Thanks,
> Neha
>
>
> On Thu, Mar 6, 2014 at 9:34 AM, David Mor
Hi there,
A few days ago i have written about an issue (0.8.0) when auto-create topic
is enabled and consumer starts before producer (consumer never sees any
message and they seem to be lost even by the brokers)
Now i have done the same test with 0.8.1 and the issue is partially fixed
but now the
ted:
>
> https://issues.apache.org/jira/browse/KAFKA-1006
>
> And we are still figuring the right way to fix it. Could you describe your
> use cases where you need to start the consumer beforehand?
>
> Guozhang
>
>
> On Thu, Mar 13, 2014 at 2:42 AM, David Morales de Frías
20 matches
Mail list logo
