Tanks for all these informations. Twitter Kestrel-Storm-Cassandra solution
looks very powerfull, scalable and well documented. I'll try to use this
solution.
Alain
2012/2/23 Milind Parikh
> Coolwww.countandra.org calls them cascaded counters and it will be
> also based on Kafka.
>
> /**
Coolwww.countandra.org calls them cascaded counters and it will be also
based on Kafka.
/***
sent from my android...please pardon occasional typos as I respond @ the
speed of thought
/
On Feb 22, 2012 7:22 PM, "Edward Capriolo" wrote:
I have been
I have been working on IronCount
(https://github.com/edwardcapriolo/IronCount/) which is designed to do
what you are talking about. Kafka takes care of the distributed
producer/consumer message queues and IronCount sets up custom
consumers to process those messages.
It might be what your are looki
Maybe Storm is what you are looking for (as well as flume to get the messages
from the network)
http://www.datastax.com/events/cassandranyc2011/presentations/marz
Cheers
-
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 22/02/2012, at 2:23 AM, Alain
Thanks for answering.
"This is a good starting point
https://github.com/thobbs/flume-cassandra-plugin "
I already saw that, but it only does a raw store of the logs. I would like
too store them in a "smart way", I mean I'd like to store logs to be able
to use information contained into them.
If
> How to do it ? Do I need to build a custom plugin/sink or can I configure an
> existing sink to write data in a custom way ?
This is a good starting point https://github.com/thobbs/flume-cassandra-plugin
> 2 - My business process also use my Cassandra DB (without flume, directly via
> thrift),
Hi,
1 - I would like to generate some statistics and store some raw events from
log files tailed with flume. I saw some plugins giving Cassandra sinks but
I would like to store data in a custom way, storing raw data but also
incrementing counters to get near real-time statistcis. How to do it ? Do
