Hi Christian,
Valid point. Thanks a lot for your great explanation.
In our case, we want to avoid lots of moving part. We are working on the
greenfield project so we want to adopt the latest approach as we have a
flexibility right now.
We also asses the Apache Spark before and it doesn't suit our
Hi
Personally, I find the the concepts of the so-called Kappa
architecture intriguing. But I doubt that it is applicable in a generic
setup where different use cases are mapped into the architecture. To be
fair, I think the same applies to Lambda architectures. Therefore I
wouldn't assume that Lam
Hi Nick,
I totally agree with your point.
My concern is the Kafka, is the author concern really true ? Any one can
give comments on this one ?
On Thu, Nov 12, 2015 at 12:33 PM, Nick Dimiduk wrote:
> The first and 3rd points here aren't very fair -- they apply to all data
> systems. Systems d
Hi rss rss,
Yes. I have already read that book.
However given the state of streaming right now, and Kappa Architecture, I
don't think we need Lambda Architecture again ?
Any thoughts ?
On Thu, Nov 12, 2015 at 12:29 PM, rss rss wrote:
> Hello,
>
> regarding the Lambda architecture there is a
The first and 3rd points here aren't very fair -- they apply to all data
systems. Systems downstream of your database can lose data in the same way;
the database retention policy expires old data, downstream fails, and back
to the tapes you must go. Likewise with 3, a bug in any ETL system can
caus
Hello,
regarding the Lambda architecture there is a following book -
https://www.manning.com/books/big-data (Big Data. Principles and best
practices of scalable realtime data systems
Nathan Marz and James Warren).
Regards,
Roman
2015-11-12 4:47 GMT+03:00 Welly Tambunan :
> Hi Stephan,
>
>
>
Hi Stephan,
Thanks for your response.
We are trying to justify whether it's enough to use Kappa Architecture with
Flink. This more about resiliency and message lost issue etc.
The article is worry about message lost even if you are using Kafka.
No matter the message queue or broker you rely o
Hi!
Can you explain a little more what you want to achieve? Maybe then we can
give a few more comments...
I briefly read through some of the articles you linked, but did not quite
understand their train of thoughts.
For example, letting Tomcat write to Cassandra directly, and to Kafka,
might just
Hi All,
I read a couple of article about Kappa and Lambda Architecture.
http://www.confluent.io/blog/real-time-stream-processing-the-next-step-for-apache-flink/
I'm convince that Flink will simplify this one with streaming.
However i also stumble upon this blog post that has valid argument to h
