Re: How to share text file across tasks at run time in flink.

2016-08-23 Thread Lohith Samaga M
Hi May be you could use Cassandra to store and fetch all such reference data. This way the reference data can be updated without restarting your application. Lohith Sent from my Sony Xperia™ smartphone Baswaraj Kasture wrote Thanks Kostas ! I am using DataStream API. I have few co

RE: Where to put live model and business logic in Hadoop/Flink BigData system

2016-05-06 Thread Lohith Samaga M
HI Palle, I am a beginner in Flink. However, I can say something about your other questions: 1. It is better to use Spark to create aggregate views. It is a lot faster than MR. You could use either batch or streaming mode in spark based on your needs. 2. If your a

Re: Join DataStream with dimension tables?

2016-04-22 Thread Lohith Samaga M
Hi, Cassandra could be used as a distributed cache. Lohith. Sent from my Sony Xperia™ smartphone Aljoscha Krettek wrote Hi Srikanth, that's an interesting use case. It's not possible to do something like this out-of-box but I'm actually working on API for such cases. In the mean ti