Re: Apache Flink <=> Apache Ignite integration

2016-04-04 Thread Raul Kripalani
On Mon, Apr 4, 2016 at 3:54 PM, Stephan Ewen wrote: > > - Sounds like the having Ignite for snapshots should work pretty much > out > of the box (via the IGFS) > - The source and sink connector sounds like the next logical step. Does > Ignite have a notion of stream partitions and offsets, to

Re: Apache Flink <=> Apache Ignite integration

2016-04-04 Thread Raul Kripalani
On Mon, Apr 4, 2016 at 3:35 PM, Robert Metzger wrote: > thanks a lot for reaching out to the Flink community. > I'm really excited to see a Flink connector in Ignite. If you feel that > the > connector would be more suitable for our "connector library" feel free to > open a JIRA and open a pull r

Re: Apache Flink <=> Apache Ignite integration

2016-03-30 Thread Raul Kripalani
On Wed, Mar 30, 2016 at 2:20 PM, Roman wrote: > Raul, > > Small comment from me. > > >* As a Flink sink => inject data directly into a cache via a DataStreamer. > After reviews, IGNITE-813 is exactly this functionality. > > That's cool, Roman! The idea would be to host these (richer) modules as F

Apache Flink <=> Apache Ignite integration

2016-03-30 Thread Raul Kripalani
Hello from the Apache Ignite community! Last year there was an interesting thread [1] about such integration. Unfortunately there's been little follow-through, so let's try and fix that in 2016 ;-) I'm sure a lot has changed in the Flink community, with the recent graduation and 1.0 release, so I