Re: DAG processing in Kafka Streams

2017-07-25 Thread Sameer Kumar
it is quite a bit more flexible than K-Streams (which we also use…but > for > >>> simpler applications) Akka-streams-Kafka is particularly good for > >>> asynchronous processing: http://doc.akka.io/docs/akka- > >>> stream-kafka/current/home.html > >>> > &g

Re: DAG processing in Kafka Streams

2017-07-20 Thread Matthias J. Sax
t;> -David >>> >>> On 7/17/17, 12:35 PM, "David Garcia" wrote: >>> >>> I think he means something like Akka Streams: >>> http://doc.akka.io/docs/akka/2.5.2/java/stream/stream-graphs.html >>> >>> Directe

Re: DAG processing in Kafka Streams

2017-07-17 Thread Sameer Kumar
ka Streams and > > use back-pressure to preclude memory issues. > > > > -David > > > > On 7/17/17, 12:20 PM, "Guozhang Wang" wrote: > > > > Sameer, > > > > Could you elaborate a bit more what do you mean by "

Re: DAG processing in Kafka Streams

2017-07-17 Thread Guozhang Wang
ng Wang" wrote: > > Sameer, > > Could you elaborate a bit more what do you mean by "DAG > processing"? > > > Guozhang > > > On Sun, Jul 16, 2017 at 11:58 PM, Sameer Kumar < > sam.kum.w...@gmail.com> >

Re: DAG processing in Kafka Streams

2017-07-17 Thread David Garcia
M, Sameer Kumar wrote: > Currently, we don't have DAG processing in Kafka Streams. Having a DAG has > its own share of advantages in that, it can optimize code on its own and > come up with a optimized execution plan. > &

Re: DAG processing in Kafka Streams

2017-07-17 Thread David Garcia
Sameer, Could you elaborate a bit more what do you mean by "DAG processing"? Guozhang On Sun, Jul 16, 2017 at 11:58 PM, Sameer Kumar wrote: > Currently, we don't have DAG processing in Kafka Streams. Having a DAG has > its

Re: DAG processing in Kafka Streams

2017-07-17 Thread Guozhang Wang
Sameer, Could you elaborate a bit more what do you mean by "DAG processing"? Guozhang On Sun, Jul 16, 2017 at 11:58 PM, Sameer Kumar wrote: > Currently, we don't have DAG processing in Kafka Streams. Having a DAG has > its own share of advantages in that, it can optimiz

DAG processing in Kafka Streams

2017-07-16 Thread Sameer Kumar
Currently, we don't have DAG processing in Kafka Streams. Having a DAG has its own share of advantages in that, it can optimize code on its own and come up with a optimized execution plan. Are we exploring in this direction, do we have this in our current roadmap. -Sameer.