Re: Kafka Connect ++ Kafka Streams

2016-03-29 Thread Michal Haris
Replies from the dev list weren't getting to my original sender account. I could create a pull request but it has some patchy code in ConnectEmbedded and dependencies which shouldn't be there (connect-runtime) as it was mostly intended for imagining how the integrated connect and streams topology w

Re: Kafka Connect ++ Kafka Streams

2016-03-25 Thread Guozhang Wang
I am thinking maybe we can even consider pulling the project as a whole into examples instead of adding the connector and streams implementation separately into Kafka Connect and Kafka Streams if Michal is interested to filing a PR: currently the examples folder only contains consumer / producer de

Re: Kafka Connect ++ Kafka Streams

2016-03-25 Thread Neha Narkhede
Michal -- This is really cool. Mind submitting a pull request? Also, would you like your IRC connector to be featured on the Kafka Connector Hub ? On Fri, Mar 25, 2016 at 9:08 AM, Michal Hariš wrote: > So I had a go and hacked it up here: ConnectEmbedded.java > <

Re: Kafka Connect ++ Kafka Streams

2016-03-25 Thread Michal Hariš
So I had a go and hacked it up here: ConnectEmbedded.java And this is how the wikipedia demo looks with it: hello-kafka-streams

Re: Kafka Connect ++ Kafka Streams

2016-03-24 Thread Ewen Cheslack-Postava
On Thu, Mar 24, 2016 at 4:46 AM, Michal Hariš wrote: > Hello Kafka people! > > Great to see Kafka Streams coming along, the design validates (and in many > way supersedes) my own findings from working with various stream processing > systems/frameworks and eventually ending-up using just a small

Kafka Connect ++ Kafka Streams

2016-03-24 Thread Michal Hariš
Hello Kafka people! Great to see Kafka Streams coming along, the design validates (and in many way supersedes) my own findings from working with various stream processing systems/frameworks and eventually ending-up using just a small custom library built directly around Kafka. I have set out yest