Currently this is not part of the DSL and needs to be done separately through KafkaConnect. Here's an example: http://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams
In the future we want to integrate Connect and Streams better, so you could do something like "builder.stream(..).fromCassandra()" and "stream.toElastic()" and a connector will be added that does the "last mile" of data integration. Gwen On Wed, Jun 1, 2016 at 4:47 PM, Avi Flax <avi.f...@parkassist.com> wrote: > Hi all, > > Is it possible to use the Kafka Streams DSL to build a topology that has a > source and/or sink that is/are not Kafka Topic(s)? > > As an example, I would like to consume some events from an API via > WebSockets and use that as a source in a Kafka Streams topology — ideally > one defined with the DSL. I currently have an API wherein I can supply a > closure to my WebSockets API, and that closure will be “fed” events from > the WebSockets connection as they come in. I’d be happy to direct the > events through some kind of intermediary like a queue or other iterable > (i.e. I could just provide an iterable to the topology.) > > I do have other cases besides WebSockets though; another need I have is to > write data to a SQL database as a topology sink. > > If this is in the docs then I apologize; I must have missed it somehow. > > Thank you! > Avi > > Software Architect @ Park Assist » We’re hiring! > >
