I think that the community really needs some feedback on the progress of this very important task. Many existing Spark Streaming applications can't be ported to Structured Streaming without Kafka support.
Is there a design document somewhere? Or can someone from the DataBricks team break down the existing monolithic JIRA issue into smaller steps that reflect the current development plan? Fred On Sat, Aug 27, 2016 at 2:32 PM, Koert Kuipers <[email protected]> wrote: > thats great > > is this effort happening anywhere that is publicly visible? github? > > On Tue, Aug 16, 2016 at 2:04 AM, Reynold Xin <[email protected]> wrote: > >> We (the team at Databricks) are working on one currently. >> >> >> On Mon, Aug 15, 2016 at 7:26 PM, Cody Koeninger <[email protected]> >> wrote: >> >>> https://issues.apache.org/jira/browse/SPARK-15406 >>> >>> I'm not working on it (yet?), never got an answer to the question of >>> who was planning to work on it. >>> >>> On Mon, Aug 15, 2016 at 9:12 PM, Guo, Chenzhao <[email protected]> >>> wrote: >>> > Hi all, >>> > >>> > >>> > >>> > I’m trying to write Structured Streaming test code and will deal with >>> Kafka >>> > source. Currently Spark 2.0 doesn’t support Kafka sources/sinks. >>> > >>> > >>> > >>> > I found some Databricks slides saying that Kafka sources/sinks will be >>> > implemented in Spark 2.0, so is there anybody working on this? And >>> when will >>> > it be released? >>> > >>> > >>> > >>> > Thanks, >>> > >>> > Chenzhao Guo >>> >>> --------------------------------------------------------------------- >>> To unsubscribe e-mail: [email protected] >>> >>> >> >
