[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15553176#comment-15553176
]
Cody Koeninger commented on SPARK-15406:
----------------------------------------
I'm talking about people using Spark, not committers. The "second category"
was referring to my statement that I'm ok with doing work, even if it never
gets merged, as long as it helps an end user actually get his/her work done.
Regarding spark.streaming.kafka010, thats a totally separate package from the
structured streaming stuff discussed in this jira. Regarding plans, it's sort
of irrelevant what my plan is. If there's something you want to help out on,
talk to a committer and try to convince them it's a good idea. If I think it's
a good or bad idea I'll bluntly tell you so, but otherwise there's not much I
can do one way or the other.
> Structured streaming support for consuming from Kafka
> -----------------------------------------------------
>
> Key: SPARK-15406
> URL: https://issues.apache.org/jira/browse/SPARK-15406
> Project: Spark
> Issue Type: New Feature
> Reporter: Cody Koeninger
>
> This is the parent JIRA to track all the work for the building a Kafka source
> for Structured Streaming. Here is the design doc for an initial version of
> the Kafka Source.
> https://docs.google.com/document/d/19t2rWe51x7tq2e5AOfrsM9qb8_m7BRuv9fel9i0PqR8/edit?usp=sharing
> ================== Old description =========================
> Structured streaming doesn't have support for kafka yet. I personally feel
> like time based indexing would make for a much better interface, but it's
> been pushed back to kafka 0.10.1
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
