[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996166#comment-15996166
]
Helena Edelson commented on SPARK-18057:
----------------------------------------
With the current 0.10.0.1 version we have several issues happening, forcing us
into ever tighter situations. Much of this is constraints related to new
functionality in later Kafka releases around kafka security and SASL_SSL and
related behavior not in previous versions of Kafka.
Users in our ecosystem can not delete topics on clusters so this is not our
relevant use case. It seems only structured streaming kafka does deleteTopic,
vs spark-streaming-kafka.
I've had to create an internal fork so that we can use Kafka 0.10.2.0 in Spark,
which is bad but we are blocked otherwise.
[~ijuma] good to know on the timing. A group of us voted for
https://issues.apache.org/jira/browse/KAFKA-4879.
> Update structured streaming kafka from 10.0.1 to 10.2.0
> -------------------------------------------------------
>
> Key: SPARK-18057
> URL: https://issues.apache.org/jira/browse/SPARK-18057
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Reporter: Cody Koeninger
>
> There are a couple of relevant KIPs here,
> https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
