[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983396#comment-15983396
]
Shixiong Zhu edited comment on SPARK-18057 at 4/25/17 6:29 PM:
---------------------------------------------------------------
[~guozhang] We have a stress test to test Spark Kafka connector for various
cases, and it will try to frequently delete / re-create topics.
Topic deletion may not be common in production, but it will just hang forever
and waste resources. It requires users to set up some monitor scripts to
restart a job if it doesn't make any progress for a long time.
was (Author: zsxwing):
[~guozhang] We have a stress test to test Spark Kafka connector for various
cases, and it will try to frequently delete / re-create topics.
> Update structured streaming kafka from 10.0.1 to 10.2.0
> -------------------------------------------------------
>
> Key: SPARK-18057
> URL: https://issues.apache.org/jira/browse/SPARK-18057
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Reporter: Cody Koeninger
>
> There are a couple of relevant KIPs here,
> https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
