[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628295#comment-15628295
]
zhangxinyu edited comment on SPARK-17935 at 11/2/16 9:10 AM:
-------------------------------------------------------------
Thank you for your suggestions.
Kafka sink will support some producer configurations, such as key.serializer
and value.serializer which make sure that users can output common type data.
However, most of producer configurations will be default value, becasue users
can config them by ".option()" if they really need. Besides, I will check some
importent configurations, such as bootstrap.servers.
was (Author: zhangxinyu):
Thank you for your suggestions.
Kafka sink will support some producer configurations, such as key.serializer
and value.serializer which make sure that users can output common type data.
However, most of producer configurations will be default value, becasue users
can config them by ".option()" if they really need. Besides, I will check some
import configurations, such as bootstrap.servers.
> Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module
> ------------------------------------------------------------------------------
>
> Key: SPARK-17935
> URL: https://issues.apache.org/jira/browse/SPARK-17935
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 2.0.0
> Reporter: zhangxinyu
>
> Now spark already supports kafkaInputStream. It would be useful that we add
> `KafkaForeachWriter` to output results to kafka in structured streaming
> module.
> `KafkaForeachWriter.scala` is put in external kafka-0.8.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
