Burak Yavuz created SPARK-19774:
-----------------------------------
Summary: StreamExecution should call stop() on sources when a
stream fails
Key: SPARK-19774
URL: https://issues.apache.org/jira/browse/SPARK-19774
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 2.1.0, 2.0.2
Reporter: Burak Yavuz
Assignee: Burak Yavuz
We call stop() on a Structured Streaming Source only when the stream is
shutdown when a user calls streamingQuery.stop(). We should actually stop all
sources when the stream fails as well, otherwise we may leak resources, e.g.
connections to Kafka.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
