Anne Rutten created ZEPPELIN-2626:
-------------------------------------
Summary: StreamingContext does not get shut down when zeppelin
shuts down
Key: ZEPPELIN-2626
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2626
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.1
Reporter: Anne Rutten
Priority: Minor
if i set up a structuredstream:
{quote}
val ds1 = spark
.readStream
.format("kafka")
.option("kafka.bootstrap.servers", "localhost:9092")
.option("subscribe", "hatespeech01")
.load()
ds1.selectExpr("CAST(key AS STRING)", "CAST(value AS STRING)")
.as[(String, String)]
.writeStream
.format("console")
.start()
.awaitTermination()
{quote}
and then terminate Zeppelin (because the stream blocks the Zeppelincontext and
i can't stop the stream), the corresponding sparkContext doesn't get terminated.
If i restart Zeppelin, the sparkContext doesn't get re-initialised, but isn't
reachable anymore. If i kill the process associated with spark and restart
Zeppelin everything again works as expected.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
