Hi All,
I have the following code
StreamingQuery query = df2.writeStream().outputMode("complete").queryName(
"foo").option("truncate", "false").format("console").start();
query.awaitTermination();
and it works fine however when I change it to the below code. I do get the
output but only once and I tried running *%spark.sql select * from foo* over
and over again but I don't see results getting updated but in console
format like above it works perfect fine I can see updates on each batch so
should I be doing something else for memory sink?
StreamingQuery query =
df2.writeStream().outputMode("complete").queryName("foo").option("truncate",
"false").format("memory").start();
%spark.sql select * from foo
Thanks!
