Re: Equivalent of emptyDataFrame in StructuredStreaming

2018-11-17 Thread Arun Manivannan
am sorry if I haven't done a good job in explaining it well. Cheers, Arun On Tue, Nov 6, 2018 at 7:34 AM Jungtaek Lim wrote: > Could you explain what you're trying to do? It should have no batch for no > data in stream, so it will end up to no-op even it is possible. > >

Equivalent of emptyDataFrame in StructuredStreaming

2018-11-05 Thread Arun Manivannan
Hi, I would like to create a "zero" value for a Structured Streaming Dataframe and unfortunately, I couldn't find any leads. With Spark batch, I can do a "emptyDataFrame" or "createDataFrame" with "emptyRDD" but with StructuredStreaming, I am lost. If I use the "emptyDataFrame" as the zero value