I think you're missing:
val query = wordCounts.writeStream
.outputMode("complete")
.format("console")
.start()
Dis it help ?
On Mon, Aug 1, 2016 at 2:44 PM Jacek Laskowski <[email protected]> wrote:
> On Mon, Aug 1, 2016 at 11:01 AM, Ayoub Benali
> <[email protected]> wrote:
>
> > the problem now is that when I consume the dataframe for example with
> count
> > I get the stack trace below.
>
> Mind sharing the entire pipeline?
>
> > I followed the implementation of TextSocketSourceProvider to implement my
> > data source and Text Socket source is used in the official documentation
> > here.
>
> Right. Completely forgot about the provider. Thanks for reminding me about
> it!
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://medium.com/@jaceklaskowski/
> Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark
> Follow me at https://twitter.com/jaceklaskowski
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: [email protected]
>
>
