Re: Spark 2.3.0 and Custom Sink

: Thursday, June 21, 2018 at 3:45 PM To: subramgr Cc: user Subject: Re: Spark 2.3.0 and Custom Sink Since ForeachWriter works at a record level so you cannot do bulk ingest into KairosDB, which supports bulk inserts. This will be slow. Instead, you can have your own Sink implementation which is a batch

Re: Spark 2.3.0 and Custom Sink

Since ForeachWriter works at a record level so you cannot do bulk ingest into KairosDB, which supports bulk inserts. This will be slow. Instead, you can have your own Sink implementation which is a batch (DataFrame) level. Thanks, http://www.snappydata.io/blog On Thu, Jun 2

Spark 2.3.0 and Custom Sink

Hi Spark Mailing list, We are looking for pushing the output of the structured streaming query output to KairosDB. (time series database) What would be the recommended way of doing this? Do we implement the *Sink* trait or do we use the *ForEachWriter* At each trigger point if I do a *dataset