got it! Thank you!
On Thu, May 4, 2017 at 12:58 AM, Tathagata Das
wrote:
> Structured Streaming is not designed to integrate with receivers. The
> sources in Structured Streaming are designed for providing stronger
> fault-tolerance guarantees by precisely tracking records by their offsets
> (e.
Structured Streaming is not designed to integrate with receivers. The
sources in Structured Streaming are designed for providing stronger
fault-tolerance guarantees by precisely tracking records by their offsets
(e.g. Kafka offsets). This is different from the Receiver APIs which did
not require re
Hi All,
I have a Custom Receiver that implements onStart() and OnStop Methods of
the Receiver class and I am trying to figure out how to integrate with
SparkSession since I want to do stateful analytics using Structured
Streaming. I couldn't find it in the docs. any idea? When I was doing
stateles
