Thanks for the link !
i was able to code my first datasources in microbatch and continuous by
using the v2 api...
i was wondering if there are some equivalent to SparkListener for
microbatching & continuous stream (where one could use the
spark.extra.listener) ~ monitoring :)
--
Sent from: htt
For now you can take a look at `DataSourceV2Suite`, which contains both
Java/Scala implementations. There is also an ongoing PR to implement
catalog APIs for JDBC: https://github.com/apache/spark/pull/27345
We are still working on the user guide.
On Mon, Mar 16, 2020 at 4:59 AM MadDoxX
wrote:
>
