Re: How to mock new DataSource/Sink

> On 5. Jul 2022, at 01:48, Alexander Fedulov wrote: > > Hi David, > > I started working on FLIP-238 exactly with the concerns you've mentioned in > mind. It is currently in development, feel free to join the discussion [1]. > If you need something ASAP and are not interested in rate-limiting

Re: How to mock new DataSource/Sink

Hi David, I started working on FLIP-238 exactly with the concerns you've mentioned in mind. It is currently in development, feel free to join the discussion [1]. If you need something ASAP and are not interested in rate-limiting functionality, you could drop in this [2] class into your tests suite

Re: How to mock new DataSource/Sink

It is indeed not easy to mock sources/sink with the new interfaces. There is an effort to make this easier for sources in the future (FLIP-238 ). For the time being I'd stick with the

How to mock new DataSource/Sink

Hi, we are currently looking at replacing our sinks and sources with the respective counterparts using the 'new' data source/sink API (mainly Kafka). What holds us back is that we are not sure how to test the pipeline with mocked sources/sinks. Up till now, we somewhat followed the 'Testing doc