Re: KinesisStreamSource de-aggregation support via DeserializationSchema

2025-04-30 Thread Lorenzo Nicora
Thanks Ahmed I think I didn't express myself fully. The issue with a major release is not just timing, We should also put this from the perspective of the user. Particularly not-so-expert users. Because the change breaks the interface of @PublicEvolving class, in particular the interface KinesisD

Re: KinesisStreamSource de-aggregation support via DeserializationSchema

2025-04-29 Thread Ahmed Hamdy
Hi Lorenzo, I am not sure I follow the issue of awaiting a major release, we have seen the major releases for AWS connectors being picked up quite fast so we can just push for one. Plus the contribution is not a bug fix, additionally the legacy source is not yet removed. hence I would personally no

KinesisStreamSource de-aggregation support via DeserializationSchema

2025-04-28 Thread Lorenzo Nicora
Hello the current version of Kinesis source (5.0.0) lacks support for KLP de-aggregation [1] There is a pending PR [2] but it breaks the API and will require a new major version of the connector. I implemented an alternative solution using a DeserializationSchema wrapper which adds de-aggregation