Re: [DISCUSS] PIP: Producer Send Message with Different Schema

2020-04-14 Thread rocketraman
Now that PIP-43 is released in 2.5.0, I wanted to follow up on the messages below. What is remaining to be done in Pulsar to support having multiple different types on one topic in Pulsar? Yi indicates below that PIP-43 sets the stage for this, but that the schema compatibility implementation s

Re: [DISCUSS] PIP: Producer Send Message with Different Schema

2020-04-20 Thread rocketraman
> On Wed, Apr 15, 2020 at 4:25 AM Shivji Kumar Jha wrote: > > > Hi Sijie, > > > > I second with Raman. Apart from PIP-43 and PIP-44 which ease schema > > management, in my opinion, we should also loosely couple the association > > between topic and schema (or more precisely *type of data* on topi

Re: [DISCUSS] PIP: Producer Send Message with Different Schema

2019-09-15 Thread rocketraman
I see a mention of compatibility in the PIP but with no details. The docs about schema compatibility state this: > Consequently, those events need to go in the same Pulsar partition to > maintain order. This application can use ALWAYS_COMPATIBLE to allow different > kinds of events co-exist in