Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2021-01-13 Thread Николай Ижиков
Bump. Let’s have this API in the open source? Отправлено с iPhone > 2 дек. 2020 г., в 16:43, Nikolay Izhikov написал(а): > > Hello, Paul. > > Thanks for the feedback! > >> How does the producer get notified of a failure to pass the RecordPolicy for >> one or more records, > > The produce

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-12-02 Thread Nikolay Izhikov
Hello, Paul. Thanks for the feedback! > How does the producer get notified of a failure to pass the RecordPolicy for > one or more records, The producer will receive `PolicyViolationException`. > how should it recover? Obvious answers are Producer should switch to the correct schema OR prod

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-11-30 Thread Paul Whalen
Nikolay, I'm not a committer, but perhaps I can start the discussion. I've had the urge for a similar feature after being bitten by writing a poorly formed record to a topic - it's natural to want to push schema validation into the broker, since that's the way regular databases work. But I'm a b

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-11-30 Thread Nikolay Izhikov
Friendly bump. Please, share your feedback. Do we need those feature in the Kafka? > 23 нояб. 2020 г., в 12:09, Nikolay Izhikov > написал(а): > > Hello! > > Any additional feedback on this KIP? > I believe this API can be useful for Kafka users. > > >> 18 нояб. 2020 г., в 14:47, Nikolay Izh

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-11-23 Thread Nikolay Izhikov
Hello! Any additional feedback on this KIP? I believe this API can be useful for Kafka users. > 18 нояб. 2020 г., в 14:47, Nikolay Izhikov > написал(а): > > Hello, Ismael. > > Thanks for the feedback. > You are right, I read public interfaces definition not carefully :) > > Updated KIP acco

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-11-18 Thread Nikolay Izhikov
Hello, Ismael. Thanks for the feedback. You are right, I read public interfaces definition not carefully :) Updated KIP according to your objection. I propose to expose 2 new public interfaces: ``` package org.apache.kafka.common; public interface Record { long timestamp(); boolean has

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-11-17 Thread Ismael Juma
Thanks for the KIP. The policy interface is a small part of this. You also have to describe the new public API that will be exposed as part of this. For example, there is no public `Records` class. Ismael On Tue, Nov 17, 2020 at 8:24 AM Nikolay Izhikov wrote: > Hello. > > I want to start discus