Re: [Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-05-06 Thread Zihan Li
ystem? > > Cheers, > > Chris > > On Thu, Apr 30, 2020 at 1:01 PM Zihan Li wrote: > > > Hi Chris and Andrew, > > > > Thanks a lot for your reply! > > > > I think in most cases it is easier to analysis broken records in an > > external &

Re: [Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-04-30 Thread Zihan Li
t; KIP is trying to > > achieve, only without needing any interface or behaviour changes in the > > connectors. Yes, > > you need to run more connectors, but in a distributed connect cluster, > > that's easy to achieve. > > > > Thanks, > > Andrew Schofi

Re: [Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-04-24 Thread Zihan Li
> destination sink. It'd be nice if this were called out in the "Rejected > Alternatives" section with a reason on why the changes proposed in the KIP > are preferable, especially since it may still work as a viable workaround > for users who are working on older vers

Re: [Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-04-24 Thread Zihan Li
t; > destination sink. It'd be nice if this were called out in the "Rejected> > Alternatives" section with a reason on why the changes proposed in the KIP> > are preferable, especially since it may still work as a viable workaround> > for users who are working

Re: [Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-03-24 Thread Zihan Li
FKA-9740 <https://issues.apache.org/jira/browse/KAFKA-9740> Please share your thoughts about adding this new error handling option to Kafka Connect. Best, Zihan > On Mar 18, 2020, at 12:55 PM, Zihan Li wrote: > > Hi all, > > I'd like to use this thread to discuss KIP-582 Ad

[jira] [Created] (KAFKA-9740) Add a "continue" option for Kafka Connect error handling

2020-03-20 Thread Zihan Li (Jira)
Zihan Li created KAFKA-9740: --- Summary: Add a "continue" option for Kafka Connect error handling Key: KAFKA-9740 URL: https://issues.apache.org/jira/browse/KAFKA-9740 Project: Kafka

[Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-03-18 Thread Zihan Li
Hi all, I'd like to use this thread to discuss KIP-582 Add a "continue" option for Kafka Connect error handling, please see detail at: https://cwiki.apache.org/confluence/x/XRvcC <https://cwiki.apache.org/confluence/x/XRvcC> Best, Zihan Li

Request Permission to Create Kafka Improvement Proposal

2020-03-16 Thread Zihan Li
Hi, I’m writing to request permission to create KIP. My proposal: Currently there are two error handling options in Kafka connect, “none” and “all”. Option “none” will config the connector to fail fast, and option “all” will ignore broken records. I'm proposing a third option, which should