Kafka error handling

Hi everyone I'm designing a control handling for my kafka stream api. I'm would like to know any documentation or best practise that I can read. Basically I'm creating some topics error for failed messages and retry topics. Any suggestions? Thanks

Re: [VOTE] 1.0.1 RC1

+1. Verified artifacts and ran quickstart. Thanks Ewen! -Jason On Thu, Feb 15, 2018 at 1:42 AM, Rajini Sivaram wrote: > +1 > > Ran quickstart with binaries, built source and ran tests, > > Thank you for running the release, Ewen. > > Regards, > > Rajini > > On Thu, Feb 15, 2018 at 2:31 AM, Guoz

Jenkins build is back to normal : kafka-trunk-jdk7 #3190

See

Re: 1.1 release progress

Sounds good. Thanks Becket. Ismael On 15 Feb 2018 5:30 pm, "Becket Qin" wrote: > Hi Ismael, > > Yes, I am working on the fix. Will submit patch today. > > Thanks, > > Jiangjie (Becket) Qin > > On Thu, Feb 15, 2018 at 2:53 PM, Ismael Juma wrote: > > > Hi Becket, > > > > Thanks for filing that.

Re: 1.1 release progress

Hi Ismael, Yes, I am working on the fix. Will submit patch today. Thanks, Jiangjie (Becket) Qin On Thu, Feb 15, 2018 at 2:53 PM, Ismael Juma wrote: > Hi Becket, > > Thanks for filing that. Are you working on a fix? > > Ismael > > On Thu, Feb 15, 2018 at 2:51 PM, Becket Qin wrote: > > > Hi Da

Build failed in Jenkins: kafka-trunk-jdk7 #3189

See Changes: [github] MINOR: Resuming Tasks should not be initialized twice (#4562) [github] KAFKA-6517: Avoid deadlock in ZooKeeperClient during session expiry -- [...tr

Build failed in Jenkins: kafka-1.1-jdk7 #42

See Changes: [rajinisivaram] KAFKA-6517: Avoid deadlock in ZooKeeperClient during session expiry [ismael] MINOR: Cache Node's hashCode to improve the producer's performance ---

[jira] [Resolved] (KAFKA-6541) StackOverflow exceptions in thread 'kafka-coordinator-heartbeat-thread

[ https://issues.apache.org/jira/browse/KAFKA-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6541. Resolution: Duplicate Closing as duplicate for now. Please reopen if you think the issue has

[jira] [Reopened] (KAFKA-4969) State-store workload-aware StreamsPartitionAssignor

[ https://issues.apache.org/jira/browse/KAFKA-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reopened KAFKA-4969: -- > State-store workload-aware StreamsPartitionAssignor >

Re: 1.1 release progress

Hi Becket, Thanks for filing that. Are you working on a fix? Ismael On Thu, Feb 15, 2018 at 2:51 PM, Becket Qin wrote: > Hi Damian, > > I just created another ticket KAFKA-6568, which I believe should also be a > blocker unless people disagree. > > Thanks, > > Jiangjie (Becket) Qin > > On Wed,

Re: 1.1 release progress

Hi Damian, I just created another ticket KAFKA-6568, which I believe should also be a blocker unless people disagree. Thanks, Jiangjie (Becket) Qin On Wed, Feb 14, 2018 at 8:52 AM, Damian Guy wrote: > Hi All, > > The first 1.1 RC is due to be cut, however we currently have 2 blockers > outsta

[jira] [Created] (KAFKA-6568) LogCleanerManager.doneDeleting() should check the partition state before deleting the in progress partition

Jiangjie Qin created KAFKA-6568: --- Summary: LogCleanerManager.doneDeleting() should check the partition state before deleting the in progress partition Key: KAFKA-6568 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-6567) KStreamWindowReduce can be replaced by KStreamWindowAggregate

Guozhang Wang created KAFKA-6567: Summary: KStreamWindowReduce can be replaced by KStreamWindowAggregate Key: KAFKA-6567 URL: https://issues.apache.org/jira/browse/KAFKA-6567 Project: Kafka

[jira] [Created] (KAFKA-6566) SourceTask#stop() not called after exception raised in poll()

Gunnar Morling created KAFKA-6566: - Summary: SourceTask#stop() not called after exception raised in poll() Key: KAFKA-6566 URL: https://issues.apache.org/jira/browse/KAFKA-6566 Project: Kafka

Jenkins build is back to normal : kafka-1.1-jdk7 #41

See

[jira] [Resolved] (KAFKA-6549) Deadlock while processing Controller Events

[ https://issues.apache.org/jira/browse/KAFKA-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6549. --- Resolution: Fixed Fixed under KAFKA-6517. > Deadlock while processing Controller Events > ---

Build failed in Jenkins: kafka-trunk-jdk8 #2416

See Changes: [jason] MINOR: Update test classes to use KafkaZkClient methods (#4367) -- [...truncated 3.49 MB...] kafka.controller.PartitionStateMachineTest > testOnline

[jira] [Created] (KAFKA-6565) Sudden unresponsiveness from broker + file descriptor leak

Noam Berman created KAFKA-6565: -- Summary: Sudden unresponsiveness from broker + file descriptor leak Key: KAFKA-6565 URL: https://issues.apache.org/jira/browse/KAFKA-6565 Project: Kafka Issue Ty

Build failed in Jenkins: kafka-1.1-jdk7 #40

See Changes: [rajinisivaram] KAFKA-6512: Discard references to buffers used for compression (#4570) -- [...truncated 412.73 KB...] kafka.log.LogCleanerIntegrationTest > tes

[jira] [Resolved] (KAFKA-6512) Java Producer: Excessive memory usage with compression enabled

[ https://issues.apache.org/jira/browse/KAFKA-6512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6512. --- Resolution: Fixed Fix Version/s: (was: 1.2.0) 1.1.0 Implemented

Jenkins build is back to normal : kafka-trunk-jdk9 #405

See

Spike in Metarequest call timings in Java client

Hi There, We see spikes in the metadata request calls when a broker machine specified in the broker list goes down i.e server not reachable. Is there a property which can be set in the Java client to control the timeout when a broker is not reachable and try another one in the list. We are seei

[jira] [Resolved] (KAFKA-2167) ZkUtils updateEphemeralPath JavaDoc (spelling and correctness)

[ https://issues.apache.org/jira/browse/KAFKA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2167. -- Resolution: Fixed > ZkUtils updateEphemeralPath JavaDoc (spelling and correctness) > ---

[jira] [Resolved] (KAFKA-6240) Support dynamic updates of frequently updated broker configs

[ https://issues.apache.org/jira/browse/KAFKA-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6240. --- Resolution: Fixed Fix Version/s: (was: 1.2.0) 1.1.0 > Support dy

[jira] [Created] (KAFKA-6564) Fix broken links in Dockerfile

Andriy Sorokhtey created KAFKA-6564: --- Summary: Fix broken links in Dockerfile Key: KAFKA-6564 URL: https://issues.apache.org/jira/browse/KAFKA-6564 Project: Kafka Issue Type: Test

Build failed in Jenkins: kafka-trunk-jdk9 #404

See Changes: [github] MINOR: Support dynamic JAAS config for broker's LoginManager cache -- [...truncated 1.88 MB...] org.apache.kafka.streams.processor.internals.assignmen

Jenkins build is back to normal : kafka-trunk-jdk7 #3187

See

[jira] [Created] (KAFKA-6563) Kafka online backup

Werner Daehn created KAFKA-6563: --- Summary: Kafka online backup Key: KAFKA-6563 URL: https://issues.apache.org/jira/browse/KAFKA-6563 Project: Kafka Issue Type: Improvement Components: