[jira] [Created] (KAFKA-14096) Race Condition in Log Rolling Leading to Disk Failure

Eric Azama created KAFKA-14096: -- Summary: Race Condition in Log Rolling Leading to Disk Failure Key: KAFKA-14096 URL: https://issues.apache.org/jira/browse/KAFKA-14096 Project: Kafka Issue Type

Re: Filtering support on Fetch API

Something to keep in mind with your proposal is that you're moving the Decompression and Filtering costs into the Brokers. It probably also adds a new Compression cost if you want the Broker to send compressed data over the network. Centralizing that cost on the cluster may not be desirable and wou

[VOTE] KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits

Hi all, I'd like to open a vote on KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits This KIP is looking to improve the access to the Metadata included with Consumer Commits by adding a method to the ConsumerInterceptor that allows modification of the commit payloads.

Re: [DISCUSS] KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits

bumping for any additional feedback. I'll open a vote thread in the next couple days if there aren't any additional comments. On Wed, Nov 20, 2019 at 10:45 PM Eric Azama wrote: > Hi Deng, > > It's similar to Record Headers in that the metadata isn't used within

Re: What is the node-id tag in kafka producer MetricName ?

Nodes with a negative id refer to the bootstrap servers you configured the client with. There are also metrics that report for nodes with an extremely large node id. These are usually Integer.MAX_VALUE - (coordinator node id) On Tue, Dec 3, 2019 at 1:37 PM Rajkumar Natarajan wrote: > I've have

Re: [DISCUSS] KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits

ode and couldn't find much > of the metadata's usage, and I find its usage trivial. > > On Tue, Nov 19, 2019 at 3:19 AM Eric Azama wrote: > > > Hi all, > > > > I'd like to open discussion on KIP-547: Extend ConsumerInterceptor to > allow > > mo

[DISCUSS] KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits

Hi all, I'd like to open discussion on KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits This KIP hopes to enable better access to the Metadata included while committing offsets. LINK: https://cwiki.apache.org/confluence/display/KAFKA/KIP-547%3A+Extend+ConsumerInterce

KIP Creation Permission

Hi, I'd like to request permission to create KIPs. Wiki ID: eazama Thanks, Eric A.

Re: [DISCUSS] KIP-280: Enhanced log compaction

Hi Senthilnathan, Regarding Matthias's point 6, what is the reasoning for choosing the first occurrence of the configured header? I believe this corresponds to the oldest value for given key. If there are multiple values for a key, it seems more intuitive that the newest value is the one that shou

Re: [ DISCUSS ] KIP-512:Adding headers to RecordMetaData

Have you considered adding a new onAcknowledgement method to the ProducerInterceptor with the signature onAcknowledgement(RecordMetadata metadata, Exception exception, ProducerRecord record)? I would also consider adding this to Producer Callbacks as well, since linking a Callback to a specific rec

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

The high level design seems to indicate that all of the logic for when and how to copy log segments to remote storage lives in the RLM class. The default implementation is then HDFS specific with additional implementations being left to the community. This seems like it would require anyone impleme