Re: Question about KIP-107

Looks to be addressed in 1.1.0 which is currently being voted on for release: https://issues.apache.org/jira/browse/KAFKA-5925 The KIP-107 provides a way to delete messages s

Question about KIP-107

Hi folks, My team and I are just getting started with Kafka, and I'm looking for information about removing individual items in the log. It led me to this article about implementing GDPR with Kafka . That article links to KIP-107: Add purg

Re: information about kafka

We live as streams but we have a tendency to think on batch. Batch might be faster, but the reality is streams. Philosophical questions, philosophical answers. :) On Mar 19, 2018 16:10, "Subash Konar" wrote: > There are two systems as of now > 1.Stream processing (continuous live data comin

Re: Subject: [VOTE] 1.1.0 RC3

Vahid, The Java 9 Connect issue is similar to the one being fixed for Trogdor in the following PR: https://github.com/apache/kafka/pull/4725 We need to do something similar for Connect. Ismael On Fri, Mar 16, 2018 at 3:10 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi Damian,

Re: information about kafka

There are two systems as of now 1.Stream processing (continuous live data coming in) 2.Batch(Store and keep data as a batch and submit for processing) Sent from my Samsung 7 On 19 Mar 2018 11:42 p.m., "abdelhadi FEKHAR" wrote: Hi, in science for collecting data in real time, does it exist

Re: information about kafka

Can you clarify the question ? Are you looking for different systems for stream processing ? What's your use case ? Thanks On Mon, Mar 19, 2018 at 10:24 AM, abdelhadi FEKHAR wrote: > Hi, > >in science for collecting data in real time, does it exist only stream > processing and batch proce

information about kafka

Hi, in science for collecting data in real time, does it exist only stream processing and batch processing ? or there is another systems Best regards. -- Abdelhadi FEKHAR Student at the National engineering school for computer science option :Information systems & technology

? compression

Hi all, Probably a common scenario: Kafka storage growing Added more disk space Calculation shows disk space growing fast Would like to compress topics Compression simple enough to implement Question: Would like to compress the current data, is there any sage advice ? It does not look simple,

Re: Two instances of Kafka consumer reading same partition

Can you attach broker and consumer logs to the JIRA ? Thanks On Mon, Mar 19, 2018 at 6:15 AM, Narayan Periwal wrote: > Hi, > > We are facing an issue with the Kafka consumer, the new library that got > introduced in 0.9 > > We are using Kafka broker 0.10.2.1 and consumer client version is also

Two instances of Kafka consumer reading same partition

Hi, We are facing an issue with the Kafka consumer, the new library that got introduced in 0.9 We are using Kafka broker 0.10.2.1 and consumer client version is also 0.10.2.1 The issue that we have faced is that, after rebalancing, some of the partitions gets consumed by 2 instances within a co