Re: Compacted topic, entry deletion, kafka 0.11.0.0

2017-10-06 Thread Matthias J. Sax
Setting topic policy to "compact,delete" should be sufficient. Cf. https://cwiki.apache.org/confluence/display/KAFKA/KIP-71%3A+Enable+log+compaction+and+deletion+to+co-exist Note: retention time is not based on wall-clock time, but embedded record timestamps. Thus, old messages get only deleted if

Compacted topic, entry deletion, kafka 0.11.0.0

2017-10-06 Thread Asko Alhoniemi
Hello I understand that the compacted topic is meant to keep at least the latest key value pair. However, I am having an issue since it can happen that entry becomes old and I need to remove it. It may also occur, that I am not able to send key "null" pair. So I need another method to remove my h

Re: Kafka 0.11.0.0

2017-08-14 Thread Ismael Juma
Hi Srikanth, 0.11.0.0 is looking pretty good so far. One concern is: https://issues.apache.org/jira/browse/KAFKA-5600 There is no concrete plan for 0.11.0.1, but I'd expect a RC within a few weeks (2 to 4, probably). Ismael On Mon, Aug 14, 2017 at 5:15 AM, Srikanth Sampath wrote: > Hi, > We

Re: Kafka 0.11.0.0

2017-08-14 Thread Thomas Crayford
0.11.0.0 is a brand new release, with a very large number of changes compared to the previous stable release (0.10.2.1). As a thing that stores data, I would not recommend you switch to it without a very large amount of testing and validation, probably involving running a shadow setup of your produ

Kafka 0.11.0.0

2017-08-13 Thread Srikanth Sampath
Hi, We are currently on 0.8.2.2 in production and are planning on moving to the latest stable release which currently is 0.11.0.0. Have a few questions: * Folks who are on 0.11.0.0 in production - can you comment on how stable is it? Any problems? * Usually, I look for a maintenance release, is

Re: [ANNOUNCE] Apache Kafka 0.11.0.0 Released

2017-06-28 Thread Manikumar
__ > From: Ismael Juma > Sent: Thursday, June 29, 2017 12:52 AM > To: annou...@apache.org; Kafka Users; d...@kafka.apache.org; kafka-clients > Subject: [ANNOUNCE] Apache Kafka 0.11.0.0 Released > > The Apache Kafka community is pleased to announce the

Re: [ANNOUNCE] Apache Kafka 0.11.0.0 Released

2017-06-28 Thread Paolo Patierno
.linkedin.com/in/paolopatierno> Blog : DevExperience<http://paolopatierno.wordpress.com/> From: Ismael Juma Sent: Thursday, June 29, 2017 12:52 AM To: annou...@apache.org; Kafka Users; d...@kafka.apache.org; kafka-clients Subject: [ANNOUNCE] Apache Kafka

Re: [ANNOUNCE] Apache Kafka 0.11.0.0 Released

2017-06-28 Thread Vahid S Hashemian
+1. Thank you Ismael for your hard work on this release. --Vahid From: Guozhang Wang To: "d...@kafka.apache.org" Cc: "users@kafka.apache.org" , annou...@apache.org, kafka-clients Date: 06/28/2017 07:22 PM Subject:Re: [ANNOUNCE] Apache Kafka 0.11.0.

Re: [ANNOUNCE] Apache Kafka 0.11.0.0 Released

2017-06-28 Thread Guozhang Wang
ed to announce the release for Apache > > Kafka 0.11.0.0. This is a feature release which includes the completion > > of 32 KIPs, over 400 bug fixes and improvements, and more than 700 pull > > requests merged. > > > > All of the changes in this release can be found in

Re: [ANNOUNCE] Apache Kafka 0.11.0.0 Released

2017-06-28 Thread Jun Rao
Hi, Ismael, Thanks a lot for running this release! Jun On Wed, Jun 28, 2017 at 5:52 PM, Ismael Juma wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 0.11.0.0. This is a feature release which includes the completion > of 32 KIPs, over 400 bug

[ANNOUNCE] Apache Kafka 0.11.0.0 Released

2017-06-28 Thread Ismael Juma
The Apache Kafka community is pleased to announce the release for Apache Kafka 0.11.0.0. This is a feature release which includes the completion of 32 KIPs, over 400 bug fixes and improvements, and more than 700 pull requests merged. All of the changes in this release can be found in the release