Re: Kafka compacted topic question.

2018-01-20 Thread Rahul Bhattacharjee
Ok , so there is no attempt made for de-duplication while the row is still hot in memtable. Why is this behaviour? For compact topics we are only interested in last update for any key. thanks, Rahul On Fri, Jan 19, 2018 at 3:18 PM, Matthias J. Sax wrote: > Yes and no. > > There is a background

[jira] [Resolved] (KAFKA-5889) MetricsTest is flaky

2018-01-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-5889. --- Resolution: Cannot Reproduce > MetricsTest is flaky > > > Key: KAFKA-5889

Re: Kafka compacted topic question.

2018-01-20 Thread naresh Goud
Hi Rahul, If I understand your question correctly, you are intrested only in latest values for keys and don't want to maintain any older values immediately after update happened in a value for given key If you wanted all of segments to include in compaction consider this property value how much i

Re: Kafka compacted topic question.

2018-01-20 Thread Rahul Bhattacharjee
Thank you Naresh. It answers my question. On Sat, Jan 20, 2018 at 8:15 AM, naresh Goud wrote: > Hi Rahul, > > If I understand your question correctly, you are intrested only in latest > values for keys and don't want to maintain any older values immediately > after update happened in a value for

Re: [VOTE] KIP-227: Introduce Fetch Requests that are Incremental to Increase Partition Scalability

2018-01-20 Thread Colin McCabe
On Fri, Jan 19, 2018, at 15:02, Jun Rao wrote: > Hi, Colin, > > Thanks for the KIP. Looks good to me overall. Just a couple of more > comments. > > 1. As I mentioned earlier, it might be useful to add some metrics for > monitoring the usage of the session cache. For example, it would be useful >

[jira] [Resolved] (KAFKA-6366) StackOverflowError in kafka-coordinator-heartbeat-thread

2018-01-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6366. Resolution: Fixed > StackOverflowError in kafka-coordinator-heartbeat-thread > -

Build failed in Jenkins: kafka-1.0-jdk7 #128

2018-01-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6366: Fix stack overflow in consumer due to many offset commits -- [...truncated 1.44 MB...] V extends Object declared in interface KGroupedStr

Build failed in Jenkins: kafka-trunk-jdk7 #3106

2018-01-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6366: Fix stack overflow in consumer due to many offset commits -- [...truncated 1.89 MB...] org.apache.kafka.streams.kstream.SessionWindowsTe

Build failed in Jenkins: kafka-trunk-jdk9 #321

2018-01-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6366: Fix stack overflow in consumer due to many offset commits -- [...truncated 1.86 MB...] org.apache.kafka.streams.TopologyTest > multipleSo

[jira] [Resolved] (KAFKA-4370) CorruptRecordException when ProducerRecord constructed without key nor partition and send

2018-01-20 Thread Mariam John (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariam John resolved KAFKA-4370. Resolution: Duplicate Fix Version/s: 1.0.0 This is already fixed in [https://github.com/apach