Re: [VOTE] 0.11.0.0 RC2

Hi, One super minor issue (that can be fixed without a new RC): The big exactly-once stuff (KIP-98) doesn't actually show up as new features in the release notes. Most chunks appear as sub-tasks, but the new feature itself (KAFKA-4815) is marked as 0.11.1.0 so this is missing. I get that this is c

Re: [kafka-clients] Re: [VOTE] 0.11.0.0 RC2

Hi, Ismael, Thanks for running the release. +1. Verified quickstart on the 2.11 binary. Jun On Mon, Jun 26, 2017 at 3:53 PM, Ismael Juma wrote: > Hi Vahid, > > There are a few known issues when running Kafka on Windows. A PR with some > fixes is: https://github.com/apache/kafka/pull/3283. The

Re: KStreams to KTable join

If I understand it right, I need to pass the key and ensure that I handle it correctly in the pojo constructor. Let me give it a shot. - Shekar On Mon, Jun 26, 2017 at 4:42 PM, Guozhang Wang wrote: > I think your issue is in two folds: > > 1) if the coming record's key is null, then when it flo

Re: KStreams to KTable join

If I understand it right, I need to pass the key and ensure that I handle it correctly in the pojo constructor. Let me give it a shot. - Shekar On Mon, Jun 26, 2017 at 4:42 PM, Guozhang Wang wrote: > I think your issue is in two folds: > > 1) if the coming record's key is null, then when it flo

Re: KStreams to KTable join

I think your issue is in two folds: 1) if the coming record's key is null, then when it flows into the join processor inside the topology this record will be dropped as it cannot be joined with any records from the other stream. 2) the NPE you are getting when giving it the non-null keyed record

Re: [VOTE] 0.11.0.0 RC2

Hi Vahid, There are a few known issues when running Kafka on Windows. A PR with some fixes is: https://github.com/apache/kafka/pull/3283. The fact that the index cannot be accessed indicates that it may be a similar issue. I suggest we move this discussion to the relevant JIRAs instead of the rele

Re: [VOTE] 0.11.0.0 RC2

Hi Ismael, This is the output of core tests from the start until the first failed test. kafka.admin.AdminRackAwareTest > testAssignmentWithRackAwareWithUnevenRacks PASSED kafka.admin.AdminRackAwareTest > testAssignmentWith2ReplicasRackAware PASSED kafka.admin.AdminRackAwareTest > testAssign

JdbcSourceConnector connector configuration is invalid

Hi, We are trying to pull some data from HANA into Kafka. When run in Stand-alone mode, the following configuration works as expected (I have SAP jar in right place). name=hana-jdbc connector.class=io.confluent.connect.jdbc.JdbcSourceConnector tasks.max=5 connection.url=jdbc:sap://:30015/?databas

Re: [VOTE] 0.11.0.0 RC2

Hi Vahid, Can you please check which test fails first? The errors you mentioned can happen if a test fails and doesn't clean-up properly. Ismael On Mon, Jun 26, 2017 at 8:41 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi Ismael, > > To answer your questions: > > 1. Yes, the issu

Re: [VOTE] 0.11.0.0 RC2

Hi, Heroku has been doing additional performance testing on (1) log compaction and, separately (2) Go clients with older message format against 0.11-rc2 brokers with new message format. For log compaction, we've tested with messages using a single key, messages using unique keys, and messages wit

Re: [VOTE] 0.11.0.0 RC2

Hi Ismael, To answer your questions: 1. Yes, the issues exists in trunk too. 2. I haven't checked with Cygwin, but I can give it a try. And thanks for addressing this issue. I can confirm with your PR I no longer see it. But now that the tests progress I see quite a few errors like this in co

Re: Exposing Kafka Topic to External Parties

Hi Joe, For #2, if brokers and clients trust a certain certificate authority (CA), you should be able to just sign a new certificate with that CA (without having to explicitly share said cert with all parties). - Samuel On Fri, Jun 23, 2017 at 3:10 AM, Joe San wrote: > Dear Kafka Users, > > Wo

Re: kafka-streams repeatedly rebalances on start up

Great. Thanks a lot for confirming! :) -Matthias On 6/26/17 4:58 AM, Tom Dearman wrote: > Hi Matthias, > > This problem seems to be fixed in 0.11.0.0 client. > > Thanks, > > Tom >> On 17 Jun 2017, at 01:11, Matthias J. Sax wrote: >> >> Hi Tom, >> >> Thanks a lot for reporting this. We dug int

Re: Kafka Connect Transformations - tranformations for value broken on tombsone events

Would you mind logging an issue against the Kafka Connect component in our JIRA? https://issues.apache.org/jira/projects/KAFKA Thanks! On Sun, Jun 25, 2017 at 8:21 AM, 男Danngo wrote: > Hi all, > > I'm trying to use the transformation for Kafka Connect and running into > issues. > > > The tranfo

ECCN code for Kafka 0.10.2.1

Hi, We in Ericsson are interested in the SW Kafka 0.10.2.1 from Apache. In order to begin the trade compliance process, could you please send us the ECCN codes for that SW. Best regards Céline Heerdt [Ericsson] Céline Heerdt Project Manager Ericsson 25 Avenue Carnot 9

Re: kafka-streams repeatedly rebalances on start up

Hi Matthias, This problem seems to be fixed in 0.11.0.0 client. Thanks, Tom > On 17 Jun 2017, at 01:11, Matthias J. Sax wrote: > > Hi Tom, > > Thanks a lot for reporting this. We dug into it. It's easy to reproduce > (thank a lot to describe a simple way to do that) and it seems to be a > bug

Re: Broker-side Compression and Migration to lz4

Hi Sven, If you change the topic config, any new data received by that broker will be in the new compression type. However, followers don't uncompress data, so they will store the data as it was in the leader. An easier way to test what you are trying to test is to use MirrorMaker to mirror the da

Broker-side Compression and Migration to lz4

Hi,   1. I would like to test lz4 compression on a new broker node that I want add to my cluster, while the other nodes remain in snappy, in order to compare disk usage etc. I am not sure if this scenario is even possible with only one cluster, since in the docs it is mentioned that compression

Re: [VOTE] 0.11.0.0 RC2

Hi Vahid, Sorry for not replying to the previous email, I had missed it. A couple of questions: 1. Is this also happening in trunk? Seems like it should be the case for months and seemingly no-one reported it until the RC stage. 2. Is it correct that this only happens when compiling on Windows wi

New consumer - mirror maker - blacklist

Hi All, The docs currently say the following: However, --blacklist is not supported when the new consumer has been enabled (i.e. when bootstrap.servers has been defined in the consumer configuration) Is there an alternative to using a blacklist when using the new consumer type? So that it is pos