Re: suscribe

2016-12-23 Thread Matthias J. Sax
See: http://kafka.apache.org/contact On 12/22/16 7:25 PM, em vee wrote: > > signature.asc Description: OpenPGP digital signature

Kafka offset monitoring sounds not support `kafka 0.10.1.0`.

2016-12-23 Thread Tony Liu
Hi, I am trying to use KafkaOffsetMonitor to monitor kakfa consumer Lag, but I can not see any consumer offset information. so I doubt there may be `KafkaOffsetMonitor` not support `kafka 0.10.1.0`, is anyone running into the issue I am encounter

Re: Common client metrics - per request?

2016-12-23 Thread Guozhang Wang
Hi Stevo, Common requests for producers and consumers are only metadata, and for admin clients its request like describe groups are not used in other clients either, so I feel common client metrics per request / response do not cover much of the requests since most of the time most requests wont h

Re: Failure metrics

2016-12-23 Thread Guozhang Wang
Gaurav, Those two metrics are server-side ones which records when an unexpected exception happens when handling the request. However, if the request even failed to reach the broker at all, they will not be recorded in this metrics. You can take a look at this section of the web site, which includ

Re: [ANNOUCE] Apache Kafka 0.10.1.1 Released

2016-12-23 Thread Guozhang Wang
Allen, Please see my previous email. The asf-site repo has been updated, but we cannot control when it will be reload and reflected in the web site yet. Usually it takes 5 min to a couple hours, but this time it somehow has not refreshed yet. Guozhang On Fri, Dec 23, 2016 at 12:07 PM, allen ch

Re: Is it a bad idea to use periods within a consumer group name? "my-service.topic1_consumer_group"

2016-12-23 Thread Jeff Widman
Thanks Praveen. I realized I'd been mis-remembering the warning that I'd been seeing. The limitation is for topic names, not consumer group names: *WARNING: Due to limitations in metric names, topics with a period ('.') or underscore ('_') could collide. To avoid issues it is best to use either,

Re: [ANNOUCE] Apache Kafka 0.10.1.1 Released

2016-12-23 Thread allen chan
>From what i can tell, it looks like the main kafka website is not updated with this release. Download page shows 0.10.1.0 as latest release. The above link for release notes does not work either. Not Found The requested URL /dist/kafka/0.10.1.1/RELEASE_NOTES.html was not found on this server. O

Re: can kafka 10 stream API read the topic from a Kafka 9 cluster?

2016-12-23 Thread Hans Jespersen
No. All Java clients (including Streams) need to be the same version (or lower) as the brokers they connect to. -hans > On Dec 23, 2016, at 1:03 AM, Sachin Mittal wrote: > > Is Kafka streams 0.10.2.0-SNAPSHOT compatible with 0.10.0.1 broker. > I was facing broker connect issue and it just d

Re: Heavy traffic between Kafka nodes

2016-12-23 Thread Hans Jespersen
How much more data is flowing between the two nodes versus the total ingress rate of the cluster? I would expect inter-broker bandwidth use to be about the same as the ingress rate for the entire cluster since all the data coming into node 1 needs to get replicated to node 2 (for redundancy) and

Re: what is the key used for change log topic backed by windowed store

2016-12-23 Thread Damian Guy
Hi Sachin, The key is a combination of the record key + window start time + a sequence number. The timestamp is 8 bytes and the sequence number is 4 bytes. Thanks, Damian On Thu, 22 Dec 2016 at 15:26 Sachin Mittal wrote: > Hi All, > Our stream is something like > > builder.stream() > .

Re: Error in kafka-stream example

2016-12-23 Thread Damian Guy
Hi, Have you tried building the examples with the provided pom.xml? Last i checked it all compiled and worked. Thanks On Thu, 22 Dec 2016 at 16:13 Amrit Jangid wrote: > Hi All, > > I want to try out kafka stream example using this example : > > https://github.com/confluentinc/examples/blob/3.1

Re: question about property advertised.listeners

2016-12-23 Thread Aki Yoshida
Hi Kaufman, I wasn't thinking of using listeners to switch the running port itself. That makes it very simple. It was stupid of me. thank you. regards, aki 2016-11-30 17:43 GMT+01:00 Kaufman Ng : > The advertised.listeners property would not help you to map a different > port. If you need to talk

Heavy traffic between Kafka nodes

2016-12-23 Thread Herbert Fischer
Hi, I have a two node Kafka cluster, and I'm catching some unusual "TCP retransmission" metrics from my monitoring. I did found out that the network is a bit overloaded and most of it it's because the communication between both nodes is too chatty. It seems that there's more traffic between the n

Re: can kafka 10 stream API read the topic from a Kafka 9 cluster?

2016-12-23 Thread Sachin Mittal
Is Kafka streams 0.10.2.0-SNAPSHOT compatible with 0.10.0.1 broker. I was facing broker connect issue and it just did not work. Thanks Sachin On Fri, Dec 23, 2016 at 4:25 AM, wrote: > Kafka clients (currently) do not work against older Kafka brokers/servers > so you have no other option but to