Re: performance regression with 0.10.2.0 client talking to 0.10.0.1 servers

Hi Alex, Yes, please file a JIRA and include as much detail as possible: configs used by the broker and producer/consumer (it wasn't clear which had the issue), message size and a sketch of what the code is doing and what is being measured. Thanks, Ismael On Thu, Mar 9, 2017 at 4:24 AM, Alex Coz

Re: Strange behaviour in Session Windows

Hi Marco, FYI this has now been merged to trunk and 0.10.2. If you wanted to try it out i'd probably suggest checking out building the 0.10.2 branch. Thanks, Damian On Tue, 7 Mar 2017 at 17:57 Damian Guy wrote: > Hi Marco, > > Absolutely no problem at all. I'm glad it work it out. For referenc

Kafka Streams question

Hello. I'm a new who started learning the one of the new Kafka functionality, aka Kafka Stream. As far as I know, the simplest usage of the Kafka Stream is to do something like parsing, which forward incoming data from a topic to another topic, with a few changing. So... Here is what I'd want to

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

Thanks for the update, Matthias. +1 to the points 1,2,3,4 you mentioned. Naming is always a tricky subject, but renaming KStreamBuilder to StreamsTopologyBuilder looks ok to me (I would have had a slight preference towards DslTopologyBuilder, but hey.) The most important aspect is, IMHO, what yo

Re: Kafka Streams question

There's actually a demo application that demonstrates the simplest use case for Kafka's Streams API: to read data from an input topic and then write that data as-is to an output topic. https://github.com/confluentinc/examples/blob/3.2.x/kafka-streams/src/test/java/io/confluent/examples/streams/Pa

Changing "logs" directory path

Hi all, is there a way to change the directory path where Kafka put its "logs". I'm speaking about not logs in terms of topic data of course, but the text files for logging. By default a "logs" directory is created in the root dir of kafka. I'd like to change this path. Thanks, Paolo. Pa

Re: Changing "logs" directory path

We can use LOG_DIR environment variable to set logs directory. On Thu, Mar 9, 2017 at 4:17 PM, Paolo Patierno wrote: > Hi all, > > > is there a way to change the directory path where Kafka put its "logs". > I'm speaking about not logs in terms of topic data of course, but the text > files for lo

Re: Changing "logs" directory path

Thanks ! There is a documentation page for all main environment variables used by Kafka ? Thanks, Paolo. Paolo Patierno Senior Software Engineer (IoT) @ Red Hat Microsoft MVP on Windows Embedded & IoT Microsoft Azure Advisor Twitter : @ppatierno Linkedin : paolo

Re: Changing "logs" directory path

we have not documented any environment variables. you can go through bin/kafka-run-class.sh script to know the variables. I will add some documentation. On Thu, Mar 9, 2017 at 4:30 PM, Paolo Patierno wrote: > Thanks ! > > There is a documentation page for all main environment variables used by

Streams - Got bit by log levels of the record cache

Hi, I just wanted to share how we misinterpreted logs from Streams at the INFO level. Version 0.10.1.1, I think it's the same for 0.10.2.0. So, we configured `commit.interval.ms` and `cache.max.bytes.buffering`, and we expected to always reach the commit interval before the maximum bytes. It was

Need help in solving log duplication issue when throttling is enabled in Kafka

Hi, I currently face log duplication issue in my setup after enabling log throttling in kafka. *Change applied to enable log throttling :* quota.producer.default=102400 #100Kbps *How my setup looks :* Hekad agents (producers) -> Kafka -> ELK stack (consumers) This error conditions (duplicate

Re: Streams - Got bit by log levels of the record cache

Hi Nicolas, Please do file a JIRA. Many thanks, Damian On Thu, 9 Mar 2017 at 15:54 Nicolas Fouché wrote: > Hi, > > I just wanted to share how we misinterpreted logs from Streams at the INFO > level. Version 0.10.1.1, I think it's the same for 0.10.2.0. > > So, we configured `commit.interval.ms

Please add to Powered-by page

Our FX division is powered by Kafka [INTL_FCStone-Logo] Nolan Schiff 230 S. LaSalle St. Suite 10-500 Chicago, IL 60604 Phone: 312.780.6871 Cell: 312.513.0836 www.intlfcstone.com INTL FCStone Financial Inc. (IFCF) is a member of FINRA/NFA/SIPC and registered with the

Re: Kafka Streams question

Thank you very much for the information! 2017-03-09 19:40 GMT+09:00 Michael Noll : > There's actually a demo application that demonstrates the simplest use case > for Kafka's Streams API: to read data from an input topic and then write > that data as-is to an output topic. > > https://github.co

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

Thanks Matthias, the updated KIP lgtm overall. A couple of minor comments: 1. With regard to this class: public final class Source implements Node { public final String name; public final String topic; // can be topic name or pattern (as String) } Note that the source nod

KAFKA (0.10.0.0) - Error while fetching metadata with correlation id

Hi, We are running KAFKA 0.10.0.0 but at times I see below error while starting STORM topologies. org.apache.kafka.clients.NetworkClient WARN - Error while fetching metadata with correlation id 325376 : {aceb3102-62d9-4809-b01b-6c69ebacbc90=UNKNOWN} Looks like KAFKA consumer i