Re: broker logs unusable after KAFKA-6150: Make Repartition Topics Transient

Hello Henry, I saw your detailed explanations on the JIRA ticket. Thinking about this a bit more, I think moving the start offset should be as important as an event as truncating log tail, or rolling new segment etc (their log4j levels are all INFO). But I also agree that with the streams periodic

[ANNOUCE] Apache Kafka 1.0.2 Released

The Apache Kafka community is pleased to announce the release for Apache Kafka 1.0.2. This is a bug fix release and it includes fixes and improvements from 27 JIRAs, including a few critical bugs. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/k

Re: Apache Kafka QuickStart

> After executing the first command to start zookeeper, do i have to open a > Terminal to run the Kafka Server? Yes. What is the problem with this? "but run into problem in Step 2" If you follow the quickstart, you download the binaries and start multiple processes (Zookeeper, Kafka Broker, Ka

Re: Questions about state stores and KSQL

To understand joins better, you might want to check out: https://www.confluent.io/blog/crossing-streams-joins-apache-kafka/ KSQL uses the same join semantics as Kafka Streams. -Matthias On 7/11/18 8:01 AM, Guozhang Wang wrote: > Hello Jonathan, > > At the very high-level, KSQL statements is c

Re: [VOTE] 2.0.0 RC2

+1 (non-binding) - Ran testAll/releaseTarGzAll on 2.0.0-rc2 tag - Ran through quickstart of core/streams on builds generated from tag - Ran few internal apps targeting to topics on 3 node cluster. Thanks, Satish. On Sun 15 Jul, 2018, 9:55 PM Rajini Sivaram, wrote: > Hi Ismael, > > Thank you fo

Re: Error while creating ephemeral at /brokers/ids/BROKER_ID

Thanks a lot for your reply Ismael, I have filled the JIRA: https://issues.apache.org/jira/browse/KAFKA-7165 Cheers! -- Jonathan On Sat, Jul 14, 2018 at 5:25 PM Ismael Juma wrote: > Hi Jonathan, > > Can you please file a JIRA? > > Ismael > > On Sat, Jul 14, 2018 at 3:44 AM Jonathan Santilli

Re: [VOTE] 2.0.0 RC2

Hi Ismael, Thank you for pointing that out. I have re-uploaded the RC2 artifacts to maven including streams-scala_2.12. Also submitted a PR to update build & release scripts to include this. Thank you, Rajini On Fri, Jul 13, 2018 at 7:19 AM, Ismael Juma wrote: > Hi Rajini, > > Thanks for ge

Re: Accessing Zookepper and Kafka through designated ports in a container

So was it your sasl or something else? Regards, On Sun, 15 Jul 2018 at 08:40, Mich Talebzadeh wrote: > resolved this now > > Thanks > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > < > https://www.linkedin.com/profile

Re: Real time streaming as a microservice

Hi Deepak, I will put it there once all the bits and pieces come together. At the moment I am drawing the diagrams. I will let you know. Definitely everyone's contribution is welcome. Regards, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcP

Re: Real time streaming as a microservice

Is it on github Mich ? I would love to use the flink and spark edition and add some use cases from my side. Thanks Deepak On Sun, Jul 15, 2018, 13:38 Mich Talebzadeh wrote: > Hi all, > > I have now managed to deploy both ZooKeeper and Kafka as microservices > using docker images. > > The idea c

Re: Real time streaming as a microservice

Hi all, I have now managed to deploy both ZooKeeper and Kafka as microservices using docker images. The idea came to me as I wanted to create lightweight processes for both ZooKeeper and Kafka to be used as services for Flink and Spark simultaneously. In this design both Flink and Spark rely on

Re: Accessing Zookepper and Kafka through designated ports in a container

resolved this now Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own

Re: Real time streaming as a microservice

Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsi