Re: Cannot terminate query on KSQL

Hi, thank you for your reply, I opened an issue here: https://github.com/confluentinc/ksql/issues/5107 > Il giorno 17 apr 2020, alle ore 21:01, Guozhang Wang ha > scritto: > > Hi Federico, > > I'd think you could re-post this question her

Kafka Meetup hosted by Confluent Online, Tuesday 4:00pm, April 21st, 2020

Hello folks, The Bay Area Kafka meetup will continue to be hosted online this month, next Tuesday (April 21st) 4:00pm. We will be presenting the current on going work for a Kafkaesque Raft Protocol: https://cwiki.apache.org/confluence/display/KAFKA/KIP-595%3A+A+Raft+Protocol+for+the+Metadata+Quoru

Re: New CoGroup, how to do a left join

I think it is an appropriate to support multi-way joins of KTables (including outer, left), but it is not necessarily an extension of the "co-group" syntax. We can start this discussion as a separate KIP. Guozhang

Re: Cannot terminate query on KSQL

Hi Federico, I'd think you could re-post this question here: https://github.com/confluentinc/ksql/issues. Cheers, Guozhang On Fri, Apr 17, 2020 at 8:57 AM Federico D'Ambrosio wrote: > So, I tried with another query which hangs and I get this, after its > corresponding TERMINATE command: > > [

Re: Cannot terminate query on KSQL

So, I tried with another query which hangs and I get this, after its corresponding TERMINATE command: [2020-04-17 15:25:15,796] INFO stream-client [_confluent-ksql-default_query_CSAS_PROD_GTEL_AFA_GOL_ANAGRAFE_CARTE_CREDITO_INTERNAL_AVRO_166-1207a327-6eed-4c74-9787-95825e1bec43] State transition f

Re: Getting Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' all the time

Look for a solution with precompiled libraries. You are messing with forces you cannot controle yet my friend Le ven. 17 avr. 2020 à 15:29, Naveen Kumar M a écrit : > Hello Nicolas, > > Yes I have tried gradlew jarAll where gradlew file is available as I am > trying to run on windows machine.

Re: How to add partitions to an existing kafka topic

Hi Sachin, I’m a bit hazy on the details of the broker partition expansion feature. It’s been a while since I looked at it. But you actually control the key-to-partition mapping at the producer side. The producer’s default partitioner just hashes the keys over the partition, but you could plug

Re: New CoGroup, how to do a left join

Hi Guozhang Thank you very much for your response. Since KStream does not have an aggregate method, I guess you meant: "builder.stream("customer").groupByKey()", which can then be used in the CoGroup, and there I'd probably need an aggregation like this: (Long key, Customer value, Customer agg) ->

Confluent Virtual User Group (VUG)

We may not be able to go to meetups in person at the moment to learn and chat with our friends in the community about Confluent Platform and Apache Kafka, but Confluent Virtual User Group (VUG) is the next best thing 😀 Meetups are held online and across a variety of timezones so that everyone gets

Consumer Group got stuck in PreparingRebalance

Hi All, I have a problem with the latest kafka release (2.4.0). Some consumer after few days running (2-3 days usually) have a problem to consume data, It does not receive any record. The consumer from client side seems to be active but inside the broker I can see that the consumer group is st

Re: Getting Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' all the time

Hello Nicolas, Yes I have tried gradlew jarAll where gradlew file is available as I am trying to run on windows machine. But getting below error. 'gradlew' is not recognized as an internal or external command, operable program or batch file. Even I tried with ./gradlew jarAll, but getting belo

Re: Getting Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' all the time

Logs say to build it. Have you done that ? ./gradlew jarAll Le ven. 17 avr. 2020 à 13:21, Naveen Kumar M a écrit : > Hello Team, > > I have downloaded Source download: kafka-2.4.0-src.tgz > (asc >

linking different topics AVRO schemas with OWL/RDFS ontologies

Hello kafka community, We use Apache Kafka and microservices publishing and subscribing to the data exposed by other microservices. We use AVRO. Different microservices publish one or more topics like events topics or facts/entities/current state topics. And consume from others. Currently the dat

Getting Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' all the time

Hello Team, I have downloaded Source download: kafka-2.4.0-src.tgz (asc , sha512 ) and tryi

Re: How to set custom properties and message expiration for Kafka topic message.

Thanks Nicolas. This helps. On Fri, Apr 10, 2020 at 7:59 PM Nicolas Carlot wrote: > Ok, then you may be looking for custom headers: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-82+-+Add+Record+Headers > > > Le ven. 10 avr. 2020 à 16:08, Naveen Kumar M > a écrit : > > > Hello Nicola

New blog post: A quick and dirty way to monitor data arriving on Kafka

I thought I'd share here a short blog I wrote up recently: https://rmoff.net/2020/04/16/a-quick-and-dirty-way-to-monitor-data-arriving-on-kafka/ Enjoy :) -- Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff

Re: Cannot terminate query on KSQL

Looking back at the ksql-stream logs: I find for a query I'm trying to terminate this line: [2020-04-17 09:17:52,502] INFO stream-client [_confluent-ksql-default_query_CSAS_PROD_GTEL_AFA_GOL_PREV_GARANZIE_INTERNAL_AVRO_180-2625ef40-c00a-4cdf-98ea-df239aa2f29d] *Already in the pending shutdown sta

Cannot terminate query on KSQL

Hi, We deployed 30-something queries which convert json events to avro, but lately I've noticed some of the queries are consuming very slowly, accumulating quite a bit of lag. In order to reset those streams, I tried to terminate those queries, to then recreate the streams, but the TERMINATE comma