Kafka - DC, DR (Data Recovery) replication with 0 RPO

Hi Team, Hope you are doing great!! This is Rakesh and I am managing Apache Kafka administration in an organization. Currently I am using Kafka version 2.4. I have few queries related to Kafka data replication among multiple Kafka clusters. 1. The first query is that, how to achieve 0 RPO or 0 d

Re: Redis as state store

Hello Mohan, I think what you had in mind works with Redis, since it is a remote state store engine, it does not have the co-partitioning requirements as local state stores. One thing you'd need to tune KS though is that with remote stores, the processing latency may be larger, and since Kafka St

Re: Error in Kafka property file contains no connector type

Ok this try to stream kafka topic to BigQuery has moved on but I am now getting this error [2021-03-12 20:17:41,870] ERROR Stopping due to error (org.apache.kafka.connect.cli.ConnectStandalone:122) j*ava.lang.NoSuchMethodError: org.apache.kafka.common.acl.AclBindingFilter.(Lorg/apache/kafka/common

[VOTE] 2.6.2 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 2.6.2. Apache Kafka 2.6.2 is a bugfix release and fixes 30 issues since the 2.6.1 release. Please see the release notes for more information. Release notes for the 2.6.2 release: https://

Error upgrading KafkaStreams

Hi I have Kafka brokers running on version 2.4.1, with a KafkaStreams app on 2.4.0. I'm trying to upgrade my KafkaStreams to v2.7.0, but I got my instances stuck on startup. In my understanding, I don't need any special procedure to upgraded from KStreams 2.4.0 to 2.7.0, right? The following error

Re: Error in Kafka property file contains no connector type

Thanks again Liam. This is the error [2021-03-12 14:17:54,670] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:113) java.lang.NoClassDefFoundError: org/apache/kafka/common/config/ConfigDef$CaseInsensitiveValidString at com.wepay.kafka.connect.bigquery.

Re: Error in Kafka property file contains no connector type

I feel your CLASSPATH env var might need to include $KAFKA_HOME/lib (it should already have the common conf lib in there). On Fri, 12 Mar. 2021, 10:33 pm Mich Talebzadeh, wrote: > Thanks Liam for the suggestion. > > This is the redone sink file (plain text) > > name=bigquery-sink > connector.ty

Re: Kafka Streams - Out of Order Handling

Thanks Matthias - that's great to know. > Increasing the grace period should not really affect throughput, but > latency. Yes, a slip of the tongue on my part, you’re right :-) One last question if I may? I only see issues of out of order data in my re-partitioned topic as a result of a rebalan

Re: Error in Kafka property file contains no connector type

Thanks Liam for the suggestion. This is the redone sink file (plain text) name=bigquery-sink connector.type=bigquery-connector connector.class=com.wepay.kafka.connect.bigquery.BigQuerySinkConnector defaultDataset=test project=axial-glow-224522 topics=md autoCreateTables=false gcsBucketName=tmp_st