Re: Time stamp in Kafka

whats-the-time-and-why/ >> >> >> -Matthias >> >>> On 8/15/20 11:48 AM, KhajaAsmath Mohammed wrote: >>> Hi, >>> >>> I don’t have code related to it. It is pushed by other team who uses >> .net framework to push data into Kafka t

Re: Time stamp in Kafka

:44 PM, pierreneter wrote: > > can you show a little of your code related to that? > >> On Sat, Aug 15, 2020 at 11:50 PM KhajaAsmath Mohammed < >> mdkhajaasm...@gmail.com> wrote: >> >> Hi, >> >> We have a producer application that has writt

Time stamp in Kafka

Hi, We have a producer application that has written data to Kafka topic. We are reading the data from Kafka topic using spark streaming but the time stamp on Kafka is 1969-12-31 format for all the data. Is there a way to fix this while reading ? Thanks, Asmath Sent from my iPhone

Kstreams Database

Hi, I have a requirement where I need to read records from the database and load them as JSON into kafka topic. Next step is to handle only updates. I was successful using this for Kafkaconnect for mysql but unfortunately I cannot using kafka connect due to restrictions from database team. Is th

Re: Apache Kafka Streams with Sprinng Boot

Hello Suresh, I am also looking for the same. Let me know if you find anything Sent from my iPhone > On Apr 28, 2020, at 8:25 PM, Suresh Chidambaram > wrote: > > Hi Team, > > Greetings. > > I have been looking for an example application which uses Kafka Streams > with Spring Boot, but I'm

Access Kafka cli for SASL Kafka cluster

Hi, I am having trouble accessing the Secured sasl Kafka cluster from my windows laptop. I do have Confluent Kafka installed but not able to access the Kafka cluster to create topic and change retention policy on topics residing in cluster. Any suggestions on how to achieve this ? Thanks, Asma

Re: Process offsets from particular point

to consume records [2]. > > > https://kafka.apache.org/24/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html > https://mapr.com/docs/61/MapR_Streams/example-TimeBasedConsumer.html > > --Senthil >> On Sat, 11 Apr 2020, 6:24 pm KhajaAsmath Mohammed, >> wr

Process offsets from particular point

Hi, We have lost some data while processing and would like to reprocess it. May I know the procedure to do it . I have offsets numbers that I need to process. Any suggestions please. Would be really helpful. Thanks, Asmath Sent from my iPhone

KSQL - SQL query file

Hi, I am looking to run the ksql query with the queries file in windows. May I know how to acheive this? I cannot run directly on CLI as the query has more than 3000+ columns. I am looking to create stream with it Thanks, Asmath

Re: Kafka connect issue with mysql - Debezium CDC

Hi, I was able to resolve this issue by changing the name of server to docker container name. [image: image.png] Thanks, Asmath On Wed, Dec 25, 2019 at 8:30 PM KhajaAsmath Mohammed < mdkhajaasm...@gmail.com> wrote: > Hi, > > I am trying to do POC for kafka CDC with database and

Kafka connect issue with mysql - Debezium CDC

Hi, I am trying to do POC for kafka CDC with database and ingest it into kafka. I have been trying to make it work from past 5 days and had no luck. can someone help me what is wrong in my approach. Error Received: *{"error_code":400,"message":"Connector configuration is invalid and contains the

Re: Monitor Kafka connect jobs

threshold of an acceptable > number of failures ) > Hope this helps, > Jamie > > > -Original Message- > From: KhajaAsmath Mohammed > To: users > Sent: Thu, Oct 24, 2019 03:52 PM > Subject: Monitor Kafka connect jobs > > > Hi, > > >

Monitor Kafka connect jobs

Hi, We are using kafka connect in production and I have few questions about it. when we submit kafka connect job using rest api . Job gets continously running in the background and due to some issues, lets say we restarted kafka cluster. do we need to start manually all the jobs again? Is there

Re: Ksql with schema registry

try. See docs for more details > https://docs.confluent.io/current/ksql/docs/installation/server-config/avro-schema.html > > > -- > > Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff > > > On Sat, 5 Oct 2019 at 20:37, KhajaAsmath Mohammed &g

Ksql with schema registry

Hi, What is the configuration that I need to follow to register schema registry on ksql client installed in my machine that connects to cluster. Creating stream with select should create schema automatically in schema registry . Thanks, Asmath Sent from my iPhone

Re: Kstream to Kafka table

umentation/streams/developer-guide/dsl-api.html > if you need to push to a output topic, in DSL there is a #to(String topic) > function which will write the stream output to your intended topic. > > Boyang > > On Fri, Oct 4, 2019 at 8:43 AM KhajaAsmath Mohammed > wrote: > &g

Kstream to Kafka table

Hi, I have kstreams table that was created from select statement of ksql table and kstreams. Since kstream is process, how do I need to push the data into kafka topic from this stream? I also want the schema to be created in schema registry for this topic. Thanks, Asmath

Kstreams and Schema registry question

Hi, I have kstream in our cluster. I am not sure how the schema is generated for this. Dpes kstream have schema in schema registry? How to move data from kstream to topic which has the same name? How to register schema automatically for this? This is how schema looks in our registry. My assumpti