One type of event per topic?

Hi everyone, I´m working in the configuration of the topics for the integration between one API and Data platform system. We have created topic for each entity that they would need to integrate in to the datawarehouse. My question and I hope you can help me is, each entity will have diferent typ

Error sink parse Json

Hi everyone, I trying to send events from the topic This is the sink json configuration I’ve used: { "name":"CPSConnector", "config":{ "connector.class":"com.google.pubsub.kafka.sink.CloudPubSubSinkConnector", "tasks.max":"1", "topics":"STREAM-CUSTOMER-ACCOUNTS", "cps.to

Best practices Partition Key

Hi everyone, I´m trying to understand the best practice to define the partition key. I have defined some topics that they are related with entities in cassandra data model, the relationship is one-to-one, one entity - one topic, because I need to ensure the properly ordering in the events. I have

Choose the number of partitions/topics

Hi everyone I have design an integration between 2 systems throug our API Stream Kafka, and the requirements are unclear to choose properly the number of partitions/topics. That is the use case: My producer will send 28 different type of events, so I have decided to create 28 topics. The max si

Consumer group

Hi everyone, I have design a kafka api solution which has define some topics, these topics are produced by other api connect with Cassandra data model. So I need to fixed the sensical order and sequential order of the events, it means i need to guarantee that create, update and delete events will

Kafka error handling

Hi everyone I'm designing a control handling for my kafka stream api. I'm would like to know any documentation or best practise that I can read. Basically I'm creating some topics error for failed messages and retry topics. Any suggestions? Thanks