Re: Kafka Streams: Dynamic Topic Routing & Nonexistent Topics

2020-07-08 Thread Rhys Anthony McCaig
ot sufficient, and the latter should be rare case assuming you set the > buffer.size to be reasonably large. But note that since max.block is a > global config it may also affect other blocking calls like txn-related ones > as well. > > > On Wed, Jul 1, 2020 at 6:10 PM Rhys Antho

Kafka Streams: Dynamic Topic Routing & Nonexistent Topics

2020-07-01 Thread Rhys Anthony McCaig
Hi All, I have been recently working on a streams application that uses a TopicNameExtractor to dynamically route records based on the payload. This streams application is used by various other applications, and occasionally these other applications request for a record to be sent to a non-existen

Kafka Streams: Dynamic Topic Routing & Nonexistent Topics

2020-07-01 Thread Rhys Anthony McCaig
Hi All, I have been recently working on a streams application that uses a TopicNameExtractor to dynamically route records based on the payload. This streams application is used by various other applications, and occasionally these other applications request for a record to be sent to a non-existen

[jira] [Created] (KAFKA-6963) KIP-308: Add a Kafka Source Connector to Kafka Connect

2018-05-28 Thread Rhys Anthony McCaig (JIRA)
Rhys Anthony McCaig created KAFKA-6963: -- Summary: KIP-308: Add a Kafka Source Connector to Kafka Connect Key: KAFKA-6963 URL: https://issues.apache.org/jira/browse/KAFKA-6963 Project: Kafka