Ops, my bad, I misread the initial question - Moritz pointed out that you have
the only one topic with two different schemas…
I don’t think it’s supported by KafkaIO “out-of-the-box.” In this case, you
need either to write your own deserialiser which will distinguish the schemas
for every inpu
If you have two topics with different schemas in your pipeline then you need to
read them separately with two different KafkaIO instances and configure every
instance with a proper deserialiser based on its schema.
—
Alexey
> On 9 Aug 2022, at 22:28, Sigalit Eliazov wrote:
>
> Thanks for your
Thanks for your response
we have different messages with separate schemas.
I'll review the suggested solution.
BR
Sigalit
On Tue, Aug 9, 2022 at 3:40 PM Moritz Mack wrote:
> Hi Sigalit,
>
>
>
> Could you explain a bit more in detail what you mean by 2 different types
> of messages?
>
> Do they
Hi Sigalit,
Could you explain a bit more in detail what you mean by 2 different types of
messages?
Do they share the same schema, e.g. using a union / one of type? Or are you in
fact talking about different messages with separate schemas (e.g. discriminated
using a message header)?
The recomme
Hi all
we have a single kafka topic which is used to receive 2 different types of
messages.
These 2 messages are Avro.
So when reading messages from kafka i used the GenericRecord
KafkaIO.read()
.withBootstrapServers(bootstrapServers)
.withTopic(topic)
.withConsumerConfigUp
