Re: ProtoBuf DataStream to Table conversion issues

2023-08-27 Thread Benchao Li
> - Why does a Flink `CREATE TABLE` from Protobuf require the entire table > column structure to be defined in SQL again? Shouldn't fields be inferred > automatically from the provided protobuf class? I agree that auto schema inference is a good feature. The reason why ProtoBuf Format does not h

ProtoBuf DataStream to Table conversion issues

2023-08-27 Thread Clemens Valiente
There's friction with using scala/java protobuf and trying to convert them into a Flink Table from a DataStream[ProtobufObject]. Scenario: Input is a DataStream[ProtobufObject] from a kafka topic that we read data from and deserialise into Protobuf objects (scala case classes or alternatively Java