Re: Create a lookup table in a StreamExecutionEnvironment

2021-09-10 Thread JING ZHANG
Hi Robert, First of all, the built-in Kafka connector source is not a `LookupTableSource`. If we use Kafka as a lookup table, we need to implement a user-defined source [1]. Secondly, about how to define a user-defined lookup table source for Kafka, I'm not an expert in Kafka, please correct me if

Create a lookup table in a StreamExecutionEnvironment

2021-09-10 Thread Robert Cullen
I have a developer that wants to create a lookup table in Kafka with data that will be used later when sinking with S3. The lookup table will have folder information that will be used as a Bucket Assigner in the StreamingFileSink. I thought using the Table API to generate the lookup table and bui