Re: Can't access Debezium metadata fields in Kafka table

2021-09-26 Thread Leonard Xu
Hi, Harshvardhan The format debezium-avro-confluent doesn’t support read metadata yet[1], the supported formats including debezium-json, canal-json and maxwell-json, you can try the supported formats. Best, Leonard [1] https://issues.apache.org/jira/browse/FLINK-20454

Re: Can't access Debezium metadata fields in Kafka table

2021-09-23 Thread Harshvardhan Shinde
Hi, Here's the complete error log: [ERROR] Could not execute SQL statement. Reason: org.apache.flink.table.api.ValidationException: Invalid metadata key 'value.ingestion-timestamp' in column 'origin_ts' of table 'flink_hive.harsh_test.testflink'. The DynamicTableSource class 'org.apache.flink.stre

Re: Can't access Debezium metadata fields in Kafka table

2021-09-23 Thread Roman Khachatryan
Hi, could you please share the full error message? I think it should list the supported metadata columns. Do you see the same error with 'debezium-json' format instead of 'debezium-avro-confluent' ? Regards, Roman On Wed, Sep 22, 2021 at 5:12 PM Harshvardhan Shinde wrote: > > Hi, > I'm trying