[ 
https://issues.apache.org/jira/browse/FLINK-20175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239289#comment-17239289
 ] 

Dawid Wysakowicz commented on FLINK-20175:
------------------------------------------

I am currently checking if it is feasible. I am running a backported version on 
my azure: 
https://dev.azure.com/wysakowiczdawid/Flink/_build/results?buildId=578&view=results

Unfortunately a backport is not as easy as simply cherry picking.

> Avro Confluent Registry SQL format does not support adding nullable columns
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-20175
>                 URL: https://issues.apache.org/jira/browse/FLINK-20175
>             Project: Flink
>          Issue Type: Bug
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table 
> SQL / Ecosystem
>    Affects Versions: 1.12.0, 1.11.2
>            Reporter: Dawid Wysakowicz
>            Assignee: Dawid Wysakowicz
>            Priority: Critical
>             Fix For: 1.12.0
>
>
> The {{AvroSchemaConverter#convertToSchema}} generates a union with "null" for 
> nullable logical types, but it does not set the default value to null. In 
> turn it makes it impossible to generate a backwards compatible schema from a 
> DDL statement.
> Example:
> 1. Create a table: {{CREATE TABLE t (id INT NOT NULL) WITH (/* avro confluent 
> format*/)}}
> 2. Create a new table over the same topic or alter the old table with 
> {{CREATE TABLE newT(id INT NOT NULL, optionalDescription STRING) WITH (/* 
> avro confluent format */)}}
> 3. When reading from {{newT}} records inserted into {{t}} it will fail, 
> because the {{optionalDescription}} has no default value.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to