[ 
https://issues.apache.org/jira/browse/FLINK-36339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883223#comment-17883223
 ] 

david radley commented on FLINK-36339:
--------------------------------------

[~dwysakowicz] I think this sounds like a good change to make. I curious what 
your thinking is around the migration considerations. Do you envisage 
tolerating the older java based serializations? Can we manage this change using 
versions? Or maybe have a process to freshen existing snapshots to the new form 
of serialisations.  

 

> Remove java serialization from SQL serializers
> ----------------------------------------------
>
>                 Key: FLINK-36339
>                 URL: https://issues.apache.org/jira/browse/FLINK-36339
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Dawid Wysakowicz
>            Priority: Major
>             Fix For: 2.0.0
>
>
> Some of the serializers used in SQL use java serialization in their snapshots 
> which introduces risks of state incompatibilities that are hard to fix. We've 
> seen that already with FLINK-36318
> We should get rid off that. For serializing {{LogicalType}} I'd suggest using 
> {{LogicalType#asSerializableString}}.
> For {{ArrayDataSerializerSnapshot}} and {{MapDataSerializerSnapshot}} we 
> should properly implement {{CompositeTypeSerializerSnapshot}} interface 
> instead of serializing nested {{TypeSerializers}}.
> Few of the affected classes:
> * 
> https://github.com/apache/flink/blob/1ba890062d94edc4d9ea5431d44adaeb123d9607/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/MapDataSerializer.java#L283
> * 
> https://github.com/apache/flink/blob/1ba890062d94edc4d9ea5431d44adaeb123d9607/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/ArrayDataSerializer.java#L302
> * 
> https://github.com/apache/flink/blob/1ba890062d94edc4d9ea5431d44adaeb123d9607/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/RowDataSerializer.java#L304



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to