Huang Xingbo created FLINK-22612:
------------------------------------
Summary: Reconstruct coders in PyFlink
Key: FLINK-22612
URL: https://issues.apache.org/jira/browse/FLINK-22612
Project: Flink
Issue Type: Improvement
Components: API / Python
Affects Versions: 1.14.0
Reporter: Huang Xingbo
Assignee: Huang Xingbo
Fix For: 1.14.0
Now, PyFlink has introduced many top-level coder. The top-level coder is
defined as used by `Python Operation` directly. Currently, some top-level coder
comes with the semantics of function, such as `TableFunctionCoder`. In fact, we
need to remove this semantic and remove many coders such as
`TableFunctionCoder`, `AggregateFunctionCoder` and so on. For the data
structure type to be processed, there will only be `FlattenRowCoder`(used in
udf, udtf.., the type of data will be List), `TopRowCoder`(used in udaf,
udtagg, the type of data will be Row or InternalRow), `RawCoder`(used in
datastream, the type of data will be raw data type), `ArrowCoder`(used in
pandas udf, the type of data will be pandas data structure).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
