[ 
https://issues.apache.org/jira/browse/FLINK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Martijn Visser reassigned FLINK-33328:
--------------------------------------

    Assignee: Peter Vary

> Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the 
> Committable
> ---------------------------------------------------------------------------------------
>
>                 Key: FLINK-33328
>                 URL: https://issues.apache.org/jira/browse/FLINK-33328
>             Project: Flink
>          Issue Type: Sub-task
>          Components: API / DataStream, Connectors / Common
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>            Priority: Major
>              Labels: pull-request-available
>
> In case of the Iceberg Sink, we would like to use the _WithPreCommitTopology_ 
> to aggregate the writer results and create a single committable from them. So 
> we would like to change both the type, and the number of the messages. Using 
> the current _WithPreCommitTopology_ interface we can work around the issue by 
> using a Tuple, or POJO where some of the fields are used only before the 
> _addPreCommitTopology_ method, and some of the fields are only used after the 
> method, but this seems more like abusing the interface than using it.
> This is a more generic issue where the _WithPreCommitTopology_ should provide 
> a way to transform not only the data, but the type of the data channelled 
> through it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to