[
https://issues.apache.org/jira/browse/FLINK-16987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-16987:
-----------------------------------
Labels: pull-request-available stale-major (was: pull-request-available)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Major but is unassigned and neither itself nor its Sub-Tasks have been updated
for 60 days. I have gone ahead and added a "stale-major" to the issue". If this
ticket is a Major, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> FLIP-95: Add new table source and sink interfaces
> -------------------------------------------------
>
> Key: FLINK-16987
> URL: https://issues.apache.org/jira/browse/FLINK-16987
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / API, Table SQL / Planner
> Reporter: Timo Walther
> Priority: Major
> Labels: pull-request-available, stale-major
>
> Proper support for handling changelogs, more efficient processing of data
> through the new Blink planner, and unified interfaces that are DataStream API
> agnostic make it necessary to rework the table source and sink interfaces.
> The goals of this FLIP are:
> * *Simplify the current interface architecture*:
> ** Merge upsert, retract, and append sinks.
> ** Unify batch and streaming sources.
> ** Unify batch and streaming sinks.
> * *Allow sources to produce a changelog*:
> ** UpsertTableSources have been requested a lot by users. Now is the time to
> open the internal planner capabilities via the new interfaces.
> ** According to FLIP-105, we would like to support changelogs for processing
> formats such as [Debezium|https://debezium.io/].
> * *Don't rely on DataStream API for source and sinks*:
> ** According to FLIP-32, the Table API and SQL should be independent of the
> DataStream API which is why the `table-common` module has no dependencies on
> `flink-streaming-java`.
> ** Source and sink implementations should only depend on the `table-common`
> module after FLIP-27.
> ** Until FLIP-27 is ready, we still put most of the interfaces in
> `table-common` and strictly separate interfaces that communicate with a
> planner and actual runtime reader/writers.
> * *Implement efficient sources and sinks without planner dependencies*:
> ** Make Blink's internal data structures available to connectors.
> ** Introduce stable interfaces for data structures that can be marked as
> `@PublicEvolving`.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
