[
https://issues.apache.org/jira/browse/FLINK-24493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18035584#comment-18035584
]
Rion Williams commented on FLINK-24493:
---------------------------------------
[~fpaul] / [~arvid] / [~dmvk]
Hi all!
I met with a few folks (namely [~mjsax] and [~danderson]) at Current and
probably got a bit ahead of myself in terms of the pull request – especially
considering it introduces some new interfaces that would likely require a more
stringent review and likely a formal discussion via a FLIP. Since this would be
uncharted territory for me, I thought I'd mention it here to see if there was
any interest in creating one for this effort.
I've put together a few resources related to it, in the case someone it
themselves for their own use cases, but I believe any of those would be
relevant towards the larger body of work in terms of introducing it to Flink
proper:
* [Pull Request Draft|https://github.com/apache/flink/pull/27072]
* [Related Blog
Post|https://rion.io/2025/11/05/exploring-dynamic-sink-routing-in-apache-flink-via-demultiplexingsink]
* [Related Examples/Usage
Repository|https://github.com/rionmonster/demux-sink-examples] (contains usage
examples and TestContainers-based integration tests for FileSink, Kafka,
Elasticsearch, JDBC (Postgres), etc.)
I appreciate all of you and your continual work in the community and towards
all of the various Apache projects.
Thanks,
Rion
> Introduce DemultiplexingSink to Support Dynamic Sink Routing
> ------------------------------------------------------------
>
> Key: FLINK-24493
> URL: https://issues.apache.org/jira/browse/FLINK-24493
> Project: Flink
> Issue Type: New Feature
> Components: Connectors / Common
> Reporter: Rion Williams
> Assignee: Rion Williams
> Priority: Major
> Labels: pull-request-available
>
> Recently, FLINK-23977 attempted to introduce an approach to supporting
> dynamic routing for the Elasticsearch sink, however during some discussion
> within [the pull request|https://github.com/apache/flink/pull/17061], the
> idea was introduced to create a more generic approach.
> The idea being that we could introduce a common DemultiplexingSink and
> related interface for handling routing to any number of existing sinks
> similar to the implementation mentioned in FLINK-23977 to the common
> connectors directory.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
