[
https://issues.apache.org/jira/browse/KAFKA-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antony Stubbs updated KAFKA-6182:
---------------------------------
Description:
Currently it is up to the user to ensure that two input topics for a join have
the same number of partitions, and if they don't, manually create an
intermediate topic, and send the stream #through that topic first, and then
performing the join.
It would be great to have Kafka streams detect this and at least give the user
the option to create an intermediate topic automatically with the same number
of partitions as the topic being joined with.
See
https://docs.confluent.io/current/streams/developer-guide.html#joins-require-co-partitioning-of-the-input-data
was:
Currently it is up to the user to ensure that two input topics for a join have
the same number of partitions. It would be great have Kafka streams detect this
automatically, or at least give the user and easy way, and create an
intermediate topic with the same number of partitions as the topic being joins
with.
See
https://docs.confluent.io/current/streams/developer-guide.html#joins-require-co-partitioning-of-the-input-data
> Automatic co-partitioning of topics via automatic intermediate topic with
> matching partitions
> ---------------------------------------------------------------------------------------------
>
> Key: KAFKA-6182
> URL: https://issues.apache.org/jira/browse/KAFKA-6182
> Project: Kafka
> Issue Type: New Feature
> Components: streams
> Reporter: Antony Stubbs
>
> Currently it is up to the user to ensure that two input topics for a join
> have the same number of partitions, and if they don't, manually create an
> intermediate topic, and send the stream #through that topic first, and then
> performing the join.
> It would be great to have Kafka streams detect this and at least give the
> user the option to create an intermediate topic automatically with the same
> number of partitions as the topic being joined with.
> See
> https://docs.confluent.io/current/streams/developer-guide.html#joins-require-co-partitioning-of-the-input-data
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
