Hello, Thank you for the work on dynamic topic/partition topology possible with KafkaSource which permit to do a lot of things (tested in 1.14) . But, in our organization, we have a custom need to have the list of topic defined from an external source (SQL database in our case). We plan to write a custom KafkaSubscriber<https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/enumerator/subscriber/KafkaSubscriber.java> that will implement our logic. Unfortunately, we can't inject our custom subscriber in KafkaSourceBuilder => the builder has only methods for standard subscriber nor in KafkaSource as the constructor is not public.
What can be a good method to implement this need ? Would a PR which add "advanced" method to Builder or which put the KafkaSource as public be accepted ? Thanks in advance, Regards, Etienne Carrière ========================================================= Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes par le secret professionnel. Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee interdite. Tout message electronique est susceptible d'alteration. La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme falsifie. ========================================================= This message and any attachments (the "message") are confidential, intended solely for the addresses, and may contain legally privileged information. Any unauthorized use or dissemination is prohibited. E-mails are susceptible to alteration. Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified. =========================================================
