Hey AJ, you should be able to make the subscribed topics and output topics dynamic configs for Consumer and Producer. If you need to create new topics on runtime, there is some broker side setting you could use to allow topic creation based of produced records: https://stackoverflow.com/questions/36441768/how-to-create-topics-in-apache-kafka
On Fri, Jun 12, 2020 at 9:01 AM AJ Chen <cano...@gmail.com> wrote: > I'm working on a data streaming system where users will publish to > different new topics and subscribe to different new topics without > restarting the system. A large number of topics will be created over time. > Uer will choose different new topics to publish and subscribe dynamically > at runtime. Can someone share good design or practice to implement such > dynamic topic handling? Links to sample code will be very helpful. > > Thanks, > aj >
