Hi, I'm starting to weight different alternatives for data ingestion and I'd like to know whether Kafka meets the problem I have. Say we have a set of devices each with its own MAC and then we receive data in Kafka. There is a dictionary defined elsewhere that says each MAC to which topic must publish. So I have basically 2 questions: New MACs keep comming and the dictionary must be updated accordingly. How could I change this Kafka behaviour during runtime? A problem for the future. Say that dictionaries are so big that they don't fit in memory. Are there any patterns for bookkeeping internal data structures and how route to them?
T.