Shekharrajak commented on issue #18439: URL: https://github.com/apache/druid/issues/18439#issuecomment-4238852622
Hi team @gianm @a2l007 @clintropolis @FrankChen021 , Overview of Queue Semantics support for Kafka Ingestion has been drafted - utilizing diagrams to illustrate proposed class interactions and thread model & componet communication : https://github.com/Shekharrajak/druid/wiki/Queue-Semantics-support-in-Kafka-Ingestion We can take it as baseline, start implementing phase wise and can update it during implementation. PS: Based on my research into how different engines handle queue support, the Renew Thread Model seems like the most solid design choice for us. I have some prototype as well, may be I can share the draft PR and improve as we go. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
