Re: Partitioning per team

2020-10-30 Thread Guozhang Wang
Hello Jan, One alternative approach you can consider is to use combo as the key, hence it achieves the small aggregation, while customizing your partitioner for the repartition topic such that keys with the same prefix always go to the same partition. Then when cleaning up data, similarly within

Partitioning per team

2020-10-26 Thread Jan Bols
For a kafka-streams application, we keep data per team. Data from 2 teams never meet but within a team, data is highly integrated. A team has team members but also has several types of equipment. A team has a lifespan of about 1-3 days after which the team is removed and all data relating to that t