; > listening to topic X, partition Y², which is risky and difficult to
> > do.
> > > > >
> > > > > The simplest option, assuming that each topic is independent when
> it
> > > > comes
> > > > > to expectations, is don¹t go wi
ng and then, when it detects new topics, for
> > each
> > > > new topic: start a new instance of your app on a new box that listens
> > to
> > > > that single topic. It might take a few seconds to startup, but its
> > easy
> > > > to code, easy
s
> to
> > > that single topic. It might take a few seconds to startup, but its
> easy
> > > to code, easy to maintain, and easy to understand. Which makes for a
> > more
> > > resilient application.
> > > -Erik
> > >
> > >
>
new instance of your app on a new box that listens to
> > that single topic. It might take a few seconds to startup, but its easy
> > to code, easy to maintain, and easy to understand. Which makes for a
> more
> > resilient application.
> > -Erik
> >
> >
> >
> &g
;users@kafka.apache.org"
> Date: Thursday, September 10, 2015 at 6:09 AM
> To: "users@kafka.apache.org"
> Subject: automatically consume from all topics
>
>
> Hello,
>
> Is there a simple way to set up a consumer that automatically picks up all
> the top
. Which makes for a more
resilient application.
-Erik
From: Joris Peeters
Reply-To: "users@kafka.apache.org"
Date: Thursday, September 10, 2015 at 6:09 AM
To: "users@kafka.apache.org"
Subject: automatically consume from all topics
Hello,
Is there a simple way to se
Hello,
Is there a simple way to set up a consumer that automatically picks up all the
topics for all the partitions, dynamically extending its range as new topics
get created?
The underlying idea is that we want to have a few over-arching consumers (I'm
aware that's not great for the scalabili
