How about defining an avro union type containing all the schemas you wish
to put on this topic (the schemas themselves could be defined independently
and then bundled into an "uber-schema" at build time)?
That means any messages you put on the topic must match one of the schemas
defined in the uni
You could just catch the exception but if this is per row, that is probably
prohibitively expensive.
Doesn't the binlog get "create table" events? Wouldn't that be a better
time to create the topic?
--
Andy
On Mon, Oct 24, 2016 at 2:32 PM, Ben Osheroff
wrote:
> Hiya!
>
> I've been trying to me
fixtures into public
> packages:
>
> https://issues.apache.org/jira/browse/KAFKA-3625
>
> Guozhang
>
> On Sat, Sep 10, 2016 at 2:01 PM, Andy Chambers
> wrote:
>
> > Hi,
> >
> > The MockClientSupplier looks like it would be useful for developers
> wishing
>
Hi,
The MockClientSupplier looks like it would be useful for developers wishing
to write unit tests for kafka streams apps. Is it public? If so, can
someone help me out with the maven coordinates. Currently depending on
these maven coordinates
[org.apache.kafka/kafka-streams "0.10.0.1"]
[org.
an actually do this with one job):
>
> T1 -> Job_T1 -> T1’
> T2 -> Job_T2 -> T2’
>
> T1’ and T2’ would be partitioned on your join key and would have the
> same number of partitions so that you have the guarantees you need to do
> the join. (i.e. join
How
> are they created and what is the join meant to do?
>
> Thanks
> Eno
>
> > On 3 Sep 2016, at 02:43, Andy Chambers wrote:
> >
> > Hey Folks,
> >
> > We are having quite a bit trouble modelling the flow of data through a
> very
> > kafka centric
Hey Folks,
We are having quite a bit trouble modelling the flow of data through a very
kafka centric system
As I understand it, every stream you might want to join with another must
be partitioned the same way. But often streams at the edges of a system
*cannot* be partitioned the same way becaus
Wow you guys plan a long time ahead ;-)
On Fri, Oct 30, 2015 at 12:49 PM, Ed Yakabosky
wrote:
> Hi all,
>
> LinkedIn is hoping to host one more Apache Kafka meetup this year on
> November 18 in our San Francisco office. We're working on building the
> agenda now. Does anyone want to talk? Ple
Hi All,
I'm a little bit confused when I read about offset management in kafka. A
google search turns up the wiki page that provides some example code about
how to use the offset API[1] but also buried in the docs is the
configuration option "offset.storage"[2].
So my question is "can we achieve
