Hello,
I need to unit-test java code that should be able to subscribe to kafka
topic and asynchronously receive messages as input... Can anybody recommend
junit mockup framework for doing that?
Thank you,
My kafka (1.0.0) producer errors out on large (16M) messages.
ERROR Error when sending message to topic test with key: null, value:
16777239 bytes with error: (org.apache.kafka.clients.producer.internals.
ErrorLoggingCallback)
org.apache.kafka.common.errors.RecordTooLargeException: The message is
Yes, it's still there
On Thu, Aug 15, 2019 at 4:49 AM Jonathan Santilli <
jonathansanti...@gmail.com> wrote:
> Hello, try to send and flush just one message of 16777239 bytes, to verify
> the error still shows up.
>
> Cheers!
> --
> Jonathan
>
>
>
> On
gt; wrote:
> Hello, try to send and flush just one message of 16777239 bytes, to verify
> the error still shows up.
>
> Cheers!
> --
> Jonathan
>
>
>
> On Thu, Aug 15, 2019 at 2:23 AM l vic wrote:
>
> > My kafka (1.0.0) producer errors out on large (16M) messages.
&g
39 bytes, to verify
> the error still shows up.
>
> Cheers!
> --
> Jonathan
>
>
>
> On Thu, Aug 15, 2019 at 2:23 AM l vic wrote:
>
> > My kafka (1.0.0) producer errors out on large (16M) messages.
> > ERROR Error when sending message to topic tes
Cheers!
> --
> Jonathan
>
>
>
>
> On Thu, Aug 15, 2019 at 1:44 PM l vic wrote:
>
> > I tested it with kafka-console-consumer and kafka-console-producer
> reading
> > from large text file (no newlines):
> >
> > kafka-console-prod
previous email when you
> tried the console producer.
>
> Jonathan.
>
> On Thu, Aug 15, 2019, 3:07 PM l vic wrote:
>
> > yes, in producer.properties
> >
> > On Thu, Aug 15, 2019 at 9:59 AM Jonathan Santilli <
> > jonathansanti...@gmail.com> wrote:
&g
I have to deal with large ( 16M) text messages in my Kafka system, so i
increased several message limit settings on broker/producer/consumer site
and now the system is able to get them throughI also tried to enable
compression in producer:
"compression.type"= "gzip"
but to my surprise ended up
Coding.java is byte[] ba = new byte[en];
> >
> > Compression is applied after the string is serialized to bytes. So you'll
> > need to increase your heap size to support this.
> >
> > Hope that helps :)
> >
> > Liam Clarke
> >
> > On