x.retries","10");
>> props.put("enable.auto.commit", "false");
>> props.put("consumer.timeout.ms","2");
>> props.put("auto.offset.reset", "smallest");
>>
>> Thanks,
>> Sahitya
>>
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
ded & IoTMicrosoft Azure Advisor
> Twitter : @ppatierno
> Linkedin : paolopatierno
> Blog : DevExperience
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
;
> Learn more about our inaugural *FirstScreen Conference
> <http://www.firstscreenconf.com/>*!
> *Where the worlds of mobile advertising and technology meet!*
>
> June 15, 2016 @ Urania Berlin
>
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
> > you recommend skipping 0.9 and going straight to 0.10?
> >
> > I ask this because upgrading our clusters is something taken very
> seriously
> > due to how central Kafka is in the system and it comes with a lot of
> > scrutiny.
> >
> > thanks for any input,
> > John
> >
>
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
java:228)
> > at
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> > at java.lang.Thread.run(Thread.java:745)
> > [2016-03-30 15:46:17,903] INFO Closed socket connection for client /
> > 127.0.0.1:8857 which had sessionid 0x153c7e67216000e
> > (org.apache.zookeeper.server.NIOServerCnxn)
> > [...]
> >
> >
> > Any idea what this may be about? :-\
> >
> > Thanks,
> > Filipe
> >
>
>
>
> --
> FILIPE CORREIA
> Software Engineer | NMUSIC S.A.
> +351 229 026 900 | filipe.corr...@nmusic.pt
>
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
o " limit the number of partitions per broker to
> two to four thousand and the total number of partitions in the cluster to
> low tens of thousand".
>
> One partition per aggregate will far exceed that number.
>
> Thanks,
> Mark
>
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
> processor.processFile(record.value());
>
>
> }
>
> }
>
>
> } catch (Throwable e) {
>
> e.printStackTrace();
>
> System.out.println("eror in polling");
>
>
> } finally {
>
> consumer.close();
>
> }
>
> }
> --
> -Ratha
> http://vvratha.blogspot.com/
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
How much do you like your data?
It really depends. There are situations that a replication factor of 1 is
sufficient, we work with 3 (with replicas in each of our three DCs, because
that's our model-of-things-were-afraid-of). The question really is - how
many brokers do you want to be able to affo
Makes sense. Thanks!
(and now how to find out how to turn off that signature for mailing lists
;-))
On Sun, Mar 27, 2016 at 10:54 AM, Dana Powers wrote:
> Agree, it's a bit confusing based on wiki alone right now. I think of
> MemberAssignment as a double-serialized field: first serialize to by
sion (0)
> > 32 bits of length (it's a simple integration test, so for now i'm happy
> to
> > accept the answer "0 assignments for you, dude!" ;-)).
> >
> > Which clearly is more data than left in the response.
> >
> > Am I misinterpreting t
I'm helping out on adding 0.9 stuff to the Elixir Kafka driver (
https://github.com/kafkaex/kafka_ex), and I'm getting an unexpected
response on an integration test that makes a simple SyncGroup call.
In Elixir terms, I'm getting <<0, 0, 0, 3, 0, 0, 0, 0, 0, 0>> back. My
interpretation:
32 bits c
onnection from
> > > consumer/producer to kafka broker(s) seems a little heavy.
> > >
> > > Thanks in advance!
> > >
> > > Best regards
> > >
> > > bgkim
> > >
> >
> >
> >
> > --
> > *Christian Posta*
>
?.
>
> Question # 5) Are there are any open source tools / best practices -
> recommended for Kafka performance monitoring tools in case of production
> issues.
>
> Question # 6) Kafka consumer is more of a Pull Model - this can cause busy
> wait for us - any better
On Mon, Mar 14, 2016 at 5:42 AM, Jens Rantil wrote:
> Just making it more explicit: AFAIK, all Kafka consumers I've seen loads
> the incoming messages into memory. Unless you make it possible to stream it
> do disk or something you need to make sure your consumers has the available
> memory.
>
>
On Sat, Mar 5, 2016 at 4:35 AM, James Cheng wrote:
> Your partitions are balanced, but is your data being evenly written across
> all the partitions? How are you producing data? Are you producing them with
> keys? Is it possible that the majority of the messages being written to
> just a few part
d the sawtooth the unexpected one?
What could cause the difference?
Thanks for any pointers :-)
--
*Cees de Groot*
PRINCIPAL SOFTWARE ENGINEER
[image: PagerDuty logo] <http://pagerduty.com/>
pagerduty.com
c...@pagerduty.com
+1(416)435-4085
[image: Twitter] <http://twitter.com
> Please let me know whether I can adapt Apache Kafka for the solution?
>
>
> - Mahesh.
>
--
*Cees de Groot*
PRINCIPAL SOFTWARE ENGINEER
[image: PagerDuty logo] <http://pagerduty.com/>
pagerduty.com
c...@pagerduty.com
+1(416)435-4085
[image: Twitter] <http://twitter.co
17 matches
Mail list logo
