RE: Loading kafka server within a Java process

2013-02-15 Thread Jamie Wang
...@metamarkets.com] Sent: Thursday, February 14, 2013 3:08 PM To: users@kafka.apache.org Subject: Re: Loading kafka server within a Java process Consumer + broker embedding can be done, I believe. It's just producer+broker embedding that they don't like :). --Eric On Thu, Feb 14, 2013 at 4:51

Re: Loading kafka server within a Java process

2013-02-14 Thread Eric Tschetter
r in the same process. > > Jamie > > -Original Message- > From: Eric Tschetter [mailto:ched...@metamarkets.com] > Sent: Thursday, February 14, 2013 2:44 PM > To: users@kafka.apache.org > Subject: Re: Loading kafka server within a Java process > > Jamie, > > As

RE: Loading kafka server within a Java process

2013-02-14 Thread Jamie Wang
ading kafka server within a Java process Jamie, As Jay says, this is definitely possible. We also do it at Metamarkets. The one thing that we found odd when doing it though is that you cannot (or couldn't with the version we are using, I'm not sure about 0.8) embed a producer that

Re: Loading kafka server within a Java process

2013-02-14 Thread Eric Tschetter
Jamie, As Jay says, this is definitely possible. We also do it at Metamarkets. The one thing that we found odd when doing it though is that you cannot (or couldn't with the version we are using, I'm not sure about 0.8) embed a producer that produces for an embedded broker. You instead have to h

Re: Loading kafka server within a Java process

2013-02-14 Thread Jay Kreps
Yes, it will work. We do this at LinkedIn, actually. -Jay On Thu, Feb 14, 2013 at 12:15 PM, Jamie Wang wrote: > I have a situation where we have constraint on the number of processes we can > use and hence, is it possible to load kafka server within another Java > process? Looking at the kafka

Loading kafka server within a Java process

2013-02-14 Thread Jamie Wang
I have a situation where we have constraint on the number of processes we can use and hence, is it possible to load kafka server within another Java process? Looking at the kafka.kafka it seems that I can create a Java object that does most of what Kafka.kafka.main() do. Any thoughts if this wi