Re: Using Kafka AdminUtils

2020-02-17 Thread Israel Ekpo
me. > > > The solution I am looking to implement is to check during > > application > > > init whether the input topic exists and if not to create it with > > > relevant partition number and replication factor. > > > > > > I found the fol

Re: Using Kafka AdminUtils

2020-02-16 Thread John Roesler
application > > init whether the input topic exists and if not to create it with > > relevant partition number and replication factor. > > > > I found the following example that uses kafka.admin.AdminUtils > and it > > seems to be suitable: > &

Re: Using Kafka AdminUtils

2020-02-16 Thread Victoria Zuberman
it with > relevant partition number and replication factor. > > I found the following example that uses kafka.admin.AdminUtils and it > seems to be suitable: > https://www.codota.com/code/java/methods/kafka.admin.AdminUtils/createTopic > > Please advise

Re: Using Kafka AdminUtils

2020-02-16 Thread John Roesler
umber and replication factor. > > I found the following example that uses kafka.admin.AdminUtils and it > seems to be suitable: > https://www.codota.com/code/java/methods/kafka.admin.AdminUtils/createTopic > > Please advise whether using AdminUtils is considered a good practic

Using Kafka AdminUtils

2020-02-15 Thread Victoria Zuberman
kafka.admin.AdminUtils and it seems to be suitable: https://www.codota.com/code/java/methods/kafka.admin.AdminUtils/createTopic Please advise whether using AdminUtils is considered a good practice. Is AdminUtils functionality considered stable and reliable? If there are other solutions, I would appreciate to

Re: AdminUtils

2016-06-21 Thread Ismael Juma
On Wed, Jun 22, 2016 at 12:32 AM, Chris Barlock wrote: > > What is KIP-4? https://cwiki.apache.org/confluence/display/KAFKA/KIP-4+-+Command+line+and+centralized+administrative+operations > Until this is available, I think I'm stuck with > AdminUtils. Is there any (java)doc

Re: AdminUtils

2016-06-21 Thread Chris Barlock
Ismael: What is KIP-4? Until this is available, I think I'm stuck with AdminUtils. Is there any (java)doc available for it, or am I going to have to dig through the scala files and figure out what has changed? The new REST interface is a possibility, but, if I recall, it does not su

Re: AdminUtils

2016-06-21 Thread Ismael Juma
Hi Chris, Yes, `AdminUtils` is not public API. The plan is to introduce `AdminClient` as part of KIP-4. The Kafka protocol additions for `createTopic` and `deleteTopic` are currently being discussed and it looks like they will be part of the next Kafka release based on current progress. The API

AdminUtils

2016-06-21 Thread Chris Barlock
While working on upgrading from 0.8.2.1 to 0.10.0.0, I found out that AdminUtils has changed -- and not in a backwards-compatible manner. I gather this is not a public API since I can't find any Javadoc for it. So, in 0.10.0.0 are there public replacement

Re: [IMPORTANT] Questions related to AdminUtils thread safety

2015-08-31 Thread Aditya Auradkar
topicExists simply reads ZK, so yes. createTopic should also be fine unless you try to create the same topic concurrently. AdminUtils itself does not maintain any state, just some static util functions. On Mon, Aug 31, 2015 at 3:00 PM, Sivananda Reddys Thummala Abbigari < sthumm...@salesforce.

[IMPORTANT] Questions related to AdminUtils thread safety

2015-08-31 Thread Sivananda Reddys Thummala Abbigari
Hi, Could you please let me know if calls to "AdminUtils.topicExists" and "AdminUtils.createTopic" are thread-safe? Thank you, Siva.

Re: AdminUtils addPartition, subsequent producer send exception

2015-08-07 Thread Gelinas, Chiara
;> Basically, the Producer can¹t see the new partition. When I set a >> >> breakpoint just before the send (which essentially sleeps the >>thread), >> >>then >> >> all is well, and it pushes the message to the new partiti

Re: AdminUtils addPartition, subsequent producer send exception

2015-08-07 Thread Grant Henke
t;then > >> all is well, and it pushes the message to the new partition with no > >>issues. > >> > >> I am running just one zookeeper, one kafka (no replicas) ­ this is all > >> local on my dev environment. > >> > >> Is this n

Re: AdminUtils addPartition, subsequent producer send exception

2015-08-07 Thread Gelinas, Chiara
;> local on my dev environment. >> >> Is this normal behavior or is there possibly some issue with how we are >> using addPartition? Also, once we have replicas in a more realistic >> production environment, should we expect this lag to increase? >> >> The onl

Re: AdminUtils addPartition, subsequent producer send exception

2015-08-07 Thread Grant Henke
ent, should we expect this lag to increase? > > The only workaround I can envision for this is to have the thread check > the partition count via AdminUtils and only move on when the partition > count comes back as expected. > > Thanks, > Chiara > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

AdminUtils addPartition, subsequent producer send exception

2015-08-07 Thread Gelinas, Chiara
addPartition? Also, once we have replicas in a more realistic production environment, should we expect this lag to increase? The only workaround I can envision for this is to have the thread check the partition count via AdminUtils and only move on when the partition count comes back as expected