Re: KIP-119: Drop Support for Scala 2.10 in Kafka 0.11

2017-02-03 Thread Grant Henke
/confluence/display/KAFKA/KIP- > 119%3A+Drop+Support+for+Scala+2.10+in+Kafka+0.11 > > Please take a look. Your feedback is appreciated. > > Thanks, > Ismael > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: [DISCUSS] KIP-118: Drop Support for Java 7 in Kafka 0.11

2017-02-03 Thread Grant Henke
, but we know that it won't happen before > > June 2017. > > > > Please take a look at the proposal and share your feedback. > > > > Thanks, > > Ismael > > > > [1] http://search-hadoop.com/m/Kafka/uyzND1oIhV61GS5Sf2 > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: [ANNOUNCE] New committer: Grant Henke

2017-01-12 Thread Grant Henke
1, 2017 at 2:51 PM, Gwen Shapira wrote: > > > > > The PMC for Apache Kafka has invited Grant Henke to join as a > > > committer and we are pleased to announce that he has accepted! > > > > > > Grant contributed 88 patches, 90 code reviews, countless great

Re: [VOTE] KIP-106 - Default unclean.leader.election.enabled True => False

2017-01-11 Thread Grant Henke
> > > > > https://cwiki.apache.org/confluence/display/KAFKA/% > > > 5BWIP%5D+KIP-106+-+Change+Default+unclean.leader. > > > election.enabled+from+True+to+False > > > > > > B > > > > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: [VOTE] 0.10.0.1 RC2

2016-08-05 Thread Grant Henke
(off 0.10.0 branch) is the 0.10.0.1-rc2 tag: > >> > https://git-wip-us.apache.org/repos/asf?p=kafka.git;a=tag;h= > >> f8f56751744ba8e55f90f5c4f3aed8c3459447b2 > >> > > >> > * Documentation: > >> > http://kafka.apache.org/0100/documentation.

Re: What's the difference between kafka_2.11 and kafka-client?

2016-06-23 Thread Grant Henke
ank you in advance! > > Best regards > > KIM > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: [DISCUSS] Java 8 as a minimum requirement

2016-06-16 Thread Grant Henke
s may still be using Java 7 by the time Kafka 0.10.1.0 is > > released. > > > > > More specifically, we care about the subset who would be able to > > > upgrade > > > > to > > > > > Kafka 0.10.1.0, but would not be able to upgrade the Java version. > It > > > > would > > > > > be great if we could quantify this in some way. > > > > > > > > > > What do you think? > > > > > > > > > > Ismael > > > > > > > > > > [1] https://java.com/en/download/faq/java_7.xml > > > > > [2] > > https://blogs.oracle.com/thejavatutorials/entry/jdk_8_is_released > > > > > [3] http://openjdk.java.net/projects/jdk9/ > > > > > [4] https://github.com/apache/cassandra/blob/trunk/README.asc > > > > > [5] > > > https://lucene.apache.org/#highlights-of-this-lucene-release-include > > > > > [6] http://akka.io/news/2015/09/30/akka-2.4.0-released.html > > > > > [7] https://issues.apache.org/jira/browse/HADOOP-11858 > > > > > [8] https://webtide.com/jetty-9-3-features/ > > > > > [9] http://markmail.org/message/l7s276y3xkga2eqf > > > > > [10] > > > > > > > > > > > > > > > > > > > > https://intellij-support.jetbrains.com/hc/en-us/articles/206544879-Selecting-the-JDK-version-the-IDE-will-run-under > > > > > [11] http://markmail.org/message/l7s276y3xkga2eqf > > > > > > > > > > > > > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Topic relentlessly recreated

2016-06-16 Thread Grant Henke
without all brokers online > should be possible... > /usr/bin/kafka-topics.sh --zookeeper localhost --create --topic > job_processing --partitions 4 --replication-factor 2 > > Since delete doesn't do what most people would expect and actually delete, > we can't delete once online

Re: Invalid Version for API key

2016-06-08 Thread Grant Henke
.protocol.ProtoUtils.parseRequest(ProtoUtils.java:60) > at > > org.apache.kafka.common.requests.ListOffsetRequest.parse(ListOffsetRequest.java:142) > at > > org.apache.kafka.common.requests.AbstractRequest.getRequest(AbstractRequest.java:46) > at > kafka.network.RequestChannel$Request.liftedTree

Re: [ANNOUCE] Apache Kafka 0.10.0.0 Released

2016-05-24 Thread Grant Henke
Hyun, Drausin Wulsin, Duncan Sands, Dustin Cote, > Eamon Zhang, edoardo, Edward Ribeiro, Eno Thereska, Ewen > Cheslack-Postava, Flavio Junqueira, Francois Visconte, Frank Scholten, > Gabriel Zhang, gaob13, Geoff Anderson, glikson, Grant Henke, Greg > Fodor, Guozhang Wang, Gwen Shapira, Igo

Re: Tell us how you're using Kafka and what you'd like to see in the future

2016-04-28 Thread Grant Henke
t what’s working and what needs to be improved—this > community is greater than the sum of its parts, and your responses will > ultimately help to steer the development of Kafka moving forward. > > I will share the results of the survey for everyone to look at. > > Thank you! >

Re: Documentation

2016-03-29 Thread Grant Henke
ditional documentation? > > > > > > Heath Ivie > > > Solutions Architect > > > > > > > > > Warning: This e-mail may contain information proprietary to > AutoAnything > > > Inc. and is intended only for the use of the intended recipient(s). If > > the > > > reader of this message is not the intended recipient(s), you have > > received > > > this message in error and any review, dissemination, distribution or > > > copying of this message is strictly prohibited. If you have received > this > > > message in error, please notify the sender immediately and delete all > > > copies. > > > > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Fetch Response V1 incorrectly documented

2016-03-03 Thread Grant Henke
ageSet]] ThrottleTime > > But it actually is (as of Kafka 0.9.0.1): > > FetchResponse => ThrottleTime [TopicName [Partition ErrorCode > HighwaterMarkOffset MessageSetSize MessageSet]] > > e.g. ThrottleTime comes first after the response header, not last. > > As a client libr

Re: [kafka-clients] 0.9.0.1 RC1

2016-02-16 Thread Grant Henke
> > > https://groups.google.com/d/msgid/kafka-clients/CAFc58G8VbhZ5Q0nVnUAg8qR0yEO%3DqhYrHFtLySpJo1Nha%3DoOxA%40mail.gmail.com > > < > https://groups.google.com/d/msgid/kafka-clients/CAFc58G8VbhZ5Q0nVnUAg8qR0yEO%3DqhYrHFtLySpJo1Nha%3DoOxA%40mail.gmail.com?utm_medium=email&utm_source=footer > > > > . > > For more options, visit https://groups.google.com/d/optout. > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Maximum Topic Length in Kafka

2015-11-29 Thread Grant Henke
ximum length of a particular topic ( > in > > >terms of number of messages ) in kafka ? > > >2. Also how does Kafka behave when a particular topic gets full? > > >3. Can the producer be blocked if a topic get full rather than > > deleting > > >old messages? > > > > > > I have gone through the documentation > > > <http://kafka.apache.org/081/documentation.html#basic_ops_add_topic> > but > > > could not find anything of what I am looking for. > > > > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: build error

2015-11-17 Thread Grant Henke
tall in my > local > > > maven repository so I can include new api in my dependencies. When the > > > release is officially out, I can have both my code ready with the > > official > > > maven dependency > > > > > > Thanks, > > >

Re: where do I get the Kafka classes

2015-11-17 Thread Grant Henke
#x27;m guessing that Gradle is somehow importing the necessary >> classes at compile time. If I didn't want to use Gradle, how would I go >> about just getting Kafka packages with the classes I need? I can't seem to >> find them by googling. >> >> >> Adaryl "Bob" Wakefield, MBA >> Principal >> Mass Street Analytics, LLC >> 913.938.6685 >> www.linkedin.com/in/bobwakefieldmba >> Twitter: @BobLovesData >> >> > > > -- > Thanks, > Ewen > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: issue with javaapi consumer

2015-11-17 Thread Grant Henke
le. > consumerConnector = ConsumerConfig > > .createJavaConsumerConnector(consumerConfig); > > Do I have to rewrite the whole consumer to use the new jar. Whats the best > way forward please? > > Regards > > Surender Kudumula > > > -- Grant Henke Software Engineer | Cl

Re: build error

2015-11-17 Thread Grant Henke
can include new api in my dependencies. When the > > release is officially out, I can have both my code ready with the > official > > maven dependency > > > > Thanks, > > Siyuan > > > > On Monday, November 16, 2015, Grant Henke wrote: > > > > >

Re: build error

2015-11-16 Thread Grant Henke
k and 0.9.0 branch > > > > > docs/producer_config.html (No such file or directory) > > > > Do I miss anything before build > > > > Thanks, > > Siyuan > > > > > > -- > -- Guozhang > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: setting up kafka github

2015-11-16 Thread Grant Henke
t; > I have one doubt though. Which repo shall I configure as the remote - > > > apache-kafka or my fork ? > > > > > > If I configure apache-kafka as remote, will I be able to submit pull > > > requests? > > > > > > If I sync my committed ch

Re: Question on 0.9 new consumer API

2015-11-12 Thread Grant Henke
rs to 0.9, will > they accept producers in 0.8.2? > > Thanks! > > -- > *JU Han* > > Software Engineer @ Teads.tv > > +33 061960 > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Please add skyscanner to Powered by page please

2015-11-05 Thread Grant Henke
gt; > > Many thanks, > > > Scott Krueger > > > Data Architect > > skyscanner > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: kafka_2.9.2-0.8.2.0 - Topic marked for deletion

2015-11-03 Thread Grant Henke
ission, > dissemination, distribution, copying or other use of, or taking of any > action in reliance upon this information is strictly prohibited. If you > have received this communication in error, please contact the sender and > delete the material from your computer. > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Release 0.9.0

2015-11-03 Thread Grant Henke
t Anchlia wrote: > Is there a tentative release date for Kafka 0.9.0? > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Kafka 090 maven coordinate

2015-11-03 Thread Grant Henke
aja...@gmail.com> > > wrote: > > > >> Hi, > >> > >> I saw that there is new kafka client 0.9.0 in here: > >> http://kafka.apache.org/090/javadoc/index.html So what is the maven > >> coordinate for this version? I am asking this because it

Re: One more Kafka Meetup hosted by LinkedIn in 2015 (this time in San Francisco) - does anyone want to talk?

2015-11-03 Thread Grant Henke
anyone want to talk? Please send me (and Clark) a > >> private email with a short description of what you would be talking > about > >> if interested. > >> > >> -- > >> Thanks, > >> > >> Ed Yakabosky > >> ​Technical Program Management @ LinkedIn> > >> > >> > > > > -- > > Thanks, > > Ed Yakabosky > > > > > > -- > Thanks, > Ed Yakabosky > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Topic per entity

2015-11-02 Thread Grant Henke
rabbit > hole? Maybe I'm trying to force Kafka into this territory it's not suited > for. Have I been reading too many (awesome) articles about the role of the > log and streaming in distributed computing? Or am I on the right track and > I just need to put in some work to

Re: Kafka console producer stuck

2015-10-28 Thread Grant Henke
consumer is able to read them fine. It is just the > console producer that doesn't seem to work (or at least as per the quick > start link) > > > > Sent from my iPhone > > > On 28-Oct-2015, at 7:34 PM, Grant Henke wrote: > > > > Hi Sathya, >

Re: Kafka console producer stuck

2015-10-28 Thread Grant Henke
ld set the right value > >>for ³ > >> advertised.host.name², But setting that has no effect. > >> Any help overcoming this will be appreciated. > >> > >> Am running version kafka_2.11-0.8.2.1.tgz on OS X. > >> > >> Regards, > >> Sathya > >> > >> > > > > > >-- > >- > >"There are only 10 types of people in the world: Those who understand > >binary, and those who don't" > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: How Kafka Distribute partitions across the cluster

2015-10-27 Thread Grant Henke
would like to know what kind of strategy Kafka adopts in splitting > partitions of a topic to across the cluster. > > Ex: if i have 10 broker in a cluster. 1 topic with 5 partition and each > with replication-factor of 2. then how would Kafka will assign the > partition

Re: Spamming kafka mailing list

2015-10-19 Thread Grant Henke
ocumentation for basic queries. > Please spend time finding the answers before sending queries to Kafka > mailing list. In case you still not find answers Kafka community is there > to help. > Genuine queries do not get proper attention by all this clutter! > > Best, > Jhon >

Re: Synchronous producer performance is very low

2015-10-19 Thread Grant Henke
us producer. > > Please can any one of you suggest a way to improve the performance of > sync producer. > > Thanks, > Santhakumari > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Facing Issue to create asyn producer in kafka 0.8.2

2015-10-14 Thread Grant Henke
gt; > > > > > while ( true ) { > > > imageRecord = new ProducerRecord(topicName, > > > recordKey,imageBytes); > > > > > >producer.send(imageRecord); > > > } > > > } > > > > > > size of my message is around 77K > > > > > > but its work like a synchronous producer , send every message to broker > > . > > > not buffering a message in to queue and send after 5 sec > > > > > > > > > please help to find out a solution. > > > > > > > > > Regards > > > Prateek > > > > > > A Balance Transfer Card With An Outrageously Long Intro Rate And No > > Balance Transfer Fees That Can Save You Thousands > > http://thirdpartyoffers.netzero.net/TGL3231/561e9a75a77071a74763fst04vuc > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Kafka Offset remains at -1

2015-10-13 Thread Grant Henke
Are you sure your producer and consumer are pointed to the same topic? I see RECUR_TRANS in your logs but you mentioned creating RECURRING_TRANS. If thats not the issue. I have a few questions to get more informations. - Can you list & describe the relevant topics using the kafka-topics scr

Re: How to verify offsets topic exists?

2015-10-05 Thread Grant Henke
ated. Any tips how to ensure/verify that offsets topic exists? > > Kind regards, > > Stevo Slavic. > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Offset rollover/overflow?

2015-10-05 Thread Grant Henke
een a previous question (http://search-hadoop.com/m/uyzND1lrGUW1PgKGG > ) > > on offset rollovers but it doesn't look like it was ever answered. > > > > Does anyone one know what happens when an offset max limit is reached? > > Overflow, or something else? > &g

Re: are 0.8.2.1 and 0.9.0.0 compatible?

2015-10-01 Thread Grant Henke
ogether and restart (rather than setting it to the new > version), since once the code is updated, it will use that by default? > > On Thu, Oct 1, 2015 at 1:48 PM, Grant Henke wrote: > > > Hi Richard, > > > > You are correct that version will now be 0.9.0 and anyt

Re: are 0.8.2.1 and 0.9.0.0 compatible?

2015-10-01 Thread Grant Henke
cherThread) >> >> if i use kafkacat to generate a message on the topic i see >> IllegalArgumentExceptions instead. >> >> this suggests that the two versions of kafka aren't compatible. is this >> the case? does the whole ecosystem need to be on the same version? >> >> thank you, >> doug >> >> > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: log.retention.hours not working?

2015-09-22 Thread Grant Henke
-09-21 17:13:01,238] INFO Deleting segment 0 from log test-1. > > > > (kafka.log.Log)* > > > > *[2015-09-21 17:13:01,239] INFO Deleting index > > > > /var/log/kafka/test-1/.index.deleted > > > > (kafka.log.OffsetIndex)* > > > > > > > > I know the logs are still in there because i am using > > > > the kafka-consumer-offset-checker.sh and it says how many messages > the > > > > logSize is. > > > > > > > > What am i missing in my configuration? > > > > > > > > > > > > > > > > Thanks! > > > > > > > > -- > > > > Allen Michael Chan > > > > > > > > > > > > > > > -- > > Allen Michael Chan > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Jumbled up ISR

2015-09-15 Thread Grant Henke
s the ISR got to have the leader as the first replica ?? > > > Regards, > > Prabhjot > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Zookeeper use cases with Kafka

2015-08-18 Thread Grant Henke
t is there anything apart from it?) > What is the scale of data that is stored in Zookeeper ? > > Looking forward for your help. > > Thanks, > prabcs > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Grant Henke
ing you consider unsafe, speak up! > > Gwen > > On Mon, Aug 17, 2015 at 8:17 AM, Grant Henke wrote: > > > +dev > > > > Adding dev list back in. Somehow it got dropped. > > > > > > On Mon, Aug 17, 2015 at 10:16 AM, Grant Henke > wrote: > >

Re: Compaction per topic

2015-08-17 Thread Grant Henke
in some topics, but in others have > purge after x amount of days. > > I did some searches and I couldn't find anything related to this and it > appears that the compaction is enabled globally for all topics. > > Thanks for all the information > Elias > -- Grant Hen

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Grant Henke
set to zero blocks forever - KAFKA-2317 <https://issues.apache.org/jira/browse/KAFKA-2317>: De-register isrChangeNotificationListener on controller resignation Note: KAFKA-2120 <https://issues.apache.org/jira/browse/KAFKA-2120> & KAFKA-2421 <https://issues.apache.org/jir

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Grant Henke
+dev Adding dev list back in. Somehow it got dropped. On Mon, Aug 17, 2015 at 10:16 AM, Grant Henke wrote: > Below is a list of candidate bug fix jiras marked fixed for 0.8.3. I don't > suspect all of these will (or should) make it into the release but this > should be a relat

Re: Describe command does not update details about killed brokers

2015-08-17 Thread Grant Henke
is confusing behaviour of kafka broker are > welcome. > Thanks in advance. > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-16 Thread Grant Henke
://issues.apache.org/jira/browse/KAFKA-1788 and > > > https://issues.apache.org/jira/browse/KAFKA-2120 > > > > > > On Fri, Aug 14, 2015 at 4:03 PM, Gwen Shapira > wrote: > > > > > > > Will be nice to include Kafka-2308 and fix two critical snappy issues >

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-14 Thread Grant Henke
nce been fixed in trunk (just a snappy jar upgrade). Since 0.8.3 > is > > > still a few months away, it may make sense to do an 0.8.2.2 release > just > > to > > > fix this issue. Any objections? > > > > > > Thanks, > > > > > > Jun > > > > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Topic auto deletion

2015-08-11 Thread Grant Henke
a time I choose. > > Many thanks in advance, > Shahar. > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: AdminUtils addPartition, subsequent producer send exception

2015-08-07 Thread Grant Henke
e/force quick/dirty (e.g. Poll DB at interval for > updates), to using another Kafka topic for new partition event > notifications (of course, we favor the latter, but timelines will likely > mean that the first option is what initially gets implemented). > > On 8/7/15, 10:56 AM, &qu

Re: AdminUtils addPartition, subsequent producer send exception

2015-08-07 Thread Grant Henke
ent, should we expect this lag to increase? > > The only workaround I can envision for this is to have the thread check > the partition count via AdminUtils and only move on when the partition > count comes back as expected. > > Thanks, > Chiara > > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: OffsetOutOfRangeError with Kafka-Spark streaming

2015-08-06 Thread Grant Henke
erBinder". > >SLF4J: Defaulting to no-operation (NOP) logger implementation > >SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further > >details. > >MyTopic:0:60 > > > >I published 4 messages to Kafka. Immediately after few seconds, command > &g

Re: OffsetOutOfRangeError with Kafka-Spark streaming

2015-08-06 Thread Grant Henke
spark script stops working. > I have simple topic with just one partition. > > I would appreciate any clues on how to debug this issue. > > Thanks, > LCassa > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: message filterin or "selector"

2015-08-06 Thread Grant Henke
ng to perform ? > > > > Maybe I'm trying to fit a problem into a system that is not for that. I > > would love to have the amazing performance of kafka, but sadly I'm not > sure > > if its the best fit for me because of this... > > > > > > Than

Re: message filterin or "selector"

2015-08-06 Thread Grant Henke
ment a "selector" logic in kafka (similar to JMS > > > selectors) > > > > > > So, allow to consume a message if only the message contains certain > > header > > > or content ? > > > > > > I'm evaluating to migrate from Active

Re: Kafka Simple Cosumer

2015-08-06 Thread Grant Henke
mpleConsumer ? > > > Thanks, > Prabhakar > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Kafka + Avro serialization - io.confluent.kafka.serializers.KafkaAvroSerializer - maven dependency not resolving

2015-08-05 Thread Grant Henke
> > io.confluent > kafka-avro-serializer > 1.0 > > > > Any work around for this? Any other Serializer implementation I can used > when using Avro with Kafka? > > > Thanks, > -Neville > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Changing Kafka configs for already running brokers

2015-08-05 Thread Grant Henke
ng down the in sync replicas and reboot them too? > Thanks for the help! > > -- > > Jiefu Gong > University of California, Berkeley | Class of 2017 > B.A Computer Science | College of Letters and Sciences > > jg...@berkeley.edu | (925) 400-3427 > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Decomissioning a broker

2015-08-04 Thread Grant Henke
down will only move the leaders to other > replicas, right? It won’t actually migrate any replicas elsewhere. > > -Ao > > > > On Aug 4, 2015, at 13:00, Grant Henke wrote: > > > > The broker will actually unregister itself from zookeeper. The brokers id > > pa

Re: Decomissioning a broker

2015-08-04 Thread Grant Henke
e registered in Zookeeper. Should I > just delete the znode for that broker once it has been shut down? > > Thanks! > -Andrew Otto > > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Kafka Zookeeper Issues

2015-08-04 Thread Grant Henke
bs.zalando.de > > Zalando SE, Tamara-Danz-Straße 1, 10243 Berlin > Company registration: Amtsgericht Charlottenburg, HRB 158855 B > Tax ID: 29/560/00596 * VAT registration number: DE 260543043 > Management Board: Robert Gentz, David Schneider, Rubin Ritter > Chairperson of the Supe

Re: Lead Broker from kafka.message.MessageAndMetadata

2015-08-04 Thread Grant Henke
simple, I have topic and partition and wanted to find out > the lead broker for that partition. > > Please provide your insights > > > Thanks > Sreeni > -- Grant Henke Software Engineer | Cloudera gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Log Deletion Behavior

2015-07-24 Thread Grant Henke
Also this stackoverflow answer may help: http://stackoverflow.com/a/29672325 On Fri, Jul 24, 2015 at 9:36 PM, Grant Henke wrote: > I would actually suggest only using the ms versions of the retention > config. Be sure to check/set all the configs below and look at the > documented exp

Re: Log Deletion Behavior

2015-07-24 Thread Grant Henke
correct/anticipated/wanted behavior? > >> > > > >> > > Thanks for the help! > >> > > > >> > > -- > >> > > > >> > > Jiefu Gong > >> > > University of California, Berkeley | Class of 2017 > >> > > B.A Computer Science | College of Letters and Sciences > >> > > > >> > > jg...@berkeley.edu | (925) 400-3427 > >> > > > >> > > >> > > >> > > >> > -- > >> > -Regards, > >> > Mayuresh R. Gharat > >> > (862) 250-7125 > >> > > >> > >> > >> > >> -- > >> > >> Jiefu Gong > >> University of California, Berkeley | Class of 2017 > >> B.A Computer Science | College of Letters and Sciences > >> > >> jg...@berkeley.edu | (925) 400-3427 > >> > > > > > > > > -- > > -Regards, > > Mayuresh R. Gharat > > (862) 250-7125 > > > > > > -- > -Regards, > Mayuresh R. Gharat > (862) 250-7125 > -- Grant Henke Solutions Consultant | Cloudera ghe...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: Dropping support for Scala 2.9.x

2015-07-08 Thread Grant Henke
ntioning that Scala 2.9.1 was released in August 2011 > > (more than 3.5 years ago) and the 2.9.x series hasn't received updates of > > any sort since early 2013. Scala 2.10.0, in turn, was released in January > > 2013 (over 2 years ago) and 2.10.5, the last planned relea

queued.max.requests Configuration

2015-06-18 Thread Grant Henke
this value from the default? Thank you, Grant -- Grant Henke Solutions Consultant | Cloudera ghe...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke

Re: blocking KafkaProducer call

2015-04-01 Thread Grant Henke
; And i am using new "org.apache.kafka.clients.producer.KafkaProducer" >> > class for sending messages, each message is taking more than 100ms, >> > am i missing something. If i use old "kafka.javaapi.producer.Produce" >> > it is giving the desired thr

Re: blocking KafkaProducer call

2015-03-31 Thread Grant Henke
ll > possible exceptions will be throws immediately if not able to send ? > > -- > SunilKalva > -- Grant Henke Solutions Consultant | Cloudera ghe...@cloudera.com | 920-980-8979 twitter.com/ghenke <http://twitter.com/gchenke> | linkedin.com/in/granthenke

Re: Check topic exists after deleting it.

2015-03-23 Thread Grant Henke
ecking if the topic exists by using > AdminUtils.topicExists() > which suprisingly returns true. > > I expected AdminUtils.TopicExists() to check both BrokerTopicsPath > and DeleteTopicsPath before returning a verdict but it only checks > BrokerTopicsPath > > Shouldn't a t