RE: How do I remove myself from mailing list?

2016-08-30 Thread Heath Ivie
I have done the same several times, but I still get these emails. -Original Message- From: Spencer Owen [mailto:so...@netdocuments.com] Sent: Tuesday, August 30, 2016 8:33 AM To: users@kafka.apache.org Subject: How do I remove myself from mailing list? I've gone through the unsubscribe p

RE: FetchRequest Question

2016-05-27 Thread Heath Ivie
PING -Original Message- From: Heath Ivie [mailto:hi...@autoanything.com] Sent: Wednesday, May 25, 2016 9:25 AM To: users@kafka.apache.org Subject: FetchRequest Question Can someone please explain why if I write 1 message to the queue it takes N FetchRequests to get the data out where n

RE: FetchRequest Question

2016-05-26 Thread Heath Ivie
Ping -Original Message- From: Heath Ivie [mailto:hi...@autoanything.com] Sent: Wednesday, May 25, 2016 9:25 AM To: users@kafka.apache.org Subject: FetchRequest Question Can someone please explain why if I write 1 message to the queue it takes N FetchRequests to get the data out where n

FetchRequest Question

2016-05-25 Thread Heath Ivie
Can someone please explain why if I write 1 message to the queue it takes N FetchRequests to get the data out where n > 1? Heath Warning: This e-mail may contain information proprietary to AutoAnything Inc. and is intended only for the use of the intended recipient(s). If the reader of this me

FetchRequest API Always Returns 10 Rows

2016-05-03 Thread Heath Ivie
() .GetMessage(); Any ideas why this would be. We have the default confluent platform installed version 2. Thanks Heath Ivie Warning: This e-mail may contain information proprietary to AutoAnything Inc. and is intended only for the use of the intended recipient(s). If the reader of this message is

Empty Fetch Response

2016-04-28 Thread Heath Ivie
I am having an issue where the FetchResponse returns a large value MessageSetSize, but all of the bytes that follow after are null. Any ideas what could be causing that? I am getting a response without an error code, but like I said the remaining bytes (600 or more) are set to zero. Heath

RE: .Net Kafka Clients

2016-04-18 Thread Heath Ivie
Harsh, We looked at some of the other client libraries for .NET and opted to use the Kafka-Rest proxy. There are challenges with using it, since it is stateful. You can only run and connect to a single instance at a time. By that I mean, if you have 3 consumers in a group you still must connec

RE: Log Retention: What gets deleted

2016-04-08 Thread Heath Ivie
leted, meaning that more than check.interval.ms time passed since the segment was rolled. Hope this helps, Gwen On Fri, Apr 1, 2016 at 12:21 PM, Heath Ivie wrote: > Hi, > > I have some questions about the log retention and specifically what > gets deleted. > > I have a test

Log Retention: What gets deleted

2016-04-01 Thread Heath Ivie
continues to grow, but then at some point all messages are gone and the lag is at 0. I thought that the messages that are old would be deleted first. Am I misinterpreting how the log retention works? Heath Ivie Solutions Architect Warning: This e-mail may contain information proprietary to

RE: Rest Proxy Question

2016-03-31 Thread Heath Ivie
get this empty results for some non-deterministic period of time and > then out of the blue it will return the results. > > I am at a total loss at this point. > > If someone has any ideas, I sure would welcome them. > > Regards, > Heath > > -Original Messag

RE: Rest Proxy Question

2016-03-30 Thread Heath Ivie
period of time and then out of the blue it will return the results. I am at a total loss at this point. If someone has any ideas, I sure would welcome them. Regards, Heath -Original Message----- From: Heath Ivie [mailto:hi...@autoanything.com] Sent: Tuesday, February 16, 2016 10:44 AM

RE: Documentation

2016-03-29 Thread Heath Ivie
t sticking with the documented metadata specs should in theory allow heterogenous clients to cooperate. On Tue, Mar 29, 2016 at 8:21 AM, Heath Ivie wrote: > Does anyone have better documentation around the group membership APIs? > > The information about the APIs are great at the beginni

Documentation

2016-03-29 Thread Heath Ivie
help me or send me the some additional documentation? Heath Ivie Solutions Architect Warning: This e-mail may contain information proprietary to AutoAnything Inc. and is intended only for the use of the intended recipient(s). If the reader of this message is not the intended recipient(s), you have

Kafka FetchRequest

2016-03-19 Thread Heath Ivie
Hi, I am trying to create a kafka consumer from scratch and I am seeing some that is weird. Note: I am not creating a client group, I want to get the fetch request working first. What I am seeing is that every time I make the request the total size of the length of the response grows. This h

RE: Rest Proxy Question

2016-02-16 Thread Heath Ivie
n when results are received. > > I have a job that runs in the background checking for new messages every 5 > seconds, so I would expect within a minute or two the messages would be > visible. > > Have any of you seen this behavior before? > > Heath Ivie > Solutions

Rest Proxy Question

2016-02-16 Thread Heath Ivie
? Heath Ivie Solutions Architect Warning: This e-mail may contain information proprietary to AutoAnything Inc. and is intended only for the use of the intended recipient(s). If the reader of this message is not the intended recipient(s), you have received this message in error and any review

RE: Protocol Question

2016-02-04 Thread Heath Ivie
Dana, I was able to get it to work, thanks Heath -Original Message- From: Heath Ivie [mailto:hi...@autoanything.com] Sent: Thursday, February 04, 2016 8:19 AM To: users@kafka.apache.org Subject: RE: Protocol Question Dana, Again thanks for the feedback. I will try that today and see

RE: Protocol Question

2016-02-04 Thread Heath Ivie
metadata array count (4 bytes), and loop (5) you are missing the replicas and isr parsing. -Dana On Wed, Feb 3, 2016 at 6:01 PM, Heath Ivie wrote: > Hi, > > I am trying to navigate through the protocol and I am seeing some > inconsistencies with the data. > > I am tryin

Protocol Question

2016-02-03 Thread Heath Ivie
eaderId = BitConverter.ToInt32(ReverseBytes(bytes.Skip(offset).Take(4).ToArray()), 0); offset += 4; Any help would be cool, thanks Heath Ivie Solutions Architect Warning: This e-mail may contain information proprietary to AutoAnything Inc. and is intended only for the use

Re: Documentation

2016-01-31 Thread Heath Ivie
To piggy back , where can I find the api key values? Sent from Outlook Mobile<https://aka.ms/qtex0l> On Sun, Jan 31, 2016 at 9:25 AM -0800, "Heath Ivie" mailto:hi...@autoanything.com>> wrote: Hi Folks, I am working through the protocols to build a c# rest api. I am

Documentation

2016-01-31 Thread Heath Ivie
Hi Folks, I am working through the protocols to build a c# rest api. I am seeing inconsistencies in the way the document says it works with how it actually works, specifically the fetch messages. Could someone point me to the current documentation? Thanks Heath Sent from Outlook Mobile

RE: Partitions and consumer assignment

2016-01-19 Thread Heath Ivie
My mistake, I missed the carriage return -Original Message- From: Heath Ivie [mailto:hi...@autoanything.com] Sent: Tuesday, January 19, 2016 2:58 PM To: users@kafka.apache.org Subject: RE: Partitions and consumer assignment I get a 404 for this page. Is there an updated link

RE: Partitions and consumer assignment

2016-01-19 Thread Heath Ivie
I get a 404 for this page. Is there an updated link? -Original Message- From: Jason J. W. Williams [mailto:jasonjwwilli...@gmail.com] Sent: Tuesday, January 19, 2016 1:33 PM To: users@kafka.apache.org Subject: Re: Partitions and consumer assignment Thanks Luke. I'll read through that.

RE: 409 Conflict

2016-01-13 Thread Heath Ivie
Update: I have completely uninstall kafka v10 and v17 and reinstalled and all is right with the world. -Original Message- From: Heath Ivie [mailto:hi...@autoanything.com] Sent: Wednesday, January 13, 2016 11:59 AM To: users@kafka.apache.org Subject: RE: 409 Conflict Hi Ewen, When I

RE: 409 Conflict

2016-01-13 Thread Heath Ivie
n't be possible for it to generate a 409 (conflict) error. -Ewen On Tue, Jan 12, 2016 at 4:06 PM, Heath Ivie wrote: > Additional Info: > > When I enter the curl commands from the 2.0 document, I get the same error: > $ curl -X POST -H "Content-Type: application/vnd.k

RE: 409 Conflict

2016-01-12 Thread Heath Ivie
rs/my_json_consumer $ curl -X GET -H "Accept: application/vnd.kafka.json.v1+json" http://10.1.30.48:8082/consumers/my_json_consumer/instances/my_consumer_instance/topics/jsontest $ curl -X DELETE http://10.1.30.48:8082/consumers/my_json_consumer/instances/my_consume

409 Conflict

2016-01-12 Thread Heath Ivie
Hi , I am running into an issue where I cannot register new consumers. The server is consistently return error code 40901: "Consumer cannot subscribe the the specified target because it has already subscribed to other topics". I am using different groups, different topics and different names bu

RE: Kafka-Rest question

2016-01-08 Thread Heath Ivie
so you could do this directly (and KIP-4 should make that easier to accomplish). -Ewen On Thu, Jan 7, 2016 at 1:46 PM, Heath Ivie wrote: > I think that the question I should be asking is how do I get more than > 1 partition when using the rest client? > > -Original Mess

RE: Kafka-Rest question

2016-01-07 Thread Heath Ivie
I think that the question I should be asking is how do I get more than 1 partition when using the rest client? -Original Message- From: Heath Ivie [mailto:hi...@autoanything.com] Sent: Thursday, January 07, 2016 1:28 PM To: users@kafka.apache.org Subject: RE: Kafka-Rest question Thanks

RE: Kafka-Rest question

2016-01-07 Thread Heath Ivie
client, but in the proxy it doesn’t appear to work like that. -Original Message- From: Ewen Cheslack-Postava [mailto:e...@confluent.io] Sent: Thursday, January 07, 2016 1:18 PM To: users@kafka.apache.org Subject: Re: Kafka-Rest question On Thu, Jan 7, 2016 at 12:54 PM, Heath Ivie wrote

Kafka-Rest question

2016-01-07 Thread Heath Ivie
Hi, I am building my application using the rest proxy and I wanted to get some clarification on the documentation. "Because consumers are stateful, any consumer instances created with the REST API are tied to a specific REST proxy instance. A full URL is provided when the instance is created a

RE: Leader Election

2016-01-06 Thread Heath Ivie
der. Alex On Wed, Jan 6, 2016 at 8:09 AM, Heath Ivie wrote: > Hi Folks, > > I am trying to use the REST proxy, but I have some fundamental > questions about how the leader election works. > > My understanding of how the way the leader elections work is that the > proxy h

Leader Election

2016-01-06 Thread Heath Ivie
Hi Folks, I am trying to use the REST proxy, but I have some fundamental questions about how the leader election works. My understanding of how the way the leader elections work is that the proxy hides all of that complexity and processes my produce/consume request transparently. Is that the

RE: Local Storage

2015-12-18 Thread Heath Ivie
partition, and a new file every specific amount of time (you can control this with log.roll.ms). The data format is specific to Kafka. Hope this helps, Gwen On Thu, Dec 17, 2015 at 3:32 PM, Heath Ivie wrote: > Maybe someone can answer this question for, because I cannot seem to > find it. &g

Local Storage

2015-12-17 Thread Heath Ivie
Maybe someone can answer this question for, because I cannot seem to find it. What is the data store that Kafka uses when it writes the logs to disk? I thought I saw a reference to KahaDB, but I am not sure if that is correct. Heath Ivie Solutions Architect Warning: This e-mail may contain