[jira] [Resolved] (KAFKA-1956) New consumer client can return early from a poll() call

2015-04-04 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1956. -- Resolution: Won't Fix > New consumer client can return early from a pol

[jira] [Updated] (KAFKA-1956) New consumer client can return early from a poll() call

2015-02-16 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1956: - Summary: New consumer client can return early from a poll() call (was: new consumer client can't

[jira] [Commented] (KAFKA-1956) new consumer client can't fetch records from kafka server

2015-02-16 Thread Jay Kreps (JIRA)
ock in that loop rather than picking up your new assignment. I think a safer fix would be to repeat the whole poll loop until the timeout has expired. I recommend we hold off on this change until the overall producer + server implementation stabalizes a bit. > new consumer client can&#

[jira] [Commented] (KAFKA-1956) new consumer client can't fetch records from kafka server

2015-02-16 Thread Hongliang Su (JIRA)
ough, there has no records returned. And in my opinion, messages exists on the subscribed partitions, and I invoked the "poll", the records should be returned. And I tried your client loop code, it really works. > new consumer client can't fetch records from kafka server

[jira] [Commented] (KAFKA-1956) new consumer client can't fetch records from kafka server

2015-02-15 Thread Jay Kreps (JIRA)
n't ellapsed is not useful? > new consumer client can't fetch records from kafka server > - > > Key: KAFKA-1956 > URL: https://issues.apache.org/jira/browse/KAFKA-1956 >

[jira] [Updated] (KAFKA-1956) new consumer client can't fetch records from kafka server

2015-02-15 Thread Hongliang Su (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongliang Su updated KAFKA-1956: Attachment: 0005-fix-new-consumer-client-can-t-fetch-records-from-kaf.patch > new consumer cli

[jira] [Commented] (KAFKA-1956) new consumer client can't fetch records from kafka server

2015-02-15 Thread Hongliang Su (JIRA)
lst.clear(); } } } . } > new consumer client can't fetch records from kafka server > - > > Key: KAFKA-1956 > URL: https://iss

[jira] [Created] (KAFKA-1956) new consumer client can't fetch records from kafka server

2015-02-15 Thread Hongliang Su (JIRA)
Hongliang Su created KAFKA-1956: --- Summary: new consumer client can't fetch records from kafka server Key: KAFKA-1956 URL: https://issues.apache.org/jira/browse/KAFKA-1956 Project: Kafka

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-02-12 Thread Hongliang Su (JIRA)
w to use the new consumer client? Thank you. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-t

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-02-11 Thread Hongliang Su (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317711#comment-14317711 ] Hongliang Su commented on KAFKA-1760: - Does the new consumer client work ? I

Re: New consumer client

2015-02-10 Thread Jay Kreps
nally. Right now, it is hard to pin-point the problem of > > > > CORRUPT_MESSAGE especially when this happen on Mirror Maker side. Is > > > there > > > > any proposal to auto skip corrupted message and have reporting > > visibility > > > > of CRC error(met

Re: New consumer client

2015-02-10 Thread Steven Wu
> > > any proposal to auto skip corrupted message and have reporting > visibility > > > of CRC error(metics etc or traceability to find corruption).per topic > > etc ? > > > I am not sure if this is correct email thread to address this if not > > please >

Re: New consumer client

2015-02-09 Thread Bhavesh Mistry
topic > etc ? > > I am not sure if this is correct email thread to address this if not > please > > let me know. > > > > Will provide feedback about new consumer api and changes. > > Thanks, > > > > Bhavesh > > > > On Sun, Jan 11, 2015 at

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-02-04 Thread Guozhang Wang (JIRA)
d up not getting to consumer's network client, and hence it still tries to talk to the old guy. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 >

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-02-04 Thread Jay Kreps (JIRA)
for a non-hack to work and still be usable. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue T

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-02-04 Thread Guozhang Wang (JIRA)
onsumer:1259) [2015-02-04 12:43:46,253] DEBUG Initiating connection to node -2147483648 at localhost:46148. (org.apache.kafka.clients.NetworkClient:484) {code} > Implement new consumer client > - > > Key: KAFKA-1760 > URL

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-30 Thread Guozhang Wang (JIRA)
cket. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task > Components: consumer >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1760: - Resolution: Fixed Status: Resolved (was: Patch Available) > Implement new consu

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-29 Thread Guozhang Wang (JIRA)
trunk now. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task > Components: consumer

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-29 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-29 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-29_03:20:20.patch > Implement new consumer cli

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-23 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-23_13:13:00.patch > Implement new consumer cli

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-22 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-22_20:21:56.patch > Implement new consumer cli

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-22 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-22 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-22 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-22_10:03:26.patch > Implement new consumer cli

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-21 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-21_08:42:20.patch > Implement new consumer cli

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-18 Thread Jay Kreps (JIRA)
runk. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task > Components: consumer >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-18_19:10:13.patch > Implement new consumer cli

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-18 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-13 Thread Guozhang Wang (JIRA)
atch. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task > Components: consumer >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-12 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1760: - Fix Version/s: 0.8.3 > Implement new consumer cli

Re: New consumer client

2015-01-12 Thread Jay Kreps
> > On Sun, Jan 11, 2015 at 7:57 PM, Jay Kreps wrote: > > > I uploaded an updated version of the new consumer client ( > > https://issues.apache.org/jira/browse/KAFKA-1760). This is now almost > > feature complete, and has pretty reasonable testing and metrics. I th

Re: New consumer client

2015-01-11 Thread Bhavesh Mistry
an updated version of the new consumer client ( > https://issues.apache.org/jira/browse/KAFKA-1760). This is now almost > feature complete, and has pretty reasonable testing and metrics. I think it > is ready for review and could be checked in once 0.8.2 is out. > > For thos

New consumer client

2015-01-11 Thread Jay Kreps
I uploaded an updated version of the new consumer client ( https://issues.apache.org/jira/browse/KAFKA-1760). This is now almost feature complete, and has pretty reasonable testing and metrics. I think it is ready for review and could be checked in once 0.8.2 is out. For those who haven't

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-11 Thread Jay Kreps (JIRA)
less complete. I think we should review and check in as soon as 0.8.2 is out. I'd appreciate review. > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-11_16:57:15.patch > Implement new consumer cli

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-11 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2014-11-09 Thread Jay Kreps (JIRA)
t retries - Basically other cases where a specially timed failure can interrupt the non-fetch requests (e.g. fetch offsets, commit offsets, list offsets, etc) > Implement new consumer client > - > > Key: KAFKA-1760 > URL: h

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2014-11-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760.patch > Implement new consumer cli

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2014-11-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Assignee: Jay Kreps Status: Patch Available (was: Open) > Implement new consumer cli

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2014-11-09 Thread Jay Kreps (JIRA)
rg/r/27799/diff/ against branch trunk > Implement new consumer client > - > > Key: KAFKA-1760 > URL: https://issues.apache.org/jira/browse/KAFKA-1760 > Project: Kafka > Issue Type: Sub-task >

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2014-11-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Description: Implement a consumer client. > Implement new consumer cli

[jira] [Created] (KAFKA-1760) Implement new consumer client

2014-11-09 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1760: Summary: Implement new consumer client Key: KAFKA-1760 URL: https://issues.apache.org/jira/browse/KAFKA-1760 Project: Kafka Issue Type: Sub-task