[jira] [Commented] (KAFKA-1688) Add authorization interface and naive implementation

2014-12-14 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246325#comment-14246325 ] Sriharsha Chintalapani commented on KAFKA-1688: --- [~charmalloc] we already st

[jira] [Assigned] (KAFKA-1688) Add authorization interface and naive implementation

2014-12-14 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned KAFKA-1688: - Assignee: Sriharsha Chintalapani > Add authorization interface and naive

Re: spark kafka batch integration

2014-12-14 Thread Koert Kuipers
hey gwen, no immediate plans to contribute it to spark but of course we are open to this. given sparks pullreq backlog my suspicion is that spark community prefers a user library at this point. if you lose a node the task will restart. and since each task reads until the end of a kafka partition,

Re: spark kafka batch integration

2014-12-14 Thread Joe Stein
I like the idea of the KafkaRDD and Spark partition/split per Kafka partition. That is good use of the SimpleConsumer. I can see a few different strategies for the commitOffsets and partitionOwnership. What use case are you committing your offsets for? /**

[jira] [Commented] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246250#comment-14246250 ] Jeff Holoman commented on KAFKA-1512: - Updated reviewboard https://reviews.apache.org/

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman updated KAFKA-1512: Attachment: KAFKA-1512_2014-12-14_21:30:27.patch > Limit the maximum number of connections per ip ad

Re: Review Request 29029: Patch for KAFKA-1512

2014-12-14 Thread Jeff Holoman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29029/ --- (Updated Dec. 15, 2014, 2:30 a.m.) Review request for kafka. Bugs: KAFKA-1512

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman updated KAFKA-1512: Attachment: (was: KAFKA-1512_2014-12-14_21:21:37.patch) > Limit the maximum number of connection

[jira] [Created] (KAFKA-1819) Cleaner gets confused about deleted and re-created topics

2014-12-14 Thread Gian Merlino (JIRA)
Gian Merlino created KAFKA-1819: --- Summary: Cleaner gets confused about deleted and re-created topics Key: KAFKA-1819 URL: https://issues.apache.org/jira/browse/KAFKA-1819 Project: Kafka Issue T

[jira] [Commented] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246242#comment-14246242 ] Jeff Holoman commented on KAFKA-1512: - Updated reviewboard https://reviews.apache.org/

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman updated KAFKA-1512: Attachment: KAFKA-1512_2014-12-14_21:21:37.patch > Limit the maximum number of connections per ip ad

Re: Review Request 29029: Patch for KAFKA-1512

2014-12-14 Thread Jeff Holoman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29029/ --- (Updated Dec. 15, 2014, 2:21 a.m.) Review request for kafka. Bugs: KAFKA-1512

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman updated KAFKA-1512: Attachment: KAFKA-1512_2014-12-14_21:16:55.patch > Limit the maximum number of connections per ip ad

[jira] [Commented] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246237#comment-14246237 ] Jeff Holoman commented on KAFKA-1512: - Updated reviewboard https://reviews.apache.org/

Re: Review Request 29029: Patch for KAFKA-1512

2014-12-14 Thread Jeff Holoman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29029/ --- (Updated Dec. 15, 2014, 2:16 a.m.) Review request for kafka. Summary (updated

Re: Review Request 29029: KAFKA-1512 wire in Override configuration

2014-12-14 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29029/#review65067 --- Looks good. Just small one nitpick about the test :) core/src/test

spark kafka batch integration

2014-12-14 Thread Koert Kuipers
hello all, we at tresata wrote a library to provide for batch integration between spark and kafka. it supports: * distributed write of rdd to kafa * distributed read of rdd from kafka our main use cases are (in lambda architecture speak): * periodic appends to the immutable master dataset on hdfs

[jira] [Updated] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-14 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated KAFKA-742: - Status: Patch Available (was: Open) > Existing directories under the Kafka data directory

[jira] [Updated] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-14 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated KAFKA-742: - Attachment: KAFKA-742.patch > Existing directories under the Kafka data directory without a

[jira] [Comment Edited] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-14 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246074#comment-14246074 ] Ashish Kumar Singh edited comment on KAFKA-742 at 12/14/14 7:34 PM: -

[jira] [Commented] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-14 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246074#comment-14246074 ] Ashish Kumar Singh commented on KAFKA-742: -- Created RB: https://reviews.apache.org

Review Request 29030: KAFKA-742: Existing directories under the Kafka data directory without any data cause process to not start

2014-12-14 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29030/ --- Review request for kafka. Bugs: KAFKA-742 https://issues.apache.org/jira/br

[jira] [Updated] (KAFKA-1818) Code cleanup in ReplicationUtils including unit test

2014-12-14 Thread Eric Olander (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Olander updated KAFKA-1818: Attachment: 0001-KAFKA-1818-clean-up-code-to-more-idiomatic-scala-usa.patch > Code cleanup in Replic

[jira] [Updated] (KAFKA-1818) Code cleanup in ReplicationUtils including unit test

2014-12-14 Thread Eric Olander (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Olander updated KAFKA-1818: Status: Patch Available (was: Open) >From bb32b9bfbcc5e418cbb0b6b4e9f6aa39d5ce1345 Mon Sep 17 00:00

[jira] [Created] (KAFKA-1818) Code cleanup in ReplicationUtils including unit test

2014-12-14 Thread Eric Olander (JIRA)
Eric Olander created KAFKA-1818: --- Summary: Code cleanup in ReplicationUtils including unit test Key: KAFKA-1818 URL: https://issues.apache.org/jira/browse/KAFKA-1818 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246003#comment-14246003 ] Jeff Holoman commented on KAFKA-1512: - Created reviewboard https://reviews.apache.org/

Review Request 29029: KAFKA-1512 wire in Override configuration

2014-12-14 Thread Jeff Holoman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29029/ --- Review request for kafka. Bugs: KAFKA-1512 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman updated KAFKA-1512: Status: Patch Available (was: Reopened) > Limit the maximum number of connections per ip address >

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman updated KAFKA-1512: Attachment: KAFKA-1512.patch > Limit the maximum number of connections per ip address >

[jira] [Commented] (KAFKA-1810) Add IP Filtering / Whitelists-Blacklists

2014-12-14 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245972#comment-14245972 ] Joe Stein commented on KAFKA-1810: -- +1 I like this approach because you can better manage

[jira] [Updated] (KAFKA-1688) Add authorization interface and naive implementation

2014-12-14 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1688: - Fix Version/s: 0.8.3 Assignee: (was: Sriharsha Chintalapani) > Add authorization interface an

[jira] [Comment Edited] (KAFKA-1810) Add IP Filtering / Whitelists-Blacklists

2014-12-14 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240484#comment-14240484 ] Jeff Holoman edited comment on KAFKA-1810 at 12/14/14 3:08 PM: -