[jira] [Created] (KAFKA-6871) KStreams Scala API: incorrect Javadocs and misleading parameter name

2018-05-07 Thread Michael Noll (JIRA)
Michael Noll created KAFKA-6871: --- Summary: KStreams Scala API: incorrect Javadocs and misleading parameter name Key: KAFKA-6871 URL: https://issues.apache.org/jira/browse/KAFKA-6871 Project: Kafka

[jira] [Created] (KAFKA-6872) Doc for log.roll.* is wrong

2018-05-07 Thread Fabien LD (JIRA)
Fabien LD created KAFKA-6872: Summary: Doc for log.roll.* is wrong Key: KAFKA-6872 URL: https://issues.apache.org/jira/browse/KAFKA-6872 Project: Kafka Issue Type: Bug Affects Versions: 1.0.0

[jira] [Created] (KAFKA-6873) Broker is not returning data including requested offset

2018-05-07 Thread Adam Dratwinski (JIRA)
Adam Dratwinski created KAFKA-6873: -- Summary: Broker is not returning data including requested offset Key: KAFKA-6873 URL: https://issues.apache.org/jira/browse/KAFKA-6873 Project: Kafka Iss

Re: [VOTE] KIP-219 - Improve Quota Communication

2018-05-07 Thread Rajini Sivaram
Hi Jon, Thanks for the explanation. We had deliberately avoided adding throttle_time_ms to LeaderAndIsrResponse,UpdateMetadataResponse, SaslAuthenticateResponse and SaslHandshakeResponse since clients (producer/consumer/admin client) would never get throttled on these. Clients don't use LeaderAndI

Re: [DISCUSS] KIP-278: Add version option to Kafka's commands

2018-05-07 Thread Sasaki Toru
Hi Manikumar, Colin, Thank you for your comment. As Colin said, I proposed adding an option to show version information of "local" tool, because many software have this option and I think Kafka also needs this one. As you said, the function to show remote Kafka version is useful, but I think i

[jira] [Reopened] (KAFKA-4041) kafka unable to reconnect to zookeeper behind an ELB

2018-05-07 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reopened KAFKA-4041: > kafka unable to reconnect to zookeeper behind an ELB > ---

[jira] [Created] (KAFKA-6874) Add Configuration Allowing for Optional Topology Optimization

2018-05-07 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6874: -- Summary: Add Configuration Allowing for Optional Topology Optimization Key: KAFKA-6874 URL: https://issues.apache.org/jira/browse/KAFKA-6874 Project: Kafka Iss

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

2018-05-07 Thread Colin McCabe
On Fri, May 4, 2018, at 05:49, Viktor Somogyi wrote: > Hi Colin, > > > Rather than breaking compatibility, we should simply add a new > > "incremental" boolean to AlterConfigsOptions. Callers can set this boolean > > to true when they want the update to be incremental. It should default to >

[DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-07 Thread Bill Bejeck
All, I'd like to start a discussion about adding a configuration parameter allowing for the forthcoming topology optimization to be optional via configuration. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-295%3A+Add+Streams+Configuration+Allowing+for+Optional+T

[jira] [Resolved] (KAFKA-6628) RocksDBSegmentedBytesStoreTest does not cover time window serdes

2018-05-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6628. -- Resolution: Fixed Fix Version/s: 2.0.0 > RocksDBSegmentedBytesStoreTest does not cover ti

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-07 Thread Ted Yu
Which JIRA is for the Topology Optimization itself ? Thanks On Mon, May 7, 2018 at 10:26 AM, Bill Bejeck wrote: > All, > I'd like to start a discussion about adding a configuration parameter > allowing for the forthcoming topology optimization to be optional via > configuration. > > > The KIP c

Build failed in Jenkins: kafka-trunk-jdk8 #2623

2018-05-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6474: Rewrite tests to use new public TopologyTestDriver [cleanup] [github] MINOR: Remove deprecated parameter in ProcessorContext#register (#4911) [mjsax] KAFKA-6871: KStreams Sc

Build failed in Jenkins: kafka-trunk-jdk10 #81

2018-05-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6474: Rewrite tests to use new public TopologyTestDriver [cleanup] [github] MINOR: Remove deprecated parameter in ProcessorContext#register (#4911) [mjsax] KAFKA-6871: KStreams Sca

[jira] [Resolved] (KAFKA-6736) ReassignPartitionsClusterTest#shouldMoveSubsetOfPartitions is flaky

2018-05-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-6736. --- Resolution: Cannot Reproduce > ReassignPartitionsClusterTest#shouldMoveSubsetOfPartitions is flaky > -

[jira] [Created] (KAFKA-6875) EosIntegrationTest#shouldNotViolateEosIfOneTaskFails is flaky

2018-05-07 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-6875: - Summary: EosIntegrationTest#shouldNotViolateEosIfOneTaskFails is flaky Key: KAFKA-6875 URL: https://issues.apache.org/jira/browse/KAFKA-6875 Project: Kafka Issue Type: Te

Build failed in Jenkins: kafka-trunk-jdk8 #2624

2018-05-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6628: RocksDBSegmentedBytesStoreTest does not cover time window -- [...truncated 420.02 KB...] kafka.admin.ResetConsumerGroupOffsetTest > tes

[DISCUSS] KIP-296 Add connector level configurability for producer/consumer client configs

2018-05-07 Thread Allen Tang
Hi Kafka devs, I'd like to get a discussion going on KIP-296, which would allow Kafka Connect users to be able to define producer/consumer client configurations on a connector-by-connector basis to override worker-level defaults. The KIP can be found here: https://cwiki.apache.org/confluence/page

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-07 Thread Bill Bejeck
+1 Thanks, Bill On Fri, May 4, 2018 at 7:21 PM, Richard Yu wrote: > Hi all, I would like to bump this thread since discussion in the KIP > appears to be reaching its conclusion. > > > > On Thu, Mar 15, 2018 at 3:30 PM, Richard Yu > wrote: > > > Hi all, > > > > Since there does not seem to be t

Build failed in Jenkins: kafka-trunk-jdk7 #3405

2018-05-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6628: RocksDBSegmentedBytesStoreTest does not cover time window -- [...truncated 417.34 KB...] kafka.admin.ResetConsumerGroupOffsetTest > tes

[jira] [Created] (KAFKA-6876) Sender exceptions ignored by WorkerSourceTask producer Callback causing data loss

2018-05-07 Thread Paul Davidson (JIRA)
Paul Davidson created KAFKA-6876: Summary: Sender exceptions ignored by WorkerSourceTask producer Callback causing data loss Key: KAFKA-6876 URL: https://issues.apache.org/jira/browse/KAFKA-6876 Proje

Build failed in Jenkins: kafka-trunk-jdk10 #82

2018-05-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6628: RocksDBSegmentedBytesStoreTest does not cover time window -- [...truncated 1.49 MB...] kafka.zk.KafkaZkClientTest > testTopicAssignment

Permission to edit KIP page

2018-05-07 Thread Arjun Satish
Could someone please grant me the permissions to submit a KIP? My username on apache.org is wicknicks. Thanks very much, Arjun

[jira] [Created] (KAFKA-6877) Remove completedFetch upon a failed parse if it contains no records.

2018-05-07 Thread Adem Efe Gencer (JIRA)
Adem Efe Gencer created KAFKA-6877: -- Summary: Remove completedFetch upon a failed parse if it contains no records. Key: KAFKA-6877 URL: https://issues.apache.org/jira/browse/KAFKA-6877 Project: Kafka

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-07 Thread Guozhang Wang
Hello Bill, Thanks for the KIP. My comments are the following: 1) We should state clearly what are the expected impact in "Compatibility, Deprecation, and Migration Plan" when optimization is turned on. 2) I'm wondering why we define this config as a String typed, rather than boolean typed? Or a

[jira] [Created] (KAFKA-6878) NPE when querying global state store not in READY state

2018-05-07 Thread Salazar (JIRA)
Salazar created KAFKA-6878: -- Summary: NPE when querying global state store not in READY state Key: KAFKA-6878 URL: https://issues.apache.org/jira/browse/KAFKA-6878 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-07 Thread Ted Yu
There are 4 subtasks for KAFKA-6034 If each optimization can be switched on/off, there should be 4 enums for the switch. On Mon, May 7, 2018 at 4:39 PM, Guozhang Wang wrote: > Hello Bill, > > Thanks for the KIP. My comments are the following: > > 1) We should state clearly what are the expected

[jira] [Created] (KAFKA-6879) Controller deadlock following session expiration

2018-05-07 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6879: -- Summary: Controller deadlock following session expiration Key: KAFKA-6879 URL: https://issues.apache.org/jira/browse/KAFKA-6879 Project: Kafka Issue Type

Re: KIP-244: Add Record Header support to Kafka Streams

2018-05-07 Thread Guozhang Wang
Hi Matthias, My concern of setting `null` in all cases is that it would make headers not very useful in KIP-244 then, because headers will only be available at the source stream / table, but not in any of the following instances. In practice users may be more likely to look into the headers later

Re: Permission to edit KIP page

2018-05-07 Thread Matthias J. Sax
Done :) On 5/7/18 2:30 PM, Arjun Satish wrote: > Could someone please grant me the permissions to submit a KIP? My username > on apache.org is wicknicks. > > Thanks very much, > Arjun > signature.asc Description: OpenPGP digital signature

Re: KIP-244: Add Record Header support to Kafka Streams

2018-05-07 Thread Matthias J. Sax
Guozhang, if you advocate to forward headers by default, it might be a better default strategy do forward the headers for all operators (similar to topic/partition/offset metadata). It's usually harder for users to reason about different cases and thus I would prefer to have consistent behavior, i

Build failed in Jenkins: kafka-trunk-jdk10 #83

2018-05-07 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6813: Remove deprecated APIs in KIP-182, Part I (#4919) -- [...truncated 1.49 MB...] kafka.api.SaslClientsWithInvalidCredentialsTest > testPro

Build failed in Jenkins: kafka-trunk-jdk8 #2625

2018-05-07 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6813: Remove deprecated APIs in KIP-182, Part I (#4919) -- [...truncated 1.46 MB...] org.apache.kafka.common.config.ConfigDefTest > testInvalid

Re: [VOTE] KIP-219 - Improve Quota Communication

2018-05-07 Thread Jonghyun Lee
Thanks for the detailed explanation, Rajini. I think it makes sense not to make the protocol change for them. I'll revert those changes. Jon On Mon, May 7, 2018 at 6:42 AM, Rajini Sivaram wrote: > Hi Jon, > > Thanks for the explanation. We had deliberately avoided adding > throttle_time_ms to L

Jenkins build is back to normal : kafka-trunk-jdk7 #3406

2018-05-07 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-6880) Zombie replicas must be fenced

2018-05-07 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6880: -- Summary: Zombie replicas must be fenced Key: KAFKA-6880 URL: https://issues.apache.org/jira/browse/KAFKA-6880 Project: Kafka Issue Type: Improvement

please subscribe me to dev list

2018-05-07 Thread Ravi Chinoy
-- Regards Ravi Chinoy Senior Scalability Engineer JSMN Inc. http://www.jsmninc.com/ Phone: (415) 230 9971

[jira] [Created] (KAFKA-6881) Kafka 1.1 version crashes when deleting log

2018-05-07 Thread K B Parthasarathy (JIRA)
K B Parthasarathy created KAFKA-6881: Summary: Kafka 1.1 version crashes when deleting log Key: KAFKA-6881 URL: https://issues.apache.org/jira/browse/KAFKA-6881 Project: Kafka Issue Type:

Re: Permission to edit KIP page

2018-05-07 Thread Arjun Satish
Thank you! On Mon, May 7, 2018 at 5:41 PM, Matthias J. Sax wrote: > Done :) > > On 5/7/18 2:30 PM, Arjun Satish wrote: > > Could someone please grant me the permissions to submit a KIP? My > username > > on apache.org is wicknicks. > > > > Thanks very much, > > Arjun > > > >

[jira] [Created] (KAFKA-6882) Wrong producer settings may lead to DoS on Kafka Server

2018-05-07 Thread Seweryn Habdank-Wojewodzki (JIRA)
Seweryn Habdank-Wojewodzki created KAFKA-6882: - Summary: Wrong producer settings may lead to DoS on Kafka Server Key: KAFKA-6882 URL: https://issues.apache.org/jira/browse/KAFKA-6882 Projec