[jira] [Resolved] (KAFKA-1106) HighwaterMarkCheckpoint failure puting broker into a bad state

2018-03-16 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1106. -- Resolution: Auto Closed Relevant parts of the code is changed an similar exceptions are fixed in the ne

[jira] [Resolved] (KAFKA-6672) ConfigCommand failing to alter configs

2018-03-16 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6672. Resolution: Fixed Fix Version/s: 1.2.0 > ConfigCommand failing to alter configs > ---

Build failed in Jenkins: kafka-trunk-jdk7 #3264

2018-03-16 Thread Apache Jenkins Server
See Changes: [mjsax] Allow users to specify 'if-not-exists' when creating topics while [github] KAFKA-6454: Allow timestamp manipulation in Processor API (#4519) [jason] KAFKA-6658; Fix RoundTripWorkload and ma

Build failed in Jenkins: kafka-trunk-jdk8 #2483

2018-03-16 Thread Apache Jenkins Server
See Changes: [mjsax] KAFKA-6663: Doc for `GlobalKTable` should be corrected. (#4723) [mjsax] Allow users to specify 'if-not-exists' when creating topics while -- [...trun

Build failed in Jenkins: kafka-trunk-jdk9 #485

2018-03-16 Thread Apache Jenkins Server
See Changes: [mjsax] Allow users to specify 'if-not-exists' when creating topics while [github] KAFKA-6454: Allow timestamp manipulation in Processor API (#4519) [jason] KAFKA-6658; Fix RoundTripWorkload and mak

Build failed in Jenkins: kafka-1.1-jdk7 #86

2018-03-16 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-6663: Doc for `GlobalKTable` should be corrected. (#4723) -- [...truncated 1.53 MB...] org.apache.kafka.streams.integration.QueryableStateIntegra

Build failed in Jenkins: kafka-trunk-jdk7 #3263

2018-03-16 Thread Apache Jenkins Server
See Changes: [mjsax] KAFKA-6663: Doc for `GlobalKTable` should be corrected. (#4723) -- [...truncated 1.66 MB...] at hudson.util.SequentialExecutionQueue$QueueEnt

[jira] [Resolved] (KAFKA-6658) Fix RoundTripWorkload and make k/v generation configurable

2018-03-16 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6658. Resolution: Fixed Fix Version/s: 1.2.0 > Fix RoundTripWorkload and make k/v generatio

Build failed in Jenkins: kafka-trunk-jdk8 #2482

2018-03-16 Thread Apache Jenkins Server
See Changes: [rajinisivaram] MINOR: Trogdor should not assume an agent co-located with the controller -- [...truncated 3.52 MB...] kafka.utils.json.JsonValueTest > testA

Re: Subject: [VOTE] 1.1.0 RC3

2018-03-16 Thread Vahid S Hashemian
Hi Damian, Thanks for running the release. I tried building from source and running the quick start on Linux & Windows with both Java 8 & 9. Here's the result: +-+-+-+ | | Linux | Windows | + +-+-+ |

[jira] [Created] (KAFKA-6673) Segment and Stamped implement Comparable, but don't override equals.

2018-03-16 Thread Koen De Groote (JIRA)
Koen De Groote created KAFKA-6673: - Summary: Segment and Stamped implement Comparable, but don't override equals. Key: KAFKA-6673 URL: https://issues.apache.org/jira/browse/KAFKA-6673 Project: Kafka

Build failed in Jenkins: kafka-1.0-jdk7 #171

2018-03-16 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-6663: Doc for `GlobalKTable` should be corrected. (#4723) -- [...truncated 369.50 KB...] kafka.coordinator.transaction.TransactionCoordinatorTes

Re: [DISCUSS] KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade

2018-03-16 Thread Matthias J. Sax
Thanks for your comments. 1. Because the old leader cannot decode the new Subscription it can only send an empty assignment back. The idea to send empty assignments to all members is interesting. I will try this out in an PR to see how it behaves. 2. I don't see an issue with keeping config `upgr

[jira] [Created] (KAFKA-6672) ConfigCommand failing to alter configs

2018-03-16 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6672: -- Summary: ConfigCommand failing to alter configs Key: KAFKA-6672 URL: https://issues.apache.org/jira/browse/KAFKA-6672 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Matthias J. Sax
Thanks a lot for the KIP! Two questions: 1) the KIP states: > kafka-streams-scala only depends on the Scala standard library and Kafka > Streams 1.0.0. Should this be 1.2 (maybe it's even better to not put any version at all) 2) In 1.1 release, we add a new module `kafka-streams-test-utils`

[jira] [Resolved] (KAFKA-6663) Expression for GlobalKTable is not correct

2018-03-16 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6663. Resolution: Fixed > Expression for GlobalKTable is not correct > ---

Kafka Consumer v1.0 terminates prematurely

2018-03-16 Thread Javed, Haseeb
Hello, I have a test cluster for Kafka consisting of one broker, one producer and one consumer, each on a separate node. Kafka broker and producer are v1.0.0. I am able to use the ProducerPerformance benchmark to write records to the broker. However, when I try to read the records using Consum

[jira] [Resolved] (KAFKA-6667) Issues in kafka Streaming when using encryption with custom serializers and deserializers

2018-03-16 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6667. Resolution: Invalid > Issues in kafka Streaming when using encryption with custom serializer

Re: [DISCUSS] KIP-271 Add NetworkClient redirector

2018-03-16 Thread Rajini Sivaram
Hi Sergey, Thanks for the KIP. Is there a reason why brokers cannot be configured with `advertised.listeners` that use hostnames (or addresses) that clients can connect to, instead of performing a redirection? Regards, Rajini On Fri, Mar 16, 2018 at 1:24 PM, Sergey Korytnikov < sergey.korytni..

Build failed in Jenkins: kafka-trunk-jdk7 #3262

2018-03-16 Thread Apache Jenkins Server
See Changes: [rajinisivaram] MINOR: Trogdor should not assume an agent co-located with the controller -- [...truncated 416.28 KB...] kafka.server.epoch.LeaderEpochFileCac

[jira] [Resolved] (KAFKA-6665) LeaderChangeListener.handleDataDeleted deadlock

2018-03-16 Thread Dmitry Konstantinov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Konstantinov resolved KAFKA-6665. Resolution: Duplicate > LeaderChangeListener.handleDataDeleted deadlock > --

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Ted Yu
Import renames seem to be fine. The class names with trailing 'S' look clean. Cheers On Fri, Mar 16, 2018 at 11:04 AM, Ismael Juma wrote: > If this is rare (as it sounds), relying on import renames seems fine to me. > Let's see what others think. > > Ismael > > On Fri, Mar 16, 2018 at 10:51 AM

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Ismael Juma
If this is rare (as it sounds), relying on import renames seems fine to me. Let's see what others think. Ismael On Fri, Mar 16, 2018 at 10:51 AM, Debasish Ghosh < debasish.gh...@lightbend.com> wrote: > I am not sure if this is practical or not. But theoretically a user may > want to extract the

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Debasish Ghosh
I am not sure if this is practical or not. But theoretically a user may want to extract the unsafe Java abstraction from the Scala ones and use Java APIs on them .. e.g. val userClicksStream: KStreamS[String, Long] = builder.stream(userClicksTopic) // Scala abstraction val jStream: KStream[String

[jira] [Created] (KAFKA-6671) Consumer group coordinator releases group before new coordinator is ready.

2018-03-16 Thread Rob Gevers (JIRA)
Rob Gevers created KAFKA-6671: - Summary: Consumer group coordinator releases group before new coordinator is ready. Key: KAFKA-6671 URL: https://issues.apache.org/jira/browse/KAFKA-6671 Project: Kafka

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Ismael Juma
What does "mixed mode application" mean? What are the cases where a user would want to use both APIs? I think that would help understand the reasoning. Thanks, Ismael On Fri, Mar 16, 2018 at 8:48 AM, Debasish Ghosh < debasish.gh...@lightbend.com> wrote: > Hi Damian - > > We could. But in case th

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Ismael Juma
Thanks for the KIP! It will be nice to have an API for Kafka Streams that is more concise _and_ safer. Like Damian, I would prefer if we didn't have a suffix and relied on package names. However, if there's a good reason why this won't work well, we should explain it in the "Rejected Alternatives"

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Debasish Ghosh
Hi Damian - We could. But in case the user wants to use both Scala and Java APIs (may be for some mixed mode application), won't that be confusing ? She will have to do something like .. import o.a.k.s.scala.{KStream => KStreamS} to rename Scala imports or the other way round for imported Java c

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Damian Guy
Hi Debasish, Thanks for the KIP - will be a great addition to streams. I've only had a quick scan, but seeing as the Scala classes are going to be in their own package could we drop the S at the end of the class names? Thanks, Damian On Fri, 16 Mar 2018 at 15:25 Debasish Ghosh wrote: > Hi - >

[DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

2018-03-16 Thread Debasish Ghosh
Hi - A new KIP, KIP-270 is up for discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-270+-+A+Scala+Wrapper+Library+for+Kafka+Streams The relevant JIRA issue: https://issues.apache.org/jira/browse/KAFKA-6670 The library as proposed in the KIP has been implemented at https://github.

[jira] [Created] (KAFKA-6670) Implement a Scala wrapper library for Kafka Streams

2018-03-16 Thread Debasish Ghosh (JIRA)
Debasish Ghosh created KAFKA-6670: - Summary: Implement a Scala wrapper library for Kafka Streams Key: KAFKA-6670 URL: https://issues.apache.org/jira/browse/KAFKA-6670 Project: Kafka Issue Typ

[DISCUSS] KIP-271 Add NetworkClient redirector

2018-03-16 Thread Sergey Korytnikov
Hi devs, I have created new KIP-271 for discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-271%3A+Add+NetworkClient+redirector Kafka JIRA issue: https://issues.apache.org/jira/browse/KAFKA-6669 The fix has been implemented and tested with version 1.0 and trunk snapshot of clients j

[jira] [Created] (KAFKA-6669) KIP-271: Add NetworkClient redirector

2018-03-16 Thread Sergey Korytnikov (JIRA)
Sergey Korytnikov created KAFKA-6669: Summary: KIP-271: Add NetworkClient redirector Key: KAFKA-6669 URL: https://issues.apache.org/jira/browse/KAFKA-6669 Project: Kafka Issue Type: Impro

[jira] [Created] (KAFKA-6668) Broker crashes on restart ,got a CorruptRecordException: Record size is smaller than minimum record overhead(14)

2018-03-16 Thread mayong (JIRA)
mayong created KAFKA-6668: - Summary: Broker crashes on restart ,got a CorruptRecordException: Record size is smaller than minimum record overhead(14) Key: KAFKA-6668 URL: https://issues.apache.org/jira/browse/KAFKA-6668

Build failed in Jenkins: kafka-trunk-jdk8 #2481

2018-03-16 Thread Apache Jenkins Server
See Changes: [me] KAFKA-6661: Ensure sink connectors don’t resume consumer when task is -- [...truncated 2.00 MB...] org.apache.kafka.connect.runtime.TransformationConfig

[jira] [Created] (KAFKA-6667) Issues in kafka Streaming when using encryption with custom serializers and deserializers

2018-03-16 Thread Amandeep Singh (JIRA)
Amandeep Singh created KAFKA-6667: - Summary: Issues in kafka Streaming when using encryption with custom serializers and deserializers Key: KAFKA-6667 URL: https://issues.apache.org/jira/browse/KAFKA-6667