Re: [VOTE] 2.6.2 RC0

2021-03-22 Thread Ewen Cheslack-Postava
be the case, we only have about 3 dependencies listed there but pull in close to 90 jars (though some of those jars may be released/licensed together). These should be cleaned up. -Ewen On Fri, Mar 19, 2021 at 6:51 PM Justin Mclean wrote: > Hi, > > I was taking a look at this release

Re: [VOTE] KIP-610: Error Reporting in Sink Connectors

2020-05-19 Thread Ewen Cheslack-Postava
+1 (binding) This will be a nice improvement. From the discussion thread it's clear this is tricky to get right, nice work! On Tue, May 19, 2020 at 8:16 AM Andrew Schofield wrote: > +1 (non-binding) > > This is now looking very nice. > > Andrew Schofield > > On 19/05/2020, 16:11, "Randall Hauc

Re: [VOTE] KIP-531: Drop support for Scala 2.11 in Kafka 2.5

2019-12-17 Thread Ewen Cheslack-Postava
bly even providing a pre-shaded version for convenience). The latter is more than we probably want to do here and probably has to actually wait for major version, but former might be doable. -Ewen On Mon, Nov 18, 2019 at 9:06 AM Mickael Maison wrote: > +1 (binding) > Thanks for the KIP > &

Re: [VOTE] KIP-507: Securing Internal Connect REST Endpoints

2019-09-24 Thread Ewen Cheslack-Postava
seems like this should probably be tied to some corresponding group timeout, e.g. maybe the session.timeout. -Ewen On Tue, Sep 24, 2019 at 11:37 AM Konstantine Karantasis < konstant...@confluent.io> wrote: > Nicely done! > > +1 (non-binding) > > Konstantine > > On Tue

Re: [VOTE] 2.2.0 RC2

2019-03-21 Thread Ewen Cheslack-Postava
+1 -Ewen On Thu, Mar 21, 2019 at 10:33 AM Harsha wrote: > +1 (non-bidning) > - Download artifacts, setup 3 node cluster > - Ran producer/consumer clients > > Thanks, > Harsha > > On Thu, Mar 21, 2019, at 5:54 AM, Andrew Schofield wrote: > > +1 (non-binding) >

[jira] [Resolved] (KAFKA-7813) JmxTool throws NPE when --object-name is omitted

2019-03-17 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7813. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request

Re: [VOTE] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

2019-03-14 Thread Ewen Cheslack-Postava
+1 (binding) -Ewen On Wed, Mar 13, 2019 at 2:04 PM Randall Hauch wrote: > Excellent work, Konstantine! > > +1 (binding) > > On Mon, Mar 11, 2019 at 8:05 PM Konstantine Karantasis < > konstant...@confluent.io> wrote: > > > Thanks Jason! > > That makes pe

[jira] [Resolved] (KAFKA-7834) Extend collected logs in system test services to include heap dumps

2019-02-04 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7834. -- Resolution: Fixed Fix Version/s: (was: 1.1.2

Re: [DISCUSS] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

2019-01-25 Thread Ewen Cheslack-Postava
won't ever get to v2 anyway... -Ewen On Fri, Jan 25, 2019 at 9:38 AM Jason Gustafson wrote: > Hey Konstantine, > > Thanks for the reply. Just one response below: > > In 'compatible' mode, the worker sends both protocols to the broker > > coordinator during th

Re: [VOTE] KIP-421: Support resolving externalized secrets in AbstractConfig

2019-01-24 Thread Ewen Cheslack-Postava
constructor to encourage people to update. Further, if we're worried about confusion about how to load the two files, we could have a constructor that does that default pattern for you. -Ewen On Thu, Jan 24, 2019 at 11:36 AM Colin McCabe wrote: > On Thu, Jan 24, 2019, at 11:25, TEJA

Re: [EXTERNAL] [VOTE] KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics

2019-01-23 Thread Ewen Cheslack-Postava
iding the extra config might be worth the not-quite-perfect compatibility story. -Ewen On Tue, Sep 11, 2018 at 7:01 AM Stephane Maarek < steph...@simplemachines.com.au> wrote: > +1 (non binding) > > On Tue., 11 Sep. 2018, 10:48 am Mickael Maison, > wrote: > > > +1 (non

[jira] [Resolved] (KAFKA-7461) Connect Values converter should have coverage of logical types

2019-01-14 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7461. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-7503) Integration Test Framework for Connect

2019-01-14 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7503. -- Resolution: Fixed Fix Version/s: 2.0.2 2.1.1

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2019-01-04 Thread Ewen Cheslack-Postava
rstand the compatibility story here (which could also be that we just don't provide one -- just want to make sure it is clear). I may have missed something in this proposal since it's pretty long, let me know if there was something obvious I overlooked. Thanks, -Ewen On Mon, Dec 31, 201

Re: [DISCUSS] KIP-411: Add option to make Kafka Connect task client ID values unique

2019-01-04 Thread Ewen Cheslack-Postava
f interpolation were supported in the config value (as we now do with managed secrets). For example, it could support something like client.id=connector-${taskId} and the task ID would be substituted automatically into the string. I don't necessarily like that solution (seems complicated and n

[jira] [Resolved] (KAFKA-7551) Refactor to create both producer & consumer in Worker

2018-11-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7551. -- Resolution: Fixed Merged [https://github.com/apache/kafka/pull/5842,] my bad

[jira] [Resolved] (KAFKA-7620) ConfigProvider is broken for KafkaConnect when TTL is not null

2018-11-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7620. -- Resolution: Fixed Fix Version/s: 2.0.2 2.1.1

Re: [DISCUSS] KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics

2018-11-27 Thread Ewen Cheslack-Postava
lines, is there actually a need for TopicSettings class? We already have NewTopic in the AdminClient APIs. Does that not suffice? -Ewen On Mon, Sep 24, 2018 at 11:56 AM Andrew Otto wrote: > FWIW, I’d find this feature useful. > > On Mon, Sep 24, 2018 at 2:42 PM Randall Hauch wrote: > > > R

[jira] [Resolved] (KAFKA-7560) PushHttpMetricsReporter should not convert metric value to double

2018-11-07 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7560. -- Resolution: Fixed Fix Version/s: 2.1.0 2.2.0 Issue

Re: [VOTE] 2.0.1 RC0

2018-11-02 Thread Ewen Cheslack-Postava
+1 -Ewen On Thu, Nov 1, 2018 at 10:10 AM Manikumar wrote: > We were waiting for the system test results. There were few failures: > KAFKA-7579, KAFKA-7559, KAFKA-7561 > they are not blockers for 2.0.1 release. We need more votes from > PMC/committers :) > > Thanks Stanisl

[jira] [Resolved] (KAFKA-6490) JSON SerializationException Stops Connect

2018-10-20 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6490. -- Resolution: Fixed Fix Version/s: 2.0.0 Closing as this is effectively

[jira] [Resolved] (KAFKA-5117) Kafka Connect REST endpoints reveal Password typed values

2018-10-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-5117. -- Resolution: Duplicate Assignee: Ewen Cheslack-Postava Fix

[jira] [Resolved] (KAFKA-7476) SchemaProjector is not properly handling Date-based logical types

2018-10-04 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7476. -- Resolution: Fixed Fix Version/s: 2.1.0 0.10.2.3

Re: Anyone interested in helping out a little brother Apache project with their Kafka integration?

2018-09-30 Thread Ewen Cheslack-Postava
ka Connect already has a couple of Connectors for. Could you clarify what format/serialization/use case PLC4X has? -Ewen On Wed, Aug 15, 2018 at 7:43 AM Christofer Dutz wrote: > Hi all, > > I am one of the Apache PLC4X (incubating) committers and am looking for > people willing to

Re: Apache Kafka project charter

2018-09-30 Thread Ewen Cheslack-Postava
n immediate compatibility commitment (compatibility across versions of AK broker & Connect, as well as upgrade & API & config compatibility for the connector itself. -Ewen On Sun, Sep 30, 2018 at 1:44 PM Matthias J. Sax wrote: > I am not aware of anything like this. And I also t

[jira] [Resolved] (KAFKA-7460) Connect Values converter uses incorrect date format string

2018-09-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7460. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1

[jira] [Created] (KAFKA-7461) Connect Values converter should have coverage of logical types

2018-09-30 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-7461: Summary: Connect Values converter should have coverage of logical types Key: KAFKA-7461 URL: https://issues.apache.org/jira/browse/KAFKA-7461 Project

[jira] [Created] (KAFKA-7460) Connect Values converter uses incorrect date format string

2018-09-30 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-7460: Summary: Connect Values converter uses incorrect date format string Key: KAFKA-7460 URL: https://issues.apache.org/jira/browse/KAFKA-7460 Project

[jira] [Resolved] (KAFKA-7434) DeadLetterQueueReporter throws NPE if transform throws NPE

2018-09-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7434. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Resolved] (KAFKA-4932) Add UUID Serde

2018-09-09 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4932. -- Resolution: Fixed Issue resolved by pull request 4438 [https://github.com

[jira] [Resolved] (KAFKA-7353) Connect logs 'this' for anonymous inner classes

2018-09-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7353. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1

[jira] [Resolved] (KAFKA-7242) Externalized secrets are revealed in task configuration

2018-08-28 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7242. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

Re: [DISCUSS] add connect-related packages to "What is considered a "major change" that needs a KIP?"

2018-08-07 Thread Ewen Cheslack-Postava
nnect modules are considered internal implementation details. -Ewen On Fri, Jul 27, 2018 at 7:15 PM Chia-Ping Tsai wrote: > hi Kafka > > There is a section[1] listing the packages which have public interfaces. > However, it doesn't include any connect-related packages. It would

[jira] [Resolved] (KAFKA-7225) Kafka Connect ConfigProvider not invoked before validation

2018-08-07 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7225. -- Resolution: Fixed > Kafka Connect ConfigProvider not invoked before validat

[jira] [Resolved] (KAFKA-7228) DeadLetterQueue throws a NullPointerException

2018-08-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7228. -- Resolution: Fixed > DeadLetterQueue throws a NullPointerExcept

Re: [Vote] KIP-321: Update TopologyDescription to better represent Source and Sink Nodes

2018-07-31 Thread Ewen Cheslack-Postava
x27;t the methods on Source also be Optional types? -Ewen On Mon, Jul 30, 2018 at 11:13 PM Damian Guy wrote: > Hi Nishanth, > > I have one nit on the KIP. I think the topicNameExtractor method should > return Optional rather than null. > Sorry I'm late here. > > Than

[jira] [Resolved] (KAFKA-7068) ConfigTransformer doesn't handle null values

2018-06-17 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7068. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-7047) Connect isolation whitelist does not include SimpleHeaderConverter

2018-06-16 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7047. -- Resolution: Fixed Reviewer: Ewen Cheslack-Postava Fix Version/s

[jira] [Resolved] (KAFKA-7039) DelegatingClassLoader creates plugin instance even if its not Versioned

2018-06-16 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7039. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-7056) Connect's new numeric converters should be in a different package

2018-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7056. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-7009) Mute logger for reflections.org at the warn level in system tests

2018-06-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7009. -- Resolution: Fixed Fix Version/s: 2.1.0 0.11.0.3

[jira] [Resolved] (KAFKA-7031) Kafka Connect API module depends on Jersey

2018-06-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7031. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-7043) Connect isolation whitelist does not include new primitive converters (KIP-305)

2018-06-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7043. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-7003) Add headers with error context in messages written to the Connect DeadLetterQueue topic

2018-06-11 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7003. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.0 Issue

[jira] [Resolved] (KAFKA-6997) Kafka run class doesn't exclude test-sources jar

2018-06-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6997. -- Resolution: Fixed Issue resolved by pull request 5139 [https://github.com

[jira] [Resolved] (KAFKA-6981) Missing Connector Config (errors.deadletterqueue.topic.name) kills Connect Clusters

2018-06-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6981. -- Resolution: Fixed Issue resolved by pull request 5125 [https://github.com

Re: [VOTE] KIP-176: Remove deprecated new-consumer option for tools

2018-05-25 Thread Ewen Cheslack-Postava
+1 (binding) Just follow up on the existing version of the KIP, so nothing new here. Possibly a bit disruptive given how quick the 1.0 -> 2.0 jump happened, but it's the right time to remove it. -Ewen On Thu, May 24, 2018 at 8:13 AM Viktor Somogyi wrote: > +1 (non-binding) > >

Re: [EXTERNAL] Kafka Connect: New Kafka Source Connector

2018-05-22 Thread Ewen Cheslack-Postava
Sorry for the delay, didn't see this until now. I've given you edit permissions on the wiki. -Ewen On Tue, May 15, 2018 at 2:21 PM McCaig, Rhys wrote: > Hi Team, > > Would someone be able to provide me with Confluence permission in order to > write a KIP for the below

[jira] [Resolved] (KAFKA-5807) Check Connector.config() and Transformation.config() returns a valid ConfigDef

2018-05-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-5807. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

Re: [VOTE] KIP-305: Add Connect primitive number converters

2018-05-22 Thread Ewen Cheslack-Postava
+1 (binding) -Ewen On Tue, May 22, 2018 at 9:29 AM Ted Yu wrote: > +1 > > On Tue, May 22, 2018 at 9:19 AM, Randall Hauch wrote: > > > I'd like to start a vote of a very straightforward proposal for Connect > to > > add converters for the basic primitive numb

Re: [DISCUSS] KIP-305: Add Connect primitive number converters

2018-05-21 Thread Ewen Cheslack-Postava
Sorry, probably not ideal to just be seeing this now given KIP deadline, but in general straightforward ones where we expect things to be uncontroversial, I think its fine to kick off a vote thread. Worst case we have people re-file votes if something substantial changes in the proposal. -Ewen

Re: [DISCUSS] KIP-304: Connect runtime mode improvements for container platforms

2018-05-21 Thread Ewen Cheslack-Postava
ere fundamentally it does not fit into your k8s/mesos/container + CI/CD workflow to do anything other than pass configs in via command line flags? Or is it mostly the pain of too many topics? Or something else? -Ewen On Fri, May 18, 2018 at 4:47 AM Saulius Valatka wrote: > Hi, > > thanks

Re: [DISCUSS] KIP-298: Error Handling in Connect

2018-05-21 Thread Ewen Cheslack-Postava
On Mon, May 21, 2018 at 12:39 PM Arjun Satish wrote: > Thanks a lot, Ewen! I'll make sure the documentation is clear on the > differences between retries an tolerance. > > Do you think percentage would have the same problem as the one you brought > up? Also, if we say 10% t

Re: [VOTE] KIP-298: Error Handling in Connect kafka

2018-05-21 Thread Ewen Cheslack-Postava
+1 binding. I had one last comment in the DISCUSS thread, but not really a blocker. -Ewen On Mon, May 21, 2018 at 9:48 AM Matthias J. Sax wrote: > +1 (binding) > > > > On 5/21/18 9:30 AM, Randall Hauch wrote: > > Thanks, Arjun. +1 (non-binding) > > > > Regards

Re: [DISCUSS] KIP-298: Error Handling in Connect

2018-05-21 Thread Ewen Cheslack-Postava
olute value or something like a percentage? Given the current way of setting things, I'm not sure I'd ever set it to anything but -1 or 0, with maybe 1 as an easy option for restarting a connector to get it past one bad message, then reverting back to -1 or 0. -Ewen On Mon, May 21, 2018 at

Re: [DISCUSS] KIP-305: Add Connect primitive number converters

2018-05-18 Thread Ewen Cheslack-Postava
ebody finds them useful for something if they exist. -Ewen On Fri, May 18, 2018 at 11:55 AM Randall Hauch wrote: > Thanks, Ewen. > > You make several good points, and I've updated the KIP to hopefully address > your comments. I think the symmetry with the Kafka serdes is useful

[jira] [Resolved] (KAFKA-6566) SourceTask#stop() not called after exception raised in poll()

2018-05-18 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6566. -- Resolution: Fixed > SourceTask#stop() not called after exception raised in p

Re: [DISCUSS] KIP-298: Error Handling in Connect

2018-05-17 Thread Ewen Cheslack-Postava
s -- instead of delivering the raw data, we potentially lose raw data & schema info because we're rendering it as JSON. Not sure that's a good idea... I think that last item might be the biggest concern to me -- DLQ formats and control over content & reprocessing seems a bit unclea

Re: [VOTE] KIP-285: Connect Rest Extension Plugin

2018-05-17 Thread Ewen Cheslack-Postava
+1 (binding) Thanks, Ewen On Thu, May 17, 2018 at 12:16 PM Ted Yu wrote: > +1 > Original message From: Gwen Shapira > Date: 5/17/18 12:02 PM (GMT-08:00) To: dev > Subject: Re: [VOTE] KIP-285: Connect Rest Extension Plugin > LGTM. +1. > > On Wed, Ma

Re: [DISCUSS] KIP-285: Connect Rest Extension Plugin

2018-05-17 Thread Ewen Cheslack-Postava
Yup, thanks for the changes. The 'health' package in particular feels like a nice fit given the way we expect it to be used. -Ewen On Wed, May 16, 2018 at 7:02 PM Randall Hauch wrote: > Looks good to me. Thanks for quickly making the changes! Great work! > > Best regards, &

Re: [VOTE] KIP-297: Externalizing Secrets for Connect Configurations

2018-05-17 Thread Ewen Cheslack-Postava
hink this is fine as I don't think there are truly common secrets provider formats/apis/protocols, just want to make sure it is clear. Thanks, Ewen On Thu, May 17, 2018 at 6:19 PM Ted Yu wrote: > +1 > Original message From: Magesh Nandakumar < > mage...@co

Re: [DISCUSS] KIP-305: Add Connect primitive number converters

2018-05-17 Thread Ewen Cheslack-Postava
spend time and effort building and maintaining them. Otherwise, this seems simple and straightforward. Generally +1 on the proposal. -Ewen On Thu, May 17, 2018 at 6:04 PM Magesh Nandakumar wrote: > Thanks Randall for the KIP. I think it will be super useful and looks > pretty straightforw

Re: [DISCUSS] KIP-285: Connect Rest Extension Plugin

2018-05-16 Thread Ewen Cheslack-Postava
r metrics. * Currently we have the State classes nested inside ConnectorHealth class. I think this makes those classes more annoying to use. Is there a reason for them to be nested or can we just pull them out to the same level as ConnectorHealth? -Ewen On Tue, May 15, 2018 at 9:30 AM Magesh Nandaku

[jira] [Resolved] (KAFKA-5141) WorkerTest.testCleanupTasksOnStop transient failure due to NPE

2018-04-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-5141. -- Resolution: Fixed Assignee: Ewen Cheslack-Postava Not sure of the fix

Re: [DISCUSS] KIP-276: Add StreamsConfig prefix for different consumers

2018-04-11 Thread Ewen Cheslack-Postava
On Thu, Apr 5, 2018 at 3:28 PM, Matthias J. Sax wrote: > Ewen, > > I cannot completely follow your argument. Can you elaborate a little > bit? After reading you mail, I am not sure if you prefer config > inheritance or not? And if, to what extend? > So we've had issues wi

Re: [DISCUSS] KIP-276: Add StreamsConfig prefix for different consumers

2018-04-04 Thread Ewen Cheslack-Postava
enges in Connect don't appear here (e.g. conflicts in producer/consumer config naming, since this is a Consumer-only KIP), but similar problems arise. -Ewen On Wed, Apr 4, 2018 at 10:56 PM, Boyang Chen wrote: > Thanks Guozhang! I already updated the pull request and KIP to deprecate &g

[jira] [Resolved] (KAFKA-6728) Kafka Connect Header Null Pointer Exception

2018-04-03 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6728. -- Resolution: Fixed Fix Version/s: 1.1.1 1.2.0 Issue

Re: [VOTE] KIP-272: Add API version tag to broker's RequestsPerSec metric

2018-03-30 Thread Ewen Cheslack-Postava
+1 (binding) The incompatibility is unfortunate, but seems unlikely to cause a problem in practice. Let's just make sure there's a note in the upgrade notes about the incompatibility when we have a PR for this. -Ewen On Fri, Mar 30, 2018 at 10:22 AM, Jun Rao wrote: > Hi, Allen, &

Re: [DISCUSSION] KIP-266: Add TimeoutException to KafkaConsumer#position()

2018-03-23 Thread Ewen Cheslack-Postava
shouldn't revisit, just that it might also be a faster way to get to a full understanding of the options, concerns, and tradeoffs). -Ewen On Thu, Mar 22, 2018 at 7:19 AM, Richard Yu wrote: > I do have one question though: in the current KIP, throwing > TimeoutException to mark > that

Re: Kafka Connect task re-balance repeatedly

2018-03-22 Thread Ewen Cheslack-Postava
y start running multiple Connect clusters but forget to make some of the default settings unique. I'd probably start by looking into that possibility to debug this issue. -Ewen On Wed, Mar 21, 2018 at 10:15 PM, Ziliang Chen wrote: > Hi, > > I have 2 Kafka Connect instances runs i

Re: [DISCUSS] KIP-242: Mask password fields in Kafka Connect REST response

2018-03-19 Thread Ewen Cheslack-Postava
ST API, we'd have to address these issues anyway. -Ewen On Mon, Mar 19, 2018 at 2:33 PM, Matt Farmer wrote: > What’s the status of this? This is a pretty hard blocker for us to meet > requirements internally to deploy connect in a distributed fashion. > > @Ewen - Regarding

Re: Seeking Feedback on Kafka Connect Issues

2018-03-19 Thread Ewen Cheslack-Postava
investigate. > Interesting. I think you're right that we're probably just reporting *assigned* tasks with the task-count metric rather than active tasks. I think an active tasks metric would be reasonable, though since you really need to look at the aggregate across workers, I'm not sure it's the best for alerting. Maybe an unhealthy/dead tasks count metric would be better? You can alert on that directly without having to aggregate across workers. -Ewen > > --- > > I would love thoughts on all of the above from anyone on this list. > > Thanks, > > Matt Farmer

[jira] [Created] (KAFKA-6676) System tests do not handle ZK chroot properly with SCRAM

2018-03-17 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-6676: Summary: System tests do not handle ZK chroot properly with SCRAM Key: KAFKA-6676 URL: https://issues.apache.org/jira/browse/KAFKA-6676 Project: Kafka

Re: [VOTE] KIP-186: Increase offsets retention default to 7 days

2018-03-09 Thread Ewen Cheslack-Postava
Thanks for voting everyone, KIP is accepted with 5 binding +1 and 5 non-binding +1s. PR is already merged and there are upgrade notes about the potential memory impact. -Ewen On Wed, Mar 7, 2018 at 9:25 PM, Ted Yu wrote: > +1 > Original message From: Guozhang Wang >

[jira] [Resolved] (KAFKA-5999) Offset Fetch Request

2018-03-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-5999. -- Resolution: Invalid Assignee: Ewen Cheslack-Postava Closing as Invalid

Re: Exposing additional metadata in Kafka Connect schema parameters

2018-03-06 Thread Ewen Cheslack-Postava
erters that fail to preserve that information. -Ewen On Tue, Mar 6, 2018 at 3:29 AM, Gunnar Morling wrote: > Hi, > > A user of the Debezium CDC Kafka Connect connectors has asked whether we > could provide information about the original source type of captured table > columns. >

[ANNOUNCE] Apache Kafka 1.0.1 Released

2018-03-06 Thread Ewen Cheslack-Postava
Comar, Ewen Cheslack-Postava, Filipe Agapito, fredfp, Guozhang Wang, huxihx, Ismael Juma, Jason Gustafson, Jeremy Custenborder, Jiangjie (Becket) Qin, Joel Hamill, Konstantine Karantasis, lisa2lisa, Logan Buckley, Manjula K, Matthias J. Sax, Nick Chiu, parafiend, Rajini Sivaram, Randall Hauch, R

[jira] [Resolved] (KAFKA-5471) Original Kafka paper link broken

2018-03-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-5471. -- Resolution: Fixed Assignee: Ewen Cheslack-Postava Updated the link to

[VOTE] KIP-186: Increase offsets retention default to 7 days

2018-03-05 Thread Ewen Cheslack-Postava
ow up with those in subsequent KIPs, see the discussion thread for details. Also note this is related, but complementary, to https://cwiki.apache.org/confluence/display/KAFKA/KIP-211%3A+Revise+Expiration+Semantics+of+Consumer+Group+Offsets . And of course +1 (binding) from me. Thanks, Ewen

Re: [DISCUSS] KIP-186: Increase offsets retention default to 7 days

2018-03-05 Thread Ewen Cheslack-Postava
he vote thread so we can get this fixed for the next version. -Ewen On Fri, Oct 6, 2017 at 11:00 AM, Manikumar wrote: > looks like VOTE thread is *NOT* started for this KIP. > > On Fri, Oct 6, 2017 at 11:23 PM, Manikumar > wrote: > > > looks like VOTE thread is started

[jira] [Resolved] (KAFKA-4854) Producer RecordBatch executes callbacks with `null` provided for metadata if an exception is encountered

2018-03-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4854. -- Resolution: Not A Bug Assignee: Ewen Cheslack-Postava This behavior is

Re: [VOTE] 1.0.1 RC2

2018-03-02 Thread Ewen Cheslack-Postava
Thanks everyone for voting. This passes with 3 binding +1, 5 non-binding +1, and no dissenting votes. I'll work on getting the release finalized and send out an announcement when it is ready. -Ewen On Tue, Feb 27, 2018 at 11:18 PM, Jason Gustafson wrote: > +1. Verified artifacts and

Re: Kafka 0.11.0.1 and filebeat 6.1 compatibility

2018-02-27 Thread Ewen Cheslack-Postava
d by folks from Elastic or the sarama project. -Ewen On Fri, Feb 9, 2018 at 7:11 AM, Sandeep Sarkar wrote: > Hi All, > > > > I am using filebeat 6.1 and kafka 0.11.0.1 to push logs. From filebeat > logs I could see that communication is getting established but then logs > are

Re: Question about developer documentation

2018-02-27 Thread Ewen Cheslack-Postava
The web page is more about general project info and might be of interest to people beyond just developers. But I agree the wiki landing page could use some updating. Even more than just the developer section as we're missing several releases, the oldest ones are listed at the top, etc. -Ewe

[jira] [Resolved] (KAFKA-6236) stream not picking data from topic - after rebalancing

2018-02-23 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6236. -- Resolution: Cannot Reproduce Unresponsive, so we can't track this down. P

[jira] [Resolved] (KAFKA-6239) Consume group hung into rebalancing state, now stream not able to poll data

2018-02-23 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6239. -- Resolution: Duplicate > Consume group hung into rebalancing state, now str

[jira] [Resolved] (KAFKA-6439) "com.streamsets.pipeline.api.StageException: KAFKA_50 - Error writing data to the Kafka broker: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.N

2018-02-23 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6439. -- Resolution: Not A Bug > "com.streamsets.pipeline.api.StageException:

[jira] [Created] (KAFKA-6580) Connect bin scripts have incorrect usage

2018-02-21 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-6580: Summary: Connect bin scripts have incorrect usage Key: KAFKA-6580 URL: https://issues.apache.org/jira/browse/KAFKA-6580 Project: Kafka Issue

[VOTE] 1.0.1 RC2

2018-02-21 Thread Ewen Cheslack-Postava
com/apache/kafka/tree/1.0.1-rc2 * Documentation: http://kafka.apache.org/10/documentation.html * Protocol: http://kafka.apache.org/10/protocol.html /** Thanks, Ewen Cheslack-Postava

Re: [VOTE] 1.0.1 RC1

2018-02-20 Thread Ewen Cheslack-Postava
ter the PR is merged. -Ewen On Fri, Feb 16, 2018 at 3:53 AM, Mickael Maison wrote: > Ran tests from source and quickstart with binaries > > +1 (non-binding) > > On Fri, Feb 16, 2018 at 6:05 AM, Jason Gustafson > wrote: > > +1. Verified artifacts and ran quickstart. Than

[jira] [Resolved] (KAFKA-6503) Connect: Plugin scan is very slow

2018-02-14 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6503. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request

Re: [VOTE] 1.0.1 RC1

2018-02-12 Thread Ewen Cheslack-Postava
And of course I'm +1 since I've already done normal release validation before posting this. -Ewen On Mon, Feb 12, 2018 at 10:15 AM, Ewen Cheslack-Postava wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Ka

[VOTE] 1.0.1 RC1

2018-02-12 Thread Ewen Cheslack-Postava
che.org/10/documentation.html * Protocol: http://kafka.apache.org/10/protocol.html Thanks, Ewen Cheslack-Postava

Re: [VOTE] 1.0.1 RC0

2018-02-09 Thread Ewen Cheslack-Postava
Just a heads up that we had a fix for KAFKA-6529 land to fix a file descriptor leak. So this RC is dead and I'll be generating RC1 soon. Thanks, Ewen On Wed, Feb 7, 2018 at 11:06 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi Ewen, > > +1 > > Building f

[jira] [Resolved] (KAFKA-6513) New Connect header support doesn't define `converter.type` property correctly

2018-02-09 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6513. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request

Documentation build system

2018-02-06 Thread Ewen Cheslack-Postava
affects everyone contributing to the project, I figured I'd send this quick note to increase the likelihood people see it and have a chance to weigh in. Thanks, -Ewen

Re: [VOTE] 1.0.1 RC0

2018-02-05 Thread Ewen Cheslack-Postava
. This requires "closing" two separate staging repos to get everything released. If things look good now, I can update the release script/instructions to make this clearer. -Ewen On Mon, Feb 5, 2018 at 9:59 PM, Ewen Cheslack-Postava wrote: > Not sure, seems to be variable. I "clo

Re: [VOTE] 1.0.1 RC0

2018-02-05 Thread Ewen Cheslack-Postava
doesn't show up for too long or we need a follow up RC, I'll just extend/restart the process. -Ewen On Mon, Feb 5, 2018 at 8:21 PM, Ted Yu wrote: > Ewen: > Do you know how long it takes for maven repo to be populated ? > > Looking at: > https://repository.apache.org/con

[VOTE] 1.0.1 RC0

2018-02-05 Thread Ewen Cheslack-Postava
d from everyone. Thanks, Ewen

[jira] [Created] (KAFKA-6536) Streams quickstart pom.xml is missing versions for a bunch of plugins

2018-02-05 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-6536: Summary: Streams quickstart pom.xml is missing versions for a bunch of plugins Key: KAFKA-6536 URL: https://issues.apache.org/jira/browse/KAFKA-6536

  1   2   3   4   5   6   7   8   9   10   >