?????? [DISCUSS] Why don't support web UI

2018-05-31 Thread ????????????
Hi Rahul : Thanks for you reply . web UI is no need very beautiful . Hadoop HDFS and YARN 's UI is nice , maybe we can deploy a web interface when the core function is ok -- -- ??: "Rahul Singh"; : 2018??5??31??(??) 6:23 ?

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-05-31 Thread Guozhang Wang
Hi Florian, Re 1: I think changing the KStreamImpl / KTableImpl to allow modifying the processor name after the operator is fine as long as we do the check again when modifying that. In fact, we are having some topology optimization going on which may modify processor names in the final topology a

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-31 Thread Dong Lin
Thanks for the KIP! I am in favor of the option 1. +1 as well. On Thu, May 31, 2018 at 6:00 PM, Jason Gustafson wrote: > Thanks everyone for the feedback. I've updated the KIP and added > KAFKA-6979. > > -Jason > > On Wed, May 30, 2018 at 3:50 PM, Guozhang Wang wrote: > > > Thanks Jason. I'm i

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-31 Thread Jason Gustafson
Thanks everyone for the feedback. I've updated the KIP and added KAFKA-6979. -Jason On Wed, May 30, 2018 at 3:50 PM, Guozhang Wang wrote: > Thanks Jason. I'm in favor of option 1 as well. > > On Wed, May 30, 2018 at 1:37 PM, Bill Bejeck wrote: > > > For what it's worth I'm +1 on Option 1 and t

[jira] [Created] (KAFKA-6979) Add max.block.ms to consumer for default behavior

2018-05-31 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6979: -- Summary: Add max.block.ms to consumer for default behavior Key: KAFKA-6979 URL: https://issues.apache.org/jira/browse/KAFKA-6979 Project: Kafka Issue Typ

Re: [VOTE] KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User

2018-05-31 Thread Jason Gustafson
I'm going to call this vote since it has enough binding votes and it has been open for a long time. The final tally: Binding +4: me, Ismael, Rajini, and Guozhang Non-binding +4: Ted, Moshe, Alex, and Dhruvil There were no -1 votes. Thanks to Alexander Dunayevsky for the KIP! Thanks, Jason On F

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2018-05-31 Thread Anna Povzner
Hi Tom, Thanks for the KIP. I am aware that the voting thread was started, but wanted to discuss couple of concerns here first. I think the coupling of RequestedTopicState#generatedReplicaAssignment() and TopicState#replicasAssignments() does not work well in case where the request deals only w

[jira] [Created] (KAFKA-6978) Make Streams Window retention time strict

2018-05-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-6978: --- Summary: Make Streams Window retention time strict Key: KAFKA-6978 URL: https://issues.apache.org/jira/browse/KAFKA-6978 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-05-31 Thread Florian Hussonnois
Hi , Thank you very much for your feedback. 1/ I agree that overloading most of the methods with a Processed is not ideal. I've started modifying the KStream API and I got to the same conclusion. Also ading a new method directly to KStreamImpl and KTableImpl classes seems to be a better option. H

[jira] [Created] (KAFKA-6977) Unexpected error code 2 while fetching data

2018-05-31 Thread Eugen Feller (JIRA)
Eugen Feller created KAFKA-6977: --- Summary: Unexpected error code 2 while fetching data Key: KAFKA-6977 URL: https://issues.apache.org/jira/browse/KAFKA-6977 Project: Kafka Issue Type: Bug

REMINDER: Apache EU Roadshow 2018 in Berlin is less than 2 weeks away!

2018-05-31 Thread sharan
Hello Apache Supporters and Enthusiasts This is a reminder that our Apache EU Roadshow in Berlin is less than two weeks away and we need your help to spread the word. Please let your work colleagues, friends and anyone interested in any attending know about our Apache EU Roadshow event. We h

[jira] [Resolved] (KAFKA-6666) OffsetOutOfRangeException: Replica Thread Stopped Resulting in Underreplicated Partitions

2018-05-31 Thread Srinivas Dhruvakumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Dhruvakumar resolved KAFKA-. - Resolution: Fixed As part of the fix of https://issues.apache.org/jira/browse/KAF

[DISCUSS] KIP-301 Schema Inferencing in JsonConverters

2018-05-31 Thread Andrew Otto
Hiya, I’m late to this thread, and was just referred to the KIP from the confluent mailing list. Nice idea! I like the idea of being able to provide a Schema fallback for JsonConverter. Perhaps an interface that could return the schema given the JsonNode?For my use case, I have JSONSchemas r

[jira] [Created] (KAFKA-6976) Kafka Streams instances going in to DEAD state

2018-05-31 Thread Deepak Goyal (JIRA)
Deepak Goyal created KAFKA-6976: --- Summary: Kafka Streams instances going in to DEAD state Key: KAFKA-6976 URL: https://issues.apache.org/jira/browse/KAFKA-6976 Project: Kafka Issue Type: New Fe

[jira] [Created] (KAFKA-6975) AdminClient.deleteRecords() may cause replicas unable to fetch from beginning

2018-05-31 Thread Anna Povzner (JIRA)
Anna Povzner created KAFKA-6975: --- Summary: AdminClient.deleteRecords() may cause replicas unable to fetch from beginning Key: KAFKA-6975 URL: https://issues.apache.org/jira/browse/KAFKA-6975 Project: Ka

[jira] [Created] (KAFKA-6974) Changes the interaction between request handler threads and fetcher threads into an ASYNC model

2018-05-31 Thread Lucas Wang (JIRA)
Lucas Wang created KAFKA-6974: - Summary: Changes the interaction between request handler threads and fetcher threads into an ASYNC model Key: KAFKA-6974 URL: https://issues.apache.org/jira/browse/KAFKA-6974

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-05-31 Thread Damian Guy
Hi Florian, Thanks for the KIP. What about KTable and other DSL interfaces? Will they not want to be able to do the same thing? It would be good to see a complete set of the public API changes. Cheers, Damian On Wed, 30 May 2018 at 19:45 Guozhang Wang wrote: > Hello Florian, > > Thanks for the

Re: referencing OffsetCheckpoint in downstream project

2018-05-31 Thread Ted Yu
Thanks for the reply. It seems the following class in newer release can do what the test needs: class OffsetCheckpointFile(val file: File, logDirFailureChannel: LogDirFailureChannel = null) { Cheers On Thu, May 31, 2018 at 9:27 AM, Ismael Juma wrote: > Hi Ted, > > There are two such classes.

Re: [VOTE] KIP-275 - Indicate "isClosing" in the SinkTaskContext

2018-05-31 Thread Matt Farmer
Bumping this again as it's been languishing for a few weeks. Would love to get further feedback (or know for sure that this won't happen). On Mon, May 14, 2018 at 3:48 PM, Matt Farmer wrote: > Bumping this thread. > > For anyone who needs a refresher the discussion thread is here: > http://mail-

Re: referencing OffsetCheckpoint in downstream project

2018-05-31 Thread Ismael Juma
Hi Ted, There are two such classes. The example you have is for the broker class, not the Streams one. Ismael On Thu, 31 May 2018, 09:03 Ted Yu, wrote: > Hi, > OffsetCheckpoint has been relocated > to org.apache.kafka.streams.state.internals package. > > Does this mean that downstream project

referencing OffsetCheckpoint in downstream project

2018-05-31 Thread Ted Yu
Hi, OffsetCheckpoint has been relocated to org.apache.kafka.streams.state.internals package. Does this mean that downstream project should no longer reference this class ? This is how the class is used (against Kafka 0.10.0.1 release) : // ensure that topic is removed from all cleaner offset

Re: [DISCUSS] Why don't support web UI

2018-05-31 Thread Rahul Singh
My opinions why: There are open source Web UIs available. Kafka Manager being one of them. Kafka is also a fairly new product. Even slightly mature products like Cassandra (which I’m also on the dev list for) focus on core features instead of user interfaces because there 100s is ways to take t

Jenkins build is back to normal : kafka-trunk-jdk8 #2687

2018-05-31 Thread Apache Jenkins Server
See

Re: Need help

2018-05-31 Thread Rahul Singh
This is probably better for the User list. The Dev group is for discussing Kafka Development not Kafka use cases. Also : 1. Did you mean to send a confidential email to this public list? 2. Did you search for anything on Google already and did you have trouble doing this on your own? 3. What da