Re: Consumer group describe issue

2017-12-27 Thread sahil aggarwal
@TedYu >From 0.10.0 @Bill Thanks for the pointer. Will follow the steps mentioned in the doc. On 28 December 2017 at 07:39, Ted Yu wrote: > Which branch was the patch generated from ? > When I tried to apply the patch: > > 6 out of 7 hunks FAILED --

1 to N transformers in Kafka Connect

2017-12-27 Thread Ziliang Chen
Hi, May i ask if it is possible to do 1 kafka record to many Kafka Connect records transformation ? I know we have 1:1 transformation supported in Kafka Connect, but it appears to me there are quite some user cases which requires 1:N transformation Thank you very much ! -- Regards, Zi-Liang Ma

Re: kafka-client throwing IllegalStateException on calling wait

2017-12-27 Thread Ted Yu
Have you seen https://examples.javacodegeeks.com/java-basics/exceptions/java-lang-illegalmonitorstateexception-how-to-solve-illegalmonitorstateexception/ ? You didn't include the whole code w.r.t. shadowKafkaProducer If you need more help, please consider including more of your code. Cheers On W

Re: kafka-client throwing IllegalStateException on calling wait

2017-12-27 Thread Debraj Manna
Anyone any thoughts? On Wed, Dec 27, 2017 at 7:02 PM, Debraj Manna wrote: > Cross-posting from stackoverflow > > > Kafka Client 0.10.0.0 is throwing the below IllegalStateException whenever

Re: Consumer group describe issue

2017-12-27 Thread Ted Yu
Which branch was the patch generated from ? When I tried to apply the patch: 6 out of 7 hunks FAILED -- saving rejects to file core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala.rej FYI On Mon, Dec 25, 2017 at 9:45 PM, sahil aggarwal wrote: > Attached the patch. If someone can review i

Re: Consumer group describe issue

2017-12-27 Thread Bill Bejeck
Sahil, Thanks for the patch. In order to have your patch reviewed, please look over the contribution guidelines outlined here https://kafka.apache.org/contributing Thanks, Bill On Tue, Dec 26, 2017 at 12:45 AM, sahil aggarwal wrote: > Attached the patch. If someone can review it will be very

log.deleted

2017-12-27 Thread Wim Van Leuven
Hello, When Kafka evicts a segment, it renames the files by appending .deleted. In configuration you can also specify how long to keep these files laying around. What's the actual use of keeping the .delete files around? Can you 'restore' the deleted data from these files after e.g. incrementing

Re: Kafka Streams - max.poll.interval.ms defaults to Integer.MAX_VALUE

2017-12-27 Thread Matthias J. Sax
It would -- however, this is not an issue for KafkaStreams as we make sure the thread is either still alive or properly shut down. Thus, if an error happens and the thread really dies, KafkaStreams ensures that the heartbeat thread is stopped and thus, a rebalance would not block forever as it drop

Fw: Number of Processes Kafka Server spawns

2017-12-27 Thread Sven Ludwig
Answering myself: Kafka Server spawns only 1 process. htop by default also shows threads, which was misleading. It can be turned off by pressing H https://unix.stackexchange.com/questions/10362/why-does-htop-show-more-process-than-ps Regards, Sven   Gesendet: Mittwoch, 27. Dezember 2017 um 16

Number of Processes Kafka Server spawns

2017-12-27 Thread Sven Ludwig
Hi, does Kafka ever launch processes in addition to the Kafka server process? I have a setup with CentOS plus Docker plus Kafka Server container based on the image of Confluent Platform 4.0.0 In ps -Alf there is only one Kafka process, but in htop I can see many. Regards, Sven

RE: Kafka Streams - max.poll.interval.ms defaults to Integer.MAX_VALUE

2017-12-27 Thread Javier Holguera
Hi Matthias, Thanks for your answer. It makes a lot of sense. Just a follow-up question. KIP-62 says: "we give the client as much as max.poll.interval.ms to handle a batch of records, this is also the maximum time before a consumer can be expected to rejoin the group in the worst case". Does i

kafka-client throwing IllegalStateException on calling wait

2017-12-27 Thread Debraj Manna
Cross-posting from stackoverflow Kafka Client 0.10.0.0 is throwing the below IllegalStateException whenever I am calling wait() ERROR [2017-12-27 09:55:48] c.v.g.u.UploadHandler:[?:?:?] - [d