Re: The purpose of ProducerRecord Headers

2018-06-10 Thread Darion Yaphet
thanks ~ Matthias J. Sax 于2018年6月10日周日 下午3:38写道: > Check out the KIP that added headers: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-82+-+Add+Record+Headers > > -Matthias > > On 6/8/18 8:23 PM, 逐风者的祝福 wrote: > > Hi team: > > When I reading KafkaProducer doSend() and I found eac

Re: Changing the default Kafka data log directory (was Re: What to do when file.rename fails?)

2015-01-29 Thread Darion Yaphet
It's seems a good idea . use /tmp/kafka-log as default dir maybe delete by other people and very unsafe . 2015-01-29 14:26 GMT+08:00 Jaikiran Pai : > I have created a JIRA for this proposed change https://issues.apache.org/ > jira/browse/KAFKA-1906 and uploaded a patch for review > https://review

Re: Number of kafka topics/partitions supported per cluster of n nodes

2015-07-27 Thread Darion Yaphet
Kafka store it meta data in Zookeeper Cluster so evaluate "how many total number of topics and partitions can be created in a cluster " maybe same as to test Zookeeper's expansibility and disk IO performance . 2015-07-28 13:51 GMT+08:00 Prabhjot Bharaj : > Hi, > > I'm looking forward to a bench

Re: Max Message Size

2014-05-14 Thread Darion Yaphet
max.message.bytes This is largest message size Kafka will allow to be appended to this topic. Note that if you increase this size you must also increase your consumer's fetch size so they can fetch messages this large. When the message length is larger than max,message.bytes maybe throw an excep

Re: Monitoring Producers at Large Scale

2014-06-24 Thread Darion Yaphet
Sorry I want to know you want to monitor kafka producers or kafka brokers and zookeepers ? It's seems you will want to monitor monitor Exceptions eg Leader Not Found, Queue is full, resend fail etc are kafka cluster 2014-06-25 8:20 GMT+08:00 Bhavesh Mistry : > We use Kafka as Transport Layer

Re: [jira] [Updated] (KAFKA-1620) Make kafka api protocol implementation public

2014-09-01 Thread Darion Yaphet
I'm curiosity why Kafka don't implementation protocol by protocol buffer or any other tools . It's good to use by other language 2014-09-01 22:48 GMT+08:00 Anton Karamanov (JIRA) : > > [ > https://issues.apache.org/jira/browse/KAFKA-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:

Re: [VOTE] 0.8.2-beta Release Candidate 1

2014-10-24 Thread Darion Yaphet
+1 New Sender is Added ~ 2014-10-25 1:18 GMT+08:00 Neha Narkhede : > +1 (binding) > > Verified the quickstart, docs, unit tests on the source and binary release. > > Thanks, > Neha > > On Fri, Oct 24, 2014 at 9:26 AM, Gwen Shapira > wrote: > > > +1 (non-official community vote). > > > > Kicked t

[jira] [Created] (KAFKA-6908) Update LogDirsCommand's prompt information

2018-05-16 Thread darion yaphet (JIRA)
darion yaphet created KAFKA-6908: Summary: Update LogDirsCommand's prompt information Key: KAFKA-6908 URL: https://issues.apache.org/jira/browse/KAFKA-6908 Project: Kafka Issue

[jira] [Resolved] (KAFKA-6908) Update LogDirsCommand's prompt information

2018-05-16 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet resolved KAFKA-6908. -- Resolution: Won't Fix > Update LogDirsCommand's promp

[jira] [Created] (KAFKA-6930) Update KafkaZkClient debug log

2018-05-22 Thread darion yaphet (JIRA)
darion yaphet created KAFKA-6930: Summary: Update KafkaZkClient debug log Key: KAFKA-6930 URL: https://issues.apache.org/jira/browse/KAFKA-6930 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-6954) Add a new tool to loading data from file

2018-05-26 Thread darion yaphet (JIRA)
darion yaphet created KAFKA-6954: Summary: Add a new tool to loading data from file Key: KAFKA-6954 URL: https://issues.apache.org/jira/browse/KAFKA-6954 Project: Kafka Issue Type: New

[jira] [Created] (KAFKA-7033) Modify AbstractOptions's timeoutMs as Long type

2018-06-11 Thread darion yaphet (JIRA)
darion yaphet created KAFKA-7033: Summary: Modify AbstractOptions's timeoutMs as Long type Key: KAFKA-7033 URL: https://issues.apache.org/jira/browse/KAFKA-7033 Project: Kafka Issue

[jira] [Created] (KAFKA-7034) Remove the duplicated listTopics from Consumer

2018-06-11 Thread darion yaphet (JIRA)
darion yaphet created KAFKA-7034: Summary: Remove the duplicated listTopics from Consumer Key: KAFKA-7034 URL: https://issues.apache.org/jira/browse/KAFKA-7034 Project: Kafka Issue Type

[jira] [Created] (KAFKA-7038) Support AdminClient Example

2018-06-11 Thread darion yaphet (JIRA)
darion yaphet created KAFKA-7038: Summary: Support AdminClient Example Key: KAFKA-7038 URL: https://issues.apache.org/jira/browse/KAFKA-7038 Project: Kafka Issue Type: New Feature

[jira] [Created] (KAFKA-7046) Support new Admin API for single topic

2018-06-12 Thread darion yaphet (JIRA)
darion yaphet created KAFKA-7046: Summary: Support new Admin API for single topic Key: KAFKA-7046 URL: https://issues.apache.org/jira/browse/KAFKA-7046 Project: Kafka Issue Type: New Feature