Tao and Gaurav,
After looking through the source code in Kafka v8.2.0, I don't see any
partition() function on the MessageAndMetadata object. Here's the class's
source:
package kafka.message
import kafka.serializer.Decoder
import kafka.utils.Utils
case class MessageAndMetadata[K, V](topic: String, partition: Int,
private val rawMessage: Message,
offset: Long,
keyDecoder: Decoder[K],
valueDecoder: Decoder[V]) {
/**
* Return the decoded message key and payload
*/
def key(): K = if(rawMessage.key == null) null.asInstanceOf[K] else
keyDecoder.fromBytes(Utils.readBytes(rawMessage.key))
def message(): V = if(rawMessage.isNull) null.asInstanceOf[V] else
valueDecoder.fromBytes(Utils.readBytes(rawMessage.payload))
-Alex M.
On Thu, Feb 26, 2015 at 9:54 PM, Gaurav Agarwal <gaurav130...@gmail.com>
wrote:
> that's fine to me , you can open a separate thread , But the original
> question when the consumerconnector got connected to a separate topic ,
> Whether KafkaStream will have all the information of the partitions for
> that corresponding topic , Please confirm
>
> Thanks
>
> On Fri, Feb 27, 2015 at 11:20 AM, Alex Melville <amelvi...@g.hmc.edu>
> wrote:
>
> > I was going to make a separate email thread for this question but this
> > thread's topic echoes what my own would have been.
> >
> >
> > How can I query a broker or zookeeper for the number of partitions in a
> > given topic? I'm trying to write a custom partitioner that sends a
> message
> > to every partition within a topic, and so I need to know the total number
> > of partitions before I call Producer.send().
> >
> >
> > Alex
> >
> > On Thu, Feb 26, 2015 at 7:32 PM, tao xiao <xiaotao...@gmail.com> wrote:
> >
> > > Gaurav,
> > >
> > > You can get the partition number the message belongs to via
> > > MessageAndMetadata.partition()
> > >
> > > On Fri, Feb 27, 2015 at 5:16 AM, Jun Rao <j...@confluent.io> wrote:
> > >
> > > > The partition api is exposed to the consumer in 0.8.2.
> > > >
> > > > Thanks,
> > > >
> > > > Jun
> > > >
> > > > On Thu, Feb 26, 2015 at 10:53 AM, Gaurav Agarwal <
> > gaurav130...@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > After retrieving a kafka stream or kafka message how to get the
> > > > > corresponding partition number to which it belongs ? I am using
> kafka
> > > > > version 0.8.1.
> > > > > More specifically kafka.consumer.KafkaStream and
> > > > > kafka.message.MessageAndMetaData classes, does not provide API to
> > > > retrieve
> > > > > partition number. Are there any other API's to get the partition
> > > number?
> > > > >
> > > > > IF there are multiple partitions of a topic ,Do i need to declare
> > from
> > > > java
> > > > > code how many partitions the topic contains or i can leave it topic
> > > > > Kafkastream will take the partition information from kafka broker
> at
> > > > > runtime.?
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Regards,
> > > Tao
> > >
> >
>
