I am only assigning this consumer one partition to listen to. Perhaps that is where the issue lies, because the kafka-console-consumer's group id (listening on all partitions) shows up correctly within the kafka-consumer-groups command.
On Thu, Mar 24, 2016 at 6:59 PM, Ryan Phillips <r...@trolocsis.com> wrote: > Greetings, > > I’m attempting to use the New Consumer in my project (0.9.0.1), and it > appears to be working nicely. The issue that I am seeing is that the > group.id is not showing up within: > > kafka-consumer-groups.sh —bootstrap-server > kafka0.local:9092,kafka1.local:9092 —new-consumer —list > > The command loads up, but the consumer that is running is not > displayed. The consumer is clearly processing a massive amount of > messages. I have included the properties used at the end of my > message. > > Thanks, > Ryan > > Properties props = new Properties(); > props.put(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG, "latest"); > props.put(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG, kafkaBrokerSeeds); > props.put(ConsumerConfig.ENABLE_AUTO_COMMIT_CONFIG, "false"); > props.put(ConsumerConfig.GROUP_ID_CONFIG, groupId); > props.put(ConsumerConfig.MAX_PARTITION_FETCH_BYTES_CONFIG, 6 * 1024 * 1024); > props.put(ConsumerConfig.REQUEST_TIMEOUT_MS_CONFIG, 30 * 1000); > props.put(ConsumerConfig.SESSION_TIMEOUT_MS_CONFIG, 15 * 1000); > props.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, > "org.apache.kafka.common.serialization.StringDeserializer"); > props.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, > "org.apache.kafka.common.serialization.ByteArrayDeserializer"); > consumer = new KafkaConsumer<String, byte[]>(props);
