Kafka data log retention policy for topics

2018-12-12 Thread Parth Gandhi
All, We can set the retention policy for kafka logs from the server.properties which will be applied to all the topic by default. However is there a way to set up the different log retention policy for different topics? Also does kafka record the message in time while storing the message as log?

Re: Kafka data log retention policy for topics

2018-12-12 Thread Harper Henn
You can configure a different retention policy that overrides the global one in server.properties when you create or alter a topic. Here's an example: bin/kafka-topics.sh --create --zookeeper localhost:2181 --topic some-topic --partitions 1 --replication-factor 1 --config retention.ms=17280 O

Kafka Trunk Build Failure with Gradle 5.0

2018-12-12 Thread Boyang Chen
Hey friends, I'm wondering anyone has seen this error before: Could not find method annotationProcessor() for arguments [org.openjdk.jmh:jmh-generator-annprocess:1.21] on object of type org.gradle.api.internal.artifacts.dsl.dependencies.DefaultDependencyHandler. Basically I'm building the trun

#Getting null values in kafka while pushing data from nodejs

2018-12-12 Thread Satendra Pratap Singh
Hi All, I am pushing data from nodejs server to kafka topic when i consume this topic getting null values. i have checked javascript producer its working fine and send data Json data to kafka. any help would be appreciated. i have posted my producer code here. var kafka = require('kafka-node'); v