Hi, I have checked out the trunk code and tried to use Mirror Maker. When I enabled the csv reporter in Mirror Maker consumer config (—consumer.config=c1.properties)
kafka.metrics.polling.interval.secs=5 kafka.metrics.reporters=kafka.metrics.KafkaCSVMetricsReporter kafka.csv.metrics.dir=/var/log/kafka/csv_metrics kafka.csv.metrics.reporter.enabled=true and got following exception in the log: [2015-02-03 05:50:30,869] WARN Property kafka.csv.metrics.dir is not valid (kafka.utils.VerifiableProperties) [2015-02-03 05:50:30,870] WARN Property kafka.csv.metrics.reporter.enabled is not valid (kafka.utils.VerifiableProperties) [2015-02-03 05:50:30,870] WARN Property kafka.metrics.polling.interval.secs is not valid (kafka.utils.VerifiableProperties) [2015-02-03 05:50:30,870] WARN Property kafka.metrics.reporters is not valid (kafka.utils.VerifiableProperties) [2015-02-03 05:50:31,036] WARN The configuration compression.codec = null was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [2015-02-03 05:50:31,036] WARN The configuration serializer.class = null was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [2015-02-03 05:50:31,036] WARN The configuration producer.type = null was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) java.io.IOException: Unable to create /var/log/kafka/csv_metrics/BytesPerSec.csv at com.yammer.metrics.reporting.CsvReporter.createStreamForMetric(CsvReporter.java:141) at com.yammer.metrics.reporting.CsvReporter.getPrintStream(CsvReporter.java:257) at com.yammer.metrics.reporting.CsvReporter.access$000(CsvReporter.java:22) at com.yammer.metrics.reporting.CsvReporter$1.getStream(CsvReporter.java:156) at com.yammer.metrics.reporting.CsvReporter.processMeter(CsvReporter.java:173) at com.yammer.metrics.reporting.CsvReporter.processMeter(CsvReporter.java:22) at com.yammer.metrics.core.Meter.processWith(Meter.java:131) at com.yammer.metrics.reporting.CsvReporter.run(CsvReporter.java:163) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) It shows that unable to create BytesPerSec.csv, but when the process should have write access to metrics folder. Any tips will be appreciated. Thanks
