[ https://issues.apache.org/jira/browse/KAFKA-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352237#comment-14352237 ]
Neha Narkhede commented on KAFKA-2004: -------------------------------------- Kafka uses local storage for latency and replication guarantees. Though of the popular ways of copying data from Kafka into HDFS is Camus. You can take a look at that here - http://confluent.io/docs/current/camus/docs/index.html. Is there anything in particular you are looking for with the Storm/Spark streaming approach? > Write Kafka messages directly to HDFS > ------------------------------------- > > Key: KAFKA-2004 > URL: https://issues.apache.org/jira/browse/KAFKA-2004 > Project: Kafka > Issue Type: Bug > Components: consumer, core, producer > Affects Versions: 0.8.1.1 > Reporter: sutanu das > Assignee: Neha Narkhede > Priority: Critical > > 1. Is there a way to write Kafka messages directly to HDFS without writing > any consumer code? > 2. Is there anyway to integrate Kafka with Storm or Spark so messages goes > directly from Kafka consumers to HDFS sync? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
