If you want to know if "kafka" can read hadoop files, then no. But you can write your own producer that reads from hdfs any which way and pushes to kafka. We use kafka as the ingestion pipeline's main queue. Read from various sources and push everything to kafka.
On Tue, Jan 10, 2017 at 6:26 AM, Cas Apanowicz <cas.apanow...@it-horizon.com > wrote: > Hi, > > I have general understanding of main Kafka functionality as a streaming > tool. > However, I'm trying to figure out if I can use Kafka to read Hadoop file. > Can you please advise? > Thanks > > Cas > > -- -- Sharninder
