Re: Need help in kafka hdfs connector

Try this : https://github.com/pinterest/secor On Thu, Mar 29, 2018 at 2:36 PM, Santosh Kumar J P < santoshkumar...@gmail.com> wrote: > Hi, > > Do we have any other Kafka HDFS connectors implementation other than > Confluent HDFS connector. > > Thank you, > Regards, > Santosh >

Need help in kafka hdfs connector

Hi, Do we have any other Kafka HDFS connectors implementation other than Confluent HDFS connector. Thank you, Regards, Santosh

Re: ORC plugin for Kafka HDFS connector

>> It wants to extract Avro schema from ORC record. Should say: It wants to extract connect schema from ORC record. On Thu, Mar 23, 2017 at 11:14 PM, Manoj Murumkar wrote: > Hi, > > I am developing a connector to support ORC data type in HDFS connector. > Everything is in place except for hive

ORC plugin for Kafka HDFS connector

Hi, I am developing a connector to support ORC data type in HDFS connector. Everything is in place except for hive integration. Specifically, in the SchemaFileReader implementation. It wants to extract Avro schema from ORC record. However, I am unable to get record name from ORC record in order to

Re: Reg: Kafka HDFS Connector with (HDFS SSL enabled)

Hi Colin, I have configured SSL in HDFS and used SWebHDFS. I am able to make it work with Kafka HDFS Connector. Thanks, Bharat On Fri, Feb 17, 2017 at 1:47 PM, Colin McCabe wrote: > Hi, > > Just to be clear, HDFS doesn't use HTTP or HTTPS as its primary > transport mechanis

Re: Reg: Kafka HDFS Connector with (HDFS SSL enabled)

SL configuration, so want to confirm will the Kafka HDFS > Connector works with HDFS (SSL enabled)? > > Could you please provide any information on this. > > > Thanks

Reg: Kafka HDFS Connector with (HDFS SSL enabled)

seen SSL configuration, so want to confirm will the Kafka HDFS Connector works with HDFS (SSL enabled)? Could you please provide any information on this. Thanks

Re: Kafka HDFS Connector

gt; > Dave Tauzell | Senior Software Engineer | Surescripts > > O: 651.855.3042 | www.surescripts.com | dave.tauz...@surescripts.com > > Connect with us: Twitter I LinkedIn I Facebook I YouTube > > > > > > -Original Message- > > From: Pariksheet Bar

Re: Kafka HDFS Connector

ipts.com | dave.tauz...@surescripts.com > Connect with us: Twitter I LinkedIn I Facebook I YouTube > > > -Original Message- > From: Pariksheet Barapatre [mailto:pari.data...@gmail.com] > Sent: Wednesday, June 22, 2016 11:49 AM > To: users@kafka.apache.org > C

RE: Kafka HDFS Connector

afka.apache.org Subject: Re: Kafka HDFS Connector Hi Dustin, I am looking for option 1. Looking at Kafka Connect code, I guess we need to write converter code if not available. Thanks in advance. Regards Pari On 22 June 2016 at 18:50, Dustin Cote wrote: > Hi Pari, > > Can you clarif

Re: Kafka HDFS Connector

You can use Storm also, Here you have the option of rotating > the > > > file. You can also write to Hive directly. > > > > > > Best regards / Mit freundlichen Grüßen / Sincères salutations > > > M. Lohith Samaga > > > > > > > > &g

Re: Kafka HDFS Connector

gt; > file. You can also write to Hive directly. > > > > Best regards / Mit freundlichen Grüßen / Sincères salutations > > M. Lohith Samaga > > > > > > > > > > -Original Message- > > From: Mudit Kumar [mailto:mudit.ku...@askme.in]

Re: Kafka HDFS Connector

res salutations > M. Lohith Samaga > > > > > -Original Message- > From: Mudit Kumar [mailto:mudit.ku...@askme.in] > Sent: Wednesday, June 22, 2016 12.32 > To: users@kafka.apache.org; d...@kafka.apache.org > Subject: Re: Kafka HDFS Connector > > I think you c

RE: Kafka HDFS Connector

, June 22, 2016 12.32 To: users@kafka.apache.org; d...@kafka.apache.org Subject: Re: Kafka HDFS Connector I think you can use flume also. Thanks, Mudit On 6/22/16, 12:29 PM, "Pariksheet Barapatre" wrote: >Anybody have any idea on this? > >Thanks >Pari > >On 20 Ju

Re: Kafka HDFS Connector

I think you can use flume also. Thanks, Mudit On 6/22/16, 12:29 PM, "Pariksheet Barapatre" wrote: >Anybody have any idea on this? > >Thanks >Pari > >On 20 June 2016 at 14:36, Pariksheet Barapatre >wrote: > >> Hello All, >> >> I have data coming from sensors into kafka cluster in text format

Re: Kafka HDFS Connector

Anybody have any idea on this? Thanks Pari On 20 June 2016 at 14:36, Pariksheet Barapatre wrote: > Hello All, > > I have data coming from sensors into kafka cluster in text format > delimited by comma. > > How to offload this data to Hive periodically from Kafka. I guess, Kafka > Connect should

Kafka HDFS Connector

Hello All, I have data coming from sensors into kafka cluster in text format delimited by comma. How to offload this data to Hive periodically from Kafka. I guess, Kafka Connect should solve my problem but when I checked documentation, examples have only avro formatted data. Can you please provid

Bucket records based on time(kafka-hdfs-connector)

Hi kafka gurus, This might sound a little off the track, but I don't know where else to go. I tried the Confluent google group but it seems to be quite unresponsive/inactive. Please bear with me. Many thanks in advance! I am trying to copy data from Kafka into Hive tables using kafka