Kafka Connect Hdfs Sink not sinking

2016-10-28 Thread Henry Kim
converter.schemas.enable=false internal.value.converter.schemas.enable=false # Local storage file for offset data offset.storage.file.filename=/tmp/connect.offsets - Henry Kim

Re: Kafka Connect Hdfs Sink not sinking

2016-11-02 Thread Henry Kim
n Fri, Oct 28, 2016 at 8:14 AM, Henry Kim wrote: > Hi, > > > I'm was attempting to follow the hdfs-connector quick start guide ( > http://docs.confluent.io/3.0.0/connect/connect-hdfs/docs/ > hdfs_connector.html#quickstart), but I'm unable to consume messages using &g

HDFS Connector Compression?

2016-11-02 Thread Henry Kim
Is it possible to add compression to the HDFS Connector out of the box? Or does it require code change? Thanks Henry Kim

Re: HDFS Connector Compression?

2016-11-07 Thread Henry Kim
nCodecName = CompressionCodecName.SNAPPY; final ParquetWriter writer = new AvroParquetWriter<>(path, avroSchema, compressionCodecName, blockSize, pageSize); ________ From: Henry Kim Sent: Wednesday, November 2, 2016 2:46:27 PM To: users@kafka.apache.org Subject