Re: offset.storage.filename configuration in kafka-connect-hdfs

2017-04-09 Thread Ewen Cheslack-Postava
The offset file is marked as required so we can fail early & fast, but if you only run sink connectors then offsets will be stored in Kafka's normal offsets topic and the file will never need to be created. (And the HDFS connector is even more unusual in that it doesn't even rely on Kafka offsets b

offset.storage.filename configuration in kafka-connect-hdfs

2017-03-08 Thread FEI Aggie
Hi, I'm running kafka-connect-hdfs 3.1.1. offset.storage.filename is a required configuration for standalone connector. But when I set this parameter in worker configuration file for kafka-connect-hdfs with standlone mode: offset.storage.file.filename=/mnt/data/connect.offsets It never works. Th