rmahindra123 commented on a change in pull request #3660: URL: https://github.com/apache/hudi/pull/3660#discussion_r755452612
########## File path: hudi-kafka-connect/README.md ########## @@ -56,30 +50,57 @@ After building the package, we need to install the Apache Kafka ### 1 - Starting the environment -To try out the Connect Sink locally, set up a Kafka broker locally. Download the latest apache kafka from https://kafka.apache.org/downloads. -Once downloaded and built, run the Zookeeper server and Kafka server using the command line tools. +For runtime dependencies, we encourage using the confluent HDFS connector jars. We have tested our setup with version `10.1.0`. +After downloading the connector, copy the jars from the lib folder to the Kafka Connect classpath. ```bash -export KAFKA_HOME=/path/to/kafka_install_dir -cd $KAFKA_KAFKA_HOME -./bin/zookeeper-server-start.sh ./config/zookeeper.properties -./bin/kafka-server-start.sh ./config/server.properties +confluent-hub install confluentinc/kafka-connect-hdfs:10.1.0 +cp confluentinc-kafka-connect-hdfs-10.1.0/lib/*.jars /usr/local/share/java/hudi-kafka-connect/ Review comment: done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
