[ https://issues.apache.org/jira/browse/COMDEV-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049300#comment-17049300 ]
Aniket Ray commented on COMDEV-360: ----------------------------------- Hello, I'm Aniket Ray. I would like to contribute to this task under GSOC-2020. It would be a headstart for me if anyone directs me on how to proceed with the task. Thank You > RocketMQ Connect Hive > --------------------- > > Key: COMDEV-360 > URL: https://issues.apache.org/jira/browse/COMDEV-360 > Project: Community Development > Issue Type: Wish > Components: GSoC/Mentoring ideas > Reporter: duheng > Priority: Major > Labels: RocketMQ, gsoc2020 > > h3. Content > The Hive sink connector allows you to export data from Apache RocketMQ topics > to HDFS files in a variety of formats and integrates with Hive to make data > immediately available for querying with HiveQL. The connector periodically > polls data from RocketMQ and writes them to HDFS. > The data from each RocketMQ topic is partitioned by the provided partitioner > and divided into chunks. Each chunk of data is represented as an HDFS file > with topic, queueName, start and end offsets of this data chunk in the > filename. > So, in this project, you need to implement a Hive sink connector based on > OpenMessaging connect API, and run it on RocketMQ connect runtime. > You should learn before applying for this topic > Hive/Apache RocketMQ/Apache RocketMQ Connect/ OpenMessaging Connect API > h3. Mentor > [chenguangsh...@apache.org|mailto:chenguangsh...@apache.org], > [vongosl...@apache.org|mailto:vongosl...@apache.org] -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org