Hi Fellow Spark developers/ PMC Members, I am a new member of the community and have started my tiny contributions to Spark-Kinesis Integration. I am trying to fill in the gaps in making spark operate with Kinesis as nicely as Kafka.
I am writing this mail to highlight an issue with the kinesis module in the Spark external modules [1]. I've started working on the improvements since April 2017 [2]. The PR's take a long time getting reviewed, and since its a small module we do not have enough committers with knowledge of the working of the module. Currently its only 2 people @budde <https://github.com/budde> @brkyvz <https://github.com/brkyvz> who are able to help me out with the PR's, @brkyvz being the only committer. I would request adding more committers to the module and we can have more and frequent iterations on the PR's. I believe @budde has a great knowledge of the internals of the module and would make a good fit for the role. Meanwhile I would start reviewing more PR's on this module to help out other contributors. I understand that this coming from a new contributor might sound silly but I felt this problem should be highlighted. Best Regards, Yash 1. https://github.com/yssharma/spark/tree/cef5cdece2bd2a7c95e19493c511d602c1b46461/external/kinesis-asl 2. http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-Kinesis-integration-needs-improvements-td21272.html