Hi Yongjun Hong, Thanks for your email and your interest in contributing to StormCrawler. The project is quite mature and there isn't anything that is totally missing from it but there definitely are improvements to be made. Contributions take many forms and not just code: a good starting point would be to run StormCrawler, look at the existing resources and documentation and see if anything is not clear or missing. Reporting bugs or asking questions is also very valuable.
One thing I would like to see however is a new spout implementation for OpenSearch; I had written a description for Elasticsearch a while ago <https://github.com/apache/incubator-stormcrawler/discussions/990> which is valid for OpenSearch and could improve the performance significantly. Probably a bit of an advanced topic though, maybe as a start just run StormCrawler, delve into the details and see what you think? Thanks! Julien On Tue, 21 Jan 2025 at 23:57, 홍용준 <dev.yongj...@gmail.com> wrote: > Dear StormCrawler Team, > > My name is Yongjun Hong, and I am a software developer with a strong > interest in contributing to open-source projects. I have had the privilege > of contributing to JUnit 5 by implementing performance improvements and > adding new features, which allowed me to gain a deeper appreciation for > collaborative development within the open-source community. > > Beyond JUnit, I have also made frequent contributions to other Java-based > open-source libraries, including Spring Boot. My work has focused on > enhancing core functionality and resolving community-reported issues, > aiming to improve both usability and reliability. > > I am particularly drawn to StormCrawler because of its robust and scalable > web crawling capabilities, and I am eager to contribute consistently❕ To > better understand how I can align my efforts with the project’s goals, I > would like to inquire about its current status, overall roadmap, and any > key milestones in the near future. > > If there are areas where the project could use additional support, or if > there are specific tasks or issues you think I could assist with, I would > greatly appreciate your guidance. > > Thank you for your time and for the incredible work you have done on > stormcrawler. I am excited about the possibility of contributing and look > forward to hearing from you. > > Here is my Github profile : https://github.com/YongGoose > > Best regards > > Yongjun Hong >
