Dear Apache Spark Community, My name is *Surafel Temesgen*, and I’m excited to introduce a project I’ve been developing called *Debo* — a lightweight, unified infrastructure management platform designed to monitor and control key components of the Hadoop and big data ecosystem, including *Apache Spark*. ------------------------------ 💡 What is Debo?
*Debo* is a *desktop-based*, open-source tool (written in C) that offers *real-time visibility* and *basic operational control* over numerous services in the modern data stack. It currently supports: - *HDFS, YARN, Hive, Kafka* - *Flink, Spark, Zookeeper, HBase* - *Atlas, Ranger, Tez, Presto, Phoenix, Hue*, and others Debo’s goal is to simplify the management of complex distributed systems by providing a *unified CLI and GUI dashboard* that lets administrators and developers easily monitor and interact with all integrated services — including Apache Spark. ------------------------------ 📣 Incubator Proposal & Feedback Request Debo has been proposed to the *Apache Incubator* and is currently seeking *3 PMC sponsors*. You're invited to view and join the discussion here: 🔗 https://lists.apache.org/thread/bp0rqvf4xvmdb3n1m2fzhwym95841s5v While Debo is not yet officially incubated, a *beta version* is set to be released soon — featuring improved documentation and *enhanced Spark monitoring and control capabilities*. ------------------------------ 🙏 Call for Feedback from the Spark Community If you are a contributor or user of Apache Spark, I would greatly appreciate your insights on: - Ways to enhance Debo’s Spark integration (e.g., job tracking, executor health, memory usage) - Operational pain points Debo could help address in managing Spark applications - Ideas for Spark-specific features like stage visualization, live job logs, or structured streaming metrics ------------------------------ 📺 Learn More You can follow our updates and tutorials on our YouTube channel: 👉 https://www.youtube.com/@Debo_teamwork And explore the source code and roadmap on GitHub: 🛠️ https://github.com/Debo-et/debo-teamwork ------------------------------ 🔧 Coming Soon - Updated README.md with detailed setup and usage guides - Step-by-step video tutorials for integrating Debo with Apache Spark - Enhanced support for Spark driver/executor metrics, DAG views, and streaming job monitoring ------------------------------ Thank you for your time and interest. I’m genuinely looking forward to any feedback, ideas, or suggestions from the Spark community—together, we can make big data operations more transparent and efficient. Warm regards, *Surafel Temesgen* 🔗 https://github.com/Debo-et/debo-teamwork
