andygrove opened a new pull request, #3557: URL: https://github.com/apache/datafusion-comet/pull/3557
## Summary - Adds a GitHub bot (`cometbot`) that monitors PR comments for slash commands (`/run tpch`, `/run micro`, `/help`) and automatically runs benchmarks in Kubernetes, posting results back as PR comments - Includes a Click CLI for manual benchmark runs, Docker image build/push, K8s job management, and deployment tooling - Adds contributor guide documentation explaining how to trigger benchmarks and how the bot works ## Details The bot lives in `dev/benchmarking-bot/` and includes: - **Bot** (`src/cometbot/bot.py`): Polls GitHub for slash commands on open Comet PRs - **K8s** (`src/cometbot/k8s.py`): Builds Docker images, creates/manages Kubernetes jobs - **CLI** (`src/cometbot/cli.py`): Click-based CLI for manual benchmark runs and bot management - **Dockerfile**: Container with JDK 17, Rust, Maven, and Spark 3.5 for running benchmarks - **K8s templates** (`k8s/`): Job and deployment manifests - **Deploy script** (`deploy/deploy.sh`): Automated deployment to a remote host via SSH All configuration is via `COMETBOT_*` environment variables (registry, GitHub token, deploy host, etc.). ## Test plan - [ ] `cd dev/benchmarking-bot && pip install -e .` - [ ] `cometbot --help` shows comet + bot commands - [ ] `cometbot comet --help` shows build/run/status/logs/delete - [ ] Deploy to a K8s host and run `/run tpch` on a test PR - [ ] Verify results are posted back as a PR comment 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
