See https://blogs.apache.org/infra/entry/github_pull_request_builds_now - you can now set up jobs on builds.apache.org that'll listen for pull requests on github.com/apache repos, builds those pull requests, and then comments on the pull request with the build result. Have fun!
A.
