I have started looking into PR-8101 [1] and what is required to merge it into trunk which will also unblock me around SPARK-10521 [2].
So here is the minimal plan I was thinking about : - make the docker image version fixed so we make sure we are using the same image all the time - pull the required images on the Jenkins executors so tests are not delayed/timedout because it is waiting for docker images to download - create a profile to run the JDBC tests - create daily jobs for running the JDBC tests In parallel, I learned that Alan Chin from my team is working with the AmpLab team to expand the build capacity for Spark, so I will use some of the nodes he is preparing to test/run these builds for now. Please let me know if there is anything else needed around this. [1] https://github.com/apache/spark/pull/8101 [2] https://issues.apache.org/jira/browse/SPARK-10521 -- Luciano Resende http://people.apache.org/~lresende http://twitter.com/lresende1975 http://lresende.blogspot.com/
