On 6 Oct 2015, at 01:23, Andrew Or <[email protected]<mailto:[email protected]>> wrote:
Both the history server and the shuffle service are backward compatible, but not forward compatible. This means as long as you have the latest version of history server / shuffle service running in your cluster then you're fine (you don't need multiple of them). FWIW I've just created a JIRA on tracking/reporting version mismatch on history server playback better: https://issues.apache.org/jira/browse/SPARK-10950 Even though the UI can't be expected to playback later histories, it could be possible to report the issue in a way that users can act on "run a later version", rather than raise support calls.
