Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/468#issuecomment-42113320
@srowen YARN version does need to be separate from hadoop version.
Downstream consumers of our build sometimes do this. For instance, if they want
to build against a custom HDFS distro (e.g. pivotal, IBM, or something) but
want to link against the upstream apache YARN repo. It's not something we do in
binaries we distribute but it would be good to support it.
Think it's fine to remove hadoop.major.version - it seems unused.
Adding fancy profile activation would also be nice, but I think that it's
not necessary as an immediate fix. We can just say in the build doc that "you
need special profiles for the following hadoop versions" and give a small table
or list explaining which profiles to activate.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
