On Tue, Mar 2, 2010 at 2:43 PM, Liaw, Andy <andy_l...@merck.com> wrote:
> In most implementations of boosting, and for that matter, single tree,
> the first variable wins when there are ties.

They must be in a union :-)

>> What happens if there's a third?

If they were P perfectly correlated predictors, the importance would
would be 100% for the first one encountered by gbm. In reality, where
the correlation is strong but not perfect, the other variables would
show up with small importances. In the case of RF, the "dilution
factor" is 1/P for perfect correlations and gets fuzzier as the
correlation decreases (for reasons that Andy articulated).

-- 

Max

______________________________________________
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.

Reply via email to