Re: [R] statistical significance of accuracy increase in classification

Thanks. I will surely try this as well. Monica > Date: Thu, 26 Feb 2009 08:14:31 -0500 > Subject: Re: [R] statistical significance of accuracy increase in > classification > From: mxk...@gmail.com > To: pisican...@hotmail.com > CC: r-help@r-project.org > > >

Re: [R] statistical significance of accuracy increase in classification

Hi Stefan, Thanks so much. This will help me i am sure. These past 2 days i was away on a trip so please excuse my delayed answer. Monica > From: stefan.ev...@uos.de > To: pisican...@hotmail.com > Subject: Re: [R] statistical significance of accuracy increase in > cl

Re: [R] statistical significance of accuracy increase in classification

On 26 Feb 2009, at 14:14, Max Kuhn wrote: Do you know about any good reference that discusses kappa for classification and maybe CI for kappa??? You might also want to take a look at this survey article on kappa and its alternatives: Artstein, Ron and Poesio, Massimo (2008). Survey arti

Re: [R] statistical significance of accuracy increase in classification

> Do you know about any good reference that discusses kappa for classification > and maybe CI for kappa??? I don't, but googling on kappa and confusion matrix etc should get you there. Kappa works very well when the true classes are skewed. For example, if 10% of you samples are class A and 90% c

Re: [R] statistical significance of accuracy increase in classification

prove that this gives unacceptable results. Do you know about any good reference that discusses kappa for classification and maybe CI for kappa??? Thanks again for your input, Monica > Date: Wed, 25 Feb 2009 09:01:23 -0500 > Subject: Re: [R] statistical significance of accuracy in

Re: [R] statistical significance of accuracy increase in classification

Monica, I have a few thoughts. - (I believe) it is usually better to put confidence in these metrics instead of relying on p-values. The intervals will allow you to make inferential statements and give you a way of characterizing the uncertainty in the estimates. You've seen how to do this with

Re: [R] statistical significance of accuracy increase in classification

ica > From: pisican...@hotmail.com > To: r-help@r-project.org > CC: max.k...@pfizer.com > Subject: [R] statistical significance of accuracy increase in classification > Date: Tue, 24 Feb 2009 16:22:41 + > > > Hi everyone, > > I would

[R] statistical significance of accuracy increase in classification

Hi everyone, I would like to test for the statistical significance(for what it worth ...) in increasing classification accuracy and kappa statistics from different land classifications. The classifications were done using other software (like eCognition and See5), but the results were "sampled