Re: how idf is calculated

2014-10-31 Thread Sean Owen
Yes, here the base doesn't matter as it just multiplies all results by a constant factor. Math libraries tend to have ln, not log10 or log2. ln is often the more, er, natural base for several computations. So I would assume that log = ln in the context of ML. On Fri, Oct 31, 2014 at 11:31 AM, Andr

Re: how idf is calculated

2014-10-31 Thread Andrejs Abele
ains 1. > > In other words, my calculations don't agree with yours, and neither seem > to agree with Spark :) > > Regards, > Ashic. > > -- > Date: Thu, 30 Oct 2014 22:13:49 + > Subject: how idf is calculated > From: andr...@sindic

RE: how idf is calculated

2014-10-30 Thread Ashic Mahtab
= 0.5 + {(0.5*fij)/maxk fkj}, but that doesn't change anything for TFa1, as the value remains 1. In other words, my calculations don't agree with yours, and neither seem to agree with Spark :) Regards,Ashic. Date: Thu, 30 Oct 2014 22:13:49 +0000 Subject: how idf is calculated From: andr...@

how idf is calculated

2014-10-30 Thread Andrejs Abele
Hi, I'm writing a paper and I need to calculate tf-idf. Whit your help I managed to get results, I needed, but the problem is that I need to be able to explain how each number was gotten. So I tried to understand how idf was calculated and the numbers i get don't correspond to those I should get .