Hi DB,
I found a piece of code that uses znorm to normalize data.
/**
* build training data set from sample and summary data
*/
val train_data = sample_data.map( v =>
Array.tabulate[Double](field_cnt)(
i => zscore(v._2(i),sample_mean(i),sample_stddev(i))
)
).cache
Please make your comments if you find something wrong.
BR,
Aslan
On Thu, Jun 12, 2014 at 11:13 AM, Aslan Bekirov <[email protected]>
wrote:
> Thanks a lot DB.
>
> I will try to do Znorm normalization using map transformation.
>
>
> BR,
> Aslan
>
>
> On Thu, Jun 12, 2014 at 12:16 AM, DB Tsai <[email protected]> wrote:
>
>> Hi Aslan,
>>
>> Currently, we don't have the utility function to do so. However, you
>> can easily implement this by another map transformation. I'm working
>> on this feature now, and there will be couple different available
>> normalization option users can chose.
>>
>> Sincerely,
>>
>> DB Tsai
>> -------------------------------------------------------
>> My Blog: https://www.dbtsai.com
>> LinkedIn: https://www.linkedin.com/in/dbtsai
>>
>>
>> On Wed, Jun 11, 2014 at 6:25 AM, Aslan Bekirov <[email protected]>
>> wrote:
>> > Hi All,
>> >
>> > I have to normalize a set of values in the range 0-500 to the [0-1]
>> range.
>> >
>> > Is there any util method in MLBase to normalize large set of data?
>> >
>> > BR,
>> > Aslan
>>
>
>
