Re: MLlib - Collaborative Filtering - trainImplicit task size

2015-04-23 Thread Christian S. Perone
> > On Tue, Apr 21, 2015 at 10:36 AM, Christian S. Perone > wrote: > > Hi Sean, thanks for the answer. I tried to call repartition() on the > input > > with many different sizes and it still continues to show that warning > > message. > > > > On Tue, Apr 21

Re: MLlib - Collaborative Filtering - trainImplicit task size

2015-04-21 Thread Christian S. Perone
maller tasks? > > On Tue, Apr 21, 2015 at 2:56 AM, Christian S. Perone > wrote: > > I keep seeing these warnings when using trainImplicit: > > > > WARN TaskSetManager: Stage 246 contains a task of very large size (208 > KB). > > The maximum recommended task size

MLlib - Collaborative Filtering - trainImplicit task size

2015-04-20 Thread Christian S. Perone
I keep seeing these warnings when using trainImplicit: WARN TaskSetManager: Stage 246 contains a task of very large size (208 KB). The maximum recommended task size is 100 KB. And then the task size starts to increase. Is this a known issue ? Thanks ! -- Blog

Re: MLlib -Collaborative Filtering

2015-04-19 Thread Christian S. Perone
The easiest way to do that is to use a similarity metric between the different user factors. On Sat, Apr 18, 2015 at 7:49 AM, riginos wrote: > Is there any way that i can see the similarity table of 2 users in that > algorithm? by that i mean the similarity between 2 users > > > > -- > View this