Hi Sean, thanks for the answer. I tried to call repartition() on the input with many different sizes and it still continues to show that warning message.
On Tue, Apr 21, 2015 at 7:05 AM, Sean Owen <so...@cloudera.com> wrote: > I think maybe you need more partitions in your input, which might make > for smaller tasks? > > On Tue, Apr 21, 2015 at 2:56 AM, Christian S. Perone > <christian.per...@gmail.com> wrote: > > I keep seeing these warnings when using trainImplicit: > > > > WARN TaskSetManager: Stage 246 contains a task of very large size (208 > KB). > > The maximum recommended task size is 100 KB. > > > > And then the task size starts to increase. Is this a known issue ? > > > > Thanks ! > > > > -- > > Blog | Github | Twitter > > "Forgive, O Lord, my little jokes on Thee, and I'll forgive Thy great big > > joke on me." > -- Blog <http://blog.christianperone.com> | Github <https://github.com/perone> | Twitter <https://twitter.com/tarantulae> "Forgive, O Lord, my little jokes on Thee, and I'll forgive Thy great big joke on me."
