Re: Github emails

2014-02-24 Thread Aaron Davidson
By the way, we still need to get our JIRAs migrated over to the Apache system. Unrelated, just... saying. On Mon, Feb 24, 2014 at 10:55 PM, Matei Zaharia wrote: > This is probably a snafu because we had a GitHub hook that was sending > messages to d...@spark.incubator.apache.org, and that list w

Re: Github emails

2014-02-24 Thread Matei Zaharia
This is probably a snafu because we had a GitHub hook that was sending messages to d...@spark.incubator.apache.org, and that list was recently moved (or is in the process of being moved?) to dev@spark.apache.org. Unfortunately there’s nothing we can do to change it on our end, but this was origi

Re: Github emails

2014-02-24 Thread OmPrakash Muppirala
On Feb 24, 2014 10:43 PM, "OmPrakash Muppirala" wrote: > Looks like the Apache Spark project is sending Github emails to the > infrastructure-dev mailing list. Can someone please fix this? > > Thanks, > Om >

WARNING: Spark lists moving to spark.apache.org domain name

2014-02-24 Thread Matei Zaharia
Hi everyone, As you may have noticed, our lists are currently in the process of being migrated from @spark.incubator.apache.org domain names to @spark.apache.org, as part of the project becoming a top-level project. Please beware that messages will come to the new lists and you’ll have to adjus

Re: Preparing to provide a small text files input API in mllib

2014-02-24 Thread Mridul Muralidharan
Hi, I have not looked into why this would be needed, but given it is needed, I added a couple of comments to the PR. Overall, it looks promising. Regards, Mridul On Tue, Feb 25, 2014 at 8:05 AM, 尹绪森 wrote: > Hi community, > > As I moving forward to write a LDA (Latent Dirichlet Allocation) t

Re: Kryo docs: do we include twitter/chill by default?

2014-02-24 Thread Mark Hamstra
Chill has been part of Spark releases since 0.8.0-incubating. On Mon, Feb 24, 2014 at 8:59 PM, Andrew Ash wrote: > https://github.com/apache/incubator-spark/pull/647 > > I was going to say in the addition that twitter/chill was new in 0.9.0 but > decided against it since there aren't any other

Re: Kryo docs: do we include twitter/chill by default?

2014-02-24 Thread Andrew Ash
https://github.com/apache/incubator-spark/pull/647 I was going to say in the addition that twitter/chill was new in 0.9.0 but decided against it since there aren't any other references to specific spark versions in the documentation (and I'm not confident that was actually the new version). On M

Re: Kryo docs: do we include twitter/chill by default?

2014-02-24 Thread Reynold Xin
We do include Chill by default. It's a good idea to update the doc to include chill. On Mon, Feb 24, 2014 at 7:55 PM, Andrew Ash wrote: > Spark devs, > > I picked up somewhere that the Spark 0.9.0 release included Twitter's chill > library of default-registered Kryo serialization classes. Is t

Kryo docs: do we include twitter/chill by default?

2014-02-24 Thread Andrew Ash
Spark devs, I picked up somewhere that the Spark 0.9.0 release included Twitter's chill library of default-registered Kryo serialization classes. Is that the case? If so I'd like to mention in the data serialization docs that many things are registered by default and include a link to the releva

Re: MLLib - Thoughts about refactoring Updater for LBFGS?

2014-02-24 Thread DB Tsai
Hi Yinxusen, I agree. I found a hack to use the current Updater.scala (it contains not only the logic of regularization but also the adaptive learning rate in SGD which will not be used in general for other optimizers), but I think we still need to have a better design to deal with it. Sincerely,

Re: MLLib - Thoughts about refactoring Updater for LBFGS?

2014-02-24 Thread 尹绪森
Hi DB and Xiangrui, L-BFGS is really useful. I think it will be cool if we can refactor the interface of runMiniBatchSGD, so as to plug in new optimizer more easily and compatible. What do you think of that ? 2014-02-23 3:49 GMT+08:00 Xiangrui Meng : > Hi DB, > > It is great to have the L-BFGS