Re: Apache Spark Contribution

2017-02-03 Thread Steve Loughran
You might want to look at Nephele: Efficient Parallel Data Processing in the Cloud, Warneke & Kao, 2009 http://stratosphere.eu/assets/papers/Nephele_09.pdf This was some of the work done in the research project with gave birth to Flink, though this bit didn't surface as they chose to leave VM a

Re: Apache Spark Contribution

2017-02-02 Thread Shuai Lin
> > The goal of the project is to develop an algorithm that automatically > scales the cluster up and down based on the volume of data processed by the > application. By "scale the cluster up and down" do you mean: 1) adding/removing spark executors based on the load? How is that from the dynami

Apache Spark Contribution

2017-02-02 Thread Gabi Cristache
Hello, My name is Gabriel Cristache and I am a student in my final year of a Computer Engineering/Science University. I want for my Bachelor Thesis to add support for dynamic scaling to a spark streaming application. *The goal of the project is to develop an algorithm that automatically scales t

Re: Spark Contribution

2014-08-23 Thread Maisnam Ns
Sure, it's really a good idea to have a CONTRIBUTING.md file with details on how to contribute e.g cloning,branching,changes , commit along with corresponding git commands. That way someone who wants to contribute will surely get the benefit of a quick short documentation on contribution. Maisnam

Re: Spark Contribution

2014-08-23 Thread Nicholas Chammas
That sounds like a good idea. Continuing along those lines, what do people think of moving the contributing page entirely from the wiki to GitHub? It feels like the right place for it since GitHub is where we take contributions, and it also lets people make improvements to it. Nick 2014년 8월 23일

Re: Spark Contribution

2014-08-23 Thread Sean Owen
Can I ask a related question, since I have a PR open to touch up README.md as we speak (SPARK-3069)? If this text is in a file called CONTRIBUTING.md, then it will cause a link to appear on the pull request screen, inviting people to review the contribution guidelines: https://github.com/blog/118

Re: Spark Contribution

2014-08-22 Thread Maisnam Ns
Thanks all, for adding this link . On Sat, Aug 23, 2014 at 5:38 AM, Reynold Xin wrote: > Great idea. Added the link > https://github.com/apache/spark/blob/master/README.md > > > > On Thu, Aug 21, 2014 at 4:06 PM, Nicholas Chammas < > nicholas.cham...@gmail.com> wrote: > >> We should add this li

Re: Spark Contribution

2014-08-22 Thread Reynold Xin
Great idea. Added the link https://github.com/apache/spark/blob/master/README.md On Thu, Aug 21, 2014 at 4:06 PM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > We should add this link to the readme on GitHub btw. > > 2014년 8월 21일 목요일, Henry Saputra님이 작성한 메시지: > > > The Apache Spark wi

Re: Spark Contribution

2014-08-21 Thread Nicholas Chammas
We should add this link to the readme on GitHub btw. 2014년 8월 21일 목요일, Henry Saputra님이 작성한 메시지: > The Apache Spark wiki on how to contribute should be great place to > start: > https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark > > - Henry > > On Thu, Aug 21, 2014 at 3:25 AM,

Re: Spark Contribution

2014-08-21 Thread Henry Saputra
The Apache Spark wiki on how to contribute should be great place to start: https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark - Henry On Thu, Aug 21, 2014 at 3:25 AM, Maisnam Ns wrote: > Hi, > > Can someone help me with some links on how to contribute for Spark > > Regards >

Spark Contribution

2014-08-21 Thread Maisnam Ns
Hi, Can someone help me with some links on how to contribute for Spark Regards mns