Intellij IDEA import spark souce code error

2015-05-24 Thread huangzheng
Hi all I want to learn spark source code recently. Git clone spark code from git , and exec sbt gen-idea command . import the project into intellij , have such error below: Anyone could help me? Spark version is 1.4, operation system is windows 7

learning rpc about spark core source code

2015-06-10 Thread huangzheng
Hi all Recently I have learned about 1.3 spark core source code , can't understand rpc, How to communicate between client driver, worker and master? There are some scala files such as RpcCallContextRpcEndPointRef RpcEndpoint RpcEnv. On spark core rpc module Have any blogs ?

??????Best practises

2015-10-30 Thread huangzheng
I have the same question.anyone help us. -- -- ??: "Deepak Sharma"; : 2015??10??30??(??) 7:23 ??: "user"; : Best practises Hi I am looking for any blog / doc on the developer's best practices if using Spark .I have alr