How to monitor the communication process?

2014-03-13 Thread moxiecui
Hello everyone: Say I have a application run on GraphX, and I am trying to monitor the communication cost between machines and processes. I check out the webui just to find a very fuzzy shuffled read/write size. I want to know when did the communications between machines or processes occur. Is t

Re: TriangleCount & Shortest Path under Spark

2014-03-12 Thread moxiecui
Well, you could run the driver in several ways, like using IDEA run, or using sbt run, the spark-shell, or even the run-example script, so long as you give the driver the right args. Here is an example using run-example script: # in spark-0.9.0 home dir, the first arg is your master, the second is

Re: TriangleCount & Shortest Path under Spark

2014-03-11 Thread moxiecui
1. There is a driver program named Analystics with a main method in graphx/.../lib, you should start the TriangleCount by this driver. 2. Good luck. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/TriangleCount-Shortest-Path-under-Spark-tp2439p2577.html Se

Re: Build Spark in IntelliJ IDEA 13

2014-02-26 Thread moxiecui
Hi Chen: Check the file > Setting > Compiler > Java Compiler, see if there are some compiler settings to change. Hope that will help. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Build-Spark-in-IntelliJ-IDEA-13-tp2081p2103.html Sent from the Apache