.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p11351.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user
t into one thread and read the sparkListener interface
implementation methods in another thread.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10548.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
rk.MapOutputTracker=INFO, myFileAppender
> log4j.additivty.spark.MapOutputTracker=false
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10440.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
--
Marcelo
false
log4j.logger.spark.MapOutputTrackerActor=INFO, myFileAppender
log4j.additivity.spark.MapOutputTrackerActor=false
log4j.logger.spark.MapOutputTracker=INFO, myFileAppender
log4j.additivty.spark.MapOutputTracker=false
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spar
to filter some of the
> unnecessary logs. Can you let me know where can i find this properties file.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10433.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
--
Marcelo
.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10433.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
4 at 11:05 PM, abhiguruvayya
wrote:
> Hello Marcelo Vanzin,
>
> Can you explain bit more on this? I tried using client mode but can you
> explain how can i use this port to write the log or output to this
> port?Thanks in advance!
>
>
>
> --
> View this message in context:
/application_1405471266091_0055/commons-math3-3.0.jar.
from the logs.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10343.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Hello Marcelo Vanzin,
Can you explain bit more on this? I tried using client mode but can you
explain how can i use this port to write the log or output to this
port?Thanks in advance!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker
in to write my statistics details rather than
> this default output.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p9315.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
--
Marcelo
: UNDEFINED
appTrackingUrl: ***
appUser: hadoop
Which port do i have to hook in to write my statistics details rather than
this default output.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p9315.html
Sent
> @Override
> public void onStageCompleted(SparkListenerStageCompleted arg0) {
> }
>
> @Override
> public void onStageSubmitted(SparkListenerStageSubmitted arg0) {
>
> }
>
>
>
> --
> View this message in conte
) {
}
@Override
public void onStageSubmitted(SparkListenerStageSubmitted arg0) {
}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p9104.html
Sent from the Apache Spark User List mailing list archive at
; --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8697.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
Spark displays job status information on port 4040 using JobProgressListener,
any one knows how to hook into this port and read the details?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8697.html
Sent from the Apache Spark User
ion2() {
public Integer call(Integer i1, Integer i2) {
return i1 + i2;
}
});
List> output = counts.collect();
for (Tuple2 tuple : output) {
System.out.println(tuple._1 + ": " + tuple._2);
}
System.exit(0);
}
}
--
View this message in conte
Hello Mayur,
Are you using SparkListener interface java API? I tried using it but was
unsuccessful. So need few more inputs.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8438.html
Sent from the Apache Spark User List mailing
ri, Jun 27, 2014 at 2:31 AM, abhiguruvayya
wrote:
> I don't want to track it on the cluster UI. Once i launch the job i would
> to
> like to print the status.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-jo
I don't want to track it on the cluster UI. Once i launch the job i would to
like to print the status.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p8370.html
Sent from the Apache Spark User List mailing list archi
.n3.nabble.com/Spark-job-tracker-tp8367.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
20 matches
Mail list logo
