Re: Only 60% of Total Spark Batch Application execution time spent in Task Processing

2016-04-10 Thread Ted Yu
gt; also the total execution time for the application from the Spark Web UI. > Across all the tests we saw consistently that, sum total of the execution > times of all the tasks is accounting to about 60% of the total application > run time. > We are just kind of wondering where is the

Re: Only 60% of Total Spark Batch Application execution time spent in Task Processing

2016-04-07 Thread Ted Yu
to about 60% of the total application > run time. > We are just kind of wondering where is the rest of the 40% of the time > being > spent. > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Only-60-of-Total-Spark-Bat

Only 60% of Total Spark Batch Application execution time spent in Task Processing

2016-04-07 Thread JasmineGeorge
application run time. We are just kind of wondering where is the rest of the 40% of the time being spent. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Only-60-of-Total-Spark-Batch-Application-execution-time-spent-in-Task-Processing-tp26703.html Sent from