Re: job build cost more and more time

2016-05-25 Thread nguyen duc tuan
_df = sqlContext.sql(test_sql); > test_df.registerTempTable("income"); > test_df.cache(); > test_df.count(); > test_df.show(); > } > } > > function newJob(100,sqlContext) could reproduce my issue,jo

job build cost more and more time

2016-05-24 Thread naliazheli
ay, 10 iterations one checkpoint. i also wrote a test program,there is the code: public static void newJob(int jobNum,SQLContext sqlContext){ for(int i=0;ihttp://apache-spark-user-list.1001560.n3.nabble.com/job-build-cost-more-and-more-time-tp27017.html Sent from the Apache Spark Use