Re: [Spark-Core] sc.textFile() explicit minPartitions did not work

2017-07-25 Thread Xiayun Sun
utFile = >>> val inputrddnqew = sc.textFile(inputFile,500) >>> inputRddNew.count() >>> >>> But still it used 2290 tasks. >>> >>> As per scala doc, it supposed use as like the HDFS file i.e 500. >>> >>> It would be great if you could throw some insight on this. >>> >>> Thanks & Regards, >>> Gokula Krishnan* (Gokul)* >>> >> >> > -- Xiayun Sun Home is behind, the world ahead, and there are many paths to tread through shadows to the edge of night, until the stars are all alight.

Re: real world spark code

2017-07-25 Thread Xiayun Sun
gt; www.linkedin.com/in/bobwakefieldmba > Twitter: @BobLovesData <http://twitter.com/BobLovesData> > > > > > -- Xiayun Sun Home is behind, the world ahead, and there are many paths to tread through shadows to the edge of night, until the stars are all alight.

Re: How to use Update statement or call stored procedure of Oracle from Spark

2017-07-20 Thread Xiayun Sun
gt; > Thanks, > Leena > -- Xiayun Sun Home is behind, the world ahead, and there are many paths to tread through shadows to the edge of night, until the stars are all alight.