utFile =
>>> val inputrddnqew = sc.textFile(inputFile,500)
>>> inputRddNew.count()
>>>
>>> But still it used 2290 tasks.
>>>
>>> As per scala doc, it supposed use as like the HDFS file i.e 500.
>>>
>>> It would be great if you could throw some insight on this.
>>>
>>> Thanks & Regards,
>>> Gokula Krishnan* (Gokul)*
>>>
>>
>>
>
--
Xiayun Sun
Home is behind, the world ahead,
and there are many paths to tread
through shadows to the edge of night,
until the stars are all alight.
gt; www.linkedin.com/in/bobwakefieldmba
> Twitter: @BobLovesData <http://twitter.com/BobLovesData>
>
>
>
>
>
--
Xiayun Sun
Home is behind, the world ahead,
and there are many paths to tread
through shadows to the edge of night,
until the stars are all alight.
gt;
> Thanks,
> Leena
>
--
Xiayun Sun
Home is behind, the world ahead,
and there are many paths to tread
through shadows to the edge of night,
until the stars are all alight.