found
>>>
>>> I realized that this data is part of the Scheduler. So, the Sparkcontext
>>> would not have got created yet.
>>>
>>> Any help in "writing scheduler variable data to HDFS" is appreciated!!
>>>
>>> -Karthik
>>>
>>
>
ne error found
>>
>> I realized that this data is part of the Scheduler. So, the Sparkcontext
>> would not have got created yet.
>>
>> Any help in "writing scheduler variable data to HDFS" is appreciated!!
>>
>> -Karthik
>>
>
>
> ---
It is a method of the class, not a static method of the object. Since a
SparkContext is available as sc in the shell, or you have perhaps created
one similarly in your app, write sc.parallelize(...)
On Oct 12, 2014 7:15 AM, "rapelly kartheek" wrote:
> Hi,
>
> I am trying to write a String that is
that this data is part of the Scheduler. So, the Sparkcontext
>> would not have got created yet.
>>
>> Any help in "writing scheduler variable data to HDFS" is appreciated!!
>>
>> -Karthik
>>
>
>
>
> ----------------------
> If you reply to this ema
Hi Karthik,
Can you provide us more detail of dataset "data" that you wanted to
parallelize with
SparkContext.parallelize(data);
Regards,
Sanjiv Singh
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Sun, Oct 12, 2014 at 11:45 AM, rapelly kartheek
wrote:
> Hi,
>
> I am trying to write a
Hi,
I am trying to write a String that is not an rdd to HDFS. This data is a
variable in Spark Scheduler code. None of the spark File operations are
working because my data is not rdd.
So, I tried using SparkContext.parallelize(data). But it throws error:
[error]
/home/karthik/spark-1.0.0/core/s
