you can also access SparkConf using sc.getConf in Spark shell though for
StreamingContext you can directly refer sc as Akhil suggested.
On Sun, Dec 28, 2014 at 12:13 AM, Akhil Das
wrote:
> In the shell you could do:
>
> val ssc = StreamingContext(*sc*, Seconds(1))
>
> as *sc* is the SparkContext
In the shell you could do:
val ssc = StreamingContext(*sc*, Seconds(1))
as *sc* is the SparkContext, which is already instantiated.
Thanks
Best Regards
On Sun, Dec 28, 2014 at 6:55 AM, Thomas Frisk wrote:
> Yes you are right - thanks for that :)
>
> On 27 December 2014 at 23:18, Ilya Ganelin
Yes you are right - thanks for that :)
On 27 December 2014 at 23:18, Ilya Ganelin wrote:
> Are you trying to do this in the shell? Shell is instantiated with a spark
> context named sc.
>
> -Ilya Ganelin
>
> On Sat, Dec 27, 2014 at 5:24 PM, tfrisk wrote:
>
>>
>> Hi,
>>
>> Doing:
>>val ssc =
Are you trying to do this in the shell? Shell is instantiated with a spark
context named sc.
-Ilya Ganelin
On Sat, Dec 27, 2014 at 5:24 PM, tfrisk wrote:
>
> Hi,
>
> Doing:
>val ssc = new StreamingContext(conf, Seconds(1))
>
> and getting:
>Only one SparkContext may be running in this J
