does this apply to YARN client mode?
>
> ------
> From: andrewweiner2...@u.northwestern.edu
> Date: Sun, 17 Jan 2016 17:00:39 -0600
> Subject: Re: SparkContext SyntaxError: invalid syntax
> To: cutl...@gmail.com
> CC: user@spark.apache.org
>
>
> Ye
s.
On Sun, Jan 17, 2016 at 11:37 PM, Felix Cheung
wrote:
> Do you still need help on the PR?
> btw, does this apply to YARN client mode?
>
> --
> From: andrewweiner2...@u.northwestern.edu
> Date: Sun, 17 Jan 2016 17:00:39 -0600
> Subject: Re: S
andrewweiner2...@u.northwestern.edu
<mailto:andrewweiner2...@u.northwestern.edu>
Date: Sun, 17 Jan 2016 17:00:39 -0600
Subject: Re: SparkContext SyntaxError: invalid syntax
To: cutl...@gmail.com <mailto:cutl...@gmail.com>
CC: user@spark.apache.org <mailto:user@spark.a
17 Jan 2016 17:00:39 -0600
> Subject: Re: SparkContext SyntaxError: invalid syntax
> To: cutl...@gmail.com
> CC: user@spark.apache.org
>
>
> Yeah, I do think it would be worth explicitly stating this in the docs. I
> was going to try to edit the docs myself and submit a pull
Do you still need help on the PR?
btw, does this apply to YARN client mode?
From: andrewweiner2...@u.northwestern.edu
Date: Sun, 17 Jan 2016 17:00:39 -0600
Subject: Re: SparkContext SyntaxError: invalid syntax
To: cutl...@gmail.com
CC: user@spark.apache.org
Yeah, I do think it would be worth
Finally, when I try to run the same command in client mode...
>>>>>>>>> * ./bin/spark-submit --master yarn --deploy-mode client
>>>>>>>>> --driver-memory 4g --executor-memory 2g --executor-cores 1
>>>>>>>>
issue, could you give more details
>>>>>>>>> about the OS/architecture that you are using? If you are sure
>>>>>>>>> everything
>>>>>>>>> is installed correctly on each node following the guide on "Runn
t;> you can submit a local job to just run on one node.
>>>>>>>>
>>>>>>>> On Fri, Jan 8, 2016 at 5:22 PM, Andrew Weiner <
>>>>>>>> andrewweiner2...@u.northwestern.edu> wrote:
>>>>>>>>
>>>>>>&g
der.loadLibrary(ClassLoader.java:1864)
>>>>>>>> at [....]
>>>>>>>>
>>>>>>>> A bit lower down, I see this error:
&g
lib/python2.7/site-packages:/home/zsb739/local/lib/python2.7/site-packages:/home/jpr123/mobile-cdn-analysis:/home//lib/python2.7/site-packages:/scratch4/hadoop/yarn/local/usercache//appcache/application_1450370639491_0136/container_1450370639491_0136_01_02/pyspark.zip:/scratch4/hadoop/yarn/loca
;>>>>>
>>>>>>
>>>>>> On Fri, Jan 8, 2016 at 2:31 PM, Bryan Cutler
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Andrew,
>>>>>>>
>>>>>>> I know that older versions of Spark
>>> Bryan
>>>>>>
>>>>>> On Thu, Jan 7, 2016 at 2:39 PM, weineran <
>>>>>> andrewweiner2...@u.northwestern.edu> wrote:
>>>>>>
>>&
File "loss_rate_by_probe.py", line 15, in ?
>>>>>> from pyspark import SparkContext
>>>>>> File
>>>>>>
>>>>>> "/scratch5/hadoop/yarn/local/usercache//filecache/18/spark-assembly-1.3.1-hadoop2.4.0.jar/pyspark/__init__.py&quo
/scratch5/hadoop/yarn/local/usercache//filecache/18/spark-assembly-1.3.1-hadoop2.4.0.jar/pyspark/context.py",
>>>>> line 219
>>>>> with SparkContext._lock:
>>>>> ^
>>>>> SyntaxError: invalid syntax/
>>>>>
>>>>> This is very similar to this post
e.com/SparkContext-lock-Error-td18233.html
>>>> >
>>>> , but unlike that person I am using Python 2.7.8.
>>>>
>>>> Here is what I'm using:
>>>> Spark 1.3.1
>>>> Hadoop 2.4.0.2.1.5.0-695
>>>> Python 2.7.8
>>>>
>>>&g
ate_by_probe.py", line 15, in ?
>> from pyspark import SparkContext
>> File
>>
>> "/scratch5/hadoop/yarn/local/usercache//appcache/application_1450370639491_0119/container_1450370639491_0119_01_000001/pyspark.zip/pyspark/__init__.py",
>> line 61
>> indent = ' ' * (min(len(m) for m
pyspark.zip/pyspark/__init__.py",
> line 61
> indent = ' ' * (min(len(m) for m in indents) if indents else 0)
> ^
> SyntaxError: invalid syntax/
>
> Any thoughts?
>
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/SparkContext-SyntaxError-invalid-syntax-tp25910.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-
18 matches
Mail list logo
