See this thread for discussion on related subject: http://search-hadoop.com/m/q3RTtjkIOr1gHqFb1/dropping+spark+python+2.6&subj=+discuss+dropping+Python+2+6+support
especially comments from Juliet. On Fri, Feb 12, 2016 at 9:01 AM, Zheng Wendell <zhengwend...@gmail.com> wrote: > I think this may be also due to the fact that I have multiple copies of > Python. > My driver program was using Python3.4.2 > My local slave nodes are using Python3.4.4 (System administrator's version) > > On Fri, Feb 12, 2016 at 5:51 PM, Zheng Wendell <zhengwend...@gmail.com> > wrote: > >> Sorry, I can no longer reproduce the error. >> After upgrading Python3.4.2 to Python 3.4.4, the error disappears. >> >> Spark release: spark-1.6.0-bin-hadoop2.6 >> code snippet: >> ``` >> lines = sc.parallelize([5,6,2,8,5,2,4,9,2,1,7,3,4,1,5,8,7,6]) >> pairs = lines.map(lambda x: (x, 1)) >> counts = pairs.reduceByKey(lambda a, b: a + b) >> counts.collect() >> ``` >> >> On Fri, Feb 12, 2016 at 4:26 PM, Ted Yu <yuzhih...@gmail.com> wrote: >> >>> Can you give a bit more information ? >>> >>> release of Spark you use >>> full error trace >>> your code snippet >>> >>> Thanks >>> >>> On Fri, Feb 12, 2016 at 7:22 AM, Sisyphuss <zhengwend...@gmail.com> >>> wrote: >>> >>>> When trying the `reduceByKey` transformation on Python3.4, I got the >>>> following error: >>>> >>>> ImportError: No module named 'UserString' >>>> >>>> >>>> >>>> >>>> -- >>>> View this message in context: >>>> http://apache-spark-user-list.1001560.n3.nabble.com/Python3-does-not-have-Module-UserString-tp26212.html >>>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>>> For additional commands, e-mail: user-h...@spark.apache.org >>>> >>>> >>> >> >
