Pyspark SparkContext issue

I am getting the py4j.protocol.Py4JJavaError while running SparkContext. Can you please help me to resolve this issue. from pyspark import SparkContext sc=SparkContext() a=sc.parallelize([1,2,3,4]) print(f"a_take:{a.take(2)}") py4j.protocol.Py4JJavaError: An error occurred while calling z:org.a

Re: Issue with SparkContext

Hi, we have a user group at u...@spark.apache.org You must install a java JRE If you are on ubuntu you can type apt-get install openjdk-17-jre-headless tir. 20. sep. 2022 kl. 06:15 skrev yogita bhardwaj < yogita.bhard...@iktara.ai>: > > > I am getting the py4j.protocol.Py4JJavaError while runni

Re: Issue with SparkContext

Is you using the pyspark? If pyspark, you can try to set env about PYSPARK_PYTHON SPARK_HOME Example: import os os.environ['PYSPARK_PYTHON'] = “python path” os.environ[’SPARK_HOME’] = “SPARK path” you can try this code…may it can resolved this. 在 2022年9月20日 17:34，Bjørn Jørgensen 写道： Hi,

[no subject]

I have installed pyspark using pip. I m getting the error while running the following code. from pyspark import SparkContext sc=SparkContext() a=sc.parallelize([1,2,3,4]) print(f"a_take:{a.take(2)}") py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.Pytho

回复：

Try: import os os.environ['PYSPARK_PYTHON'] = “python path” os.environ[’SPARK_HOME’] = “SPARK path” 在 2022年9月20日 17:51，yogita bhardwaj 写道： I have installed pyspark using pip. I m getting the error while running the following code. from pyspark import SparkContext sc=SparkContext() a=sc.

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1 (non-binding) On Mon, Sep 19, 2022 at 10:17 PM Wenchen Fan wrote: > > +1 > > On Mon, Sep 19, 2022 at 2:59 PM Yang,Jie(INF) wrote: >> >> +1 (non-binding) >> >> >> >> Yang Jie >> >> >> 发件人: Yikun Jiang >> 发送时间: 2022年9月19日 14:23:14 >> 收件人: Denny Lee >> 抄送: bo zh

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1 Ruifeng Zheng ruife...@foxmail.com   -- Original -- From: "Chao Sun"

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1. It's valuable, can I be involved in this work? Yikun Jiang 于2022年9月19日周一 08:15写道： > Hi, all > > I would like to start the discussion for supporting Docker Official Image > for Spark. > > This SPIP is proposed to add Docker Official Image(DOI) >