Hi,
my code:
from pyspark.sql import SparkSession
spark = SparkSession.builder.remote("sc://172.29.190.147").getOrCreate()
import pandas as pd
# 创建pandas dataframe
pdf = pd.DataFrame({
"name": ["Alice", "Bob", "Charlie"],
"age": [25, 30, 35],
"gender": ["F", "M", "M"]
})
# 将pandas dataframe转换为spark dataframe
sdf = spark.createDataFrame(pdf)
# 显示spark dataframe
sdf.show()
spark.stop()
After stop, execute sdf.show() throw
pyspark.errors.exceptions.connect.SparkConnectException: [NO_ACTIVE_SESSION] No
active Spark session found. Please create a new Spark session before running
the code. Visit the Spark web UI at http://172.29.190.147:4040/connect/ to
check if the current session is still running and has not been stopped yet.
1 session(s) are online, running 0 Request(s)
Session Statistics (1)
1 Pages. Jump to. Showitems in a page.Go
Page:
1
User
Session ID
Start Time ▾
Finish Time
Duration
Total Execute
29f05cde-8f8b-418d-95c0-8dbbbfb556d22023/10/20 15:30:0414 minutes 49 seconds2
eabour
