user
Thread
Date
Earlier messages
Later messages
Messages by Date
2023/03/09
Re: read a binary file and save in another location
Russell Jurney
2023/03/09
Re: read a binary file and save in another location
Mich Talebzadeh
2023/03/09
Re: read a binary file and save in another location
Russell Jurney
2023/03/09
Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)?
Mich Talebzadeh
2023/03/09
Re: Online classes for spark topics
neeraj bhadani
2023/03/09
eqNullSafe breaks Sorted Merge Bucket Join?
Thomas Wang
2023/03/09
Re: [EXTERNAL] Spark Thrift Server - Autoscaling on K8
Saurabh Gulati
2023/03/09
Re: [EXTERNAL] Re: Online classes for spark topics
asma zgolli
2023/03/09
Re: [EXTERNAL] Re: Online classes for spark topics
Winston Lai
2023/03/09
Re: [EXTERNAL] Re: Online classes for spark topics
Saurabh Gulati
2023/03/09
read a binary file and save in another location
second_co...@yahoo.com.INVALID
2023/03/09
Re: Online classes for spark topics
Mich Talebzadeh
2023/03/08
How to use Fair Scheduler Pools
李杰
2023/03/08
Re: Online classes for spark topics
Deepak Sharma
2023/03/08
Re: Online classes for spark topics
Denny Lee
2023/03/08
Re: Online classes for spark topics
Sofia’s World
2023/03/08
Spark Thrift Server - Autoscaling on K8
Jayabindu Singh
2023/03/08
How to use Fair Scheduler Pools
李杰
2023/03/08
[Spark] How to find which type of key is illegal during from_json() function
hueiyuan su
2023/03/08
Re: Online classes for spark topics
Winston Lai
2023/03/08
spark-submit: No "driver-" id printed in standalone mode
Travis Athougies
2023/03/08
Re: Online classes for spark topics
asma zgolli
2023/03/08
Re: Online classes for spark topics
karan alang
2023/03/08
Re: Online classes for spark topics
Mich Talebzadeh
2023/03/08
Re: Online classes for spark topics
ashok34...@yahoo.com.INVALID
2023/03/07
[ANNOUNCE] Apache Kyuubi released 1.7.0
Cheng Pan
2023/03/07
Re: Online classes for spark topics
Mich Talebzadeh
2023/03/07
Online classes for spark topics
ashok34...@yahoo.com.INVALID
2023/03/07
Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)?
Mich Talebzadeh
2023/03/07
Re: 回复:Re: Build SPARK from source with SBT failed
Tufan Rakshit
2023/03/07
Re: 回复:Re: Build SPARK from source with SBT failed
Sean Owen
2023/03/07
Re: 回复:Re: Build SPARK from source with SBT failed
Artemis User
2023/03/07
回复:Re: Build SPARK from source with SBT failed
ckgppl_yan
2023/03/07
Re: Pandas UDFs vs Inbuilt pyspark functions
Sean Owen
2023/03/07
Re: Build SPARK from source with SBT failed
Sean Owen
2023/03/07
Pandas UDFs vs Inbuilt pyspark functions
neha garde
2023/03/06
Re: [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently and how to handle if achieve quotas of kinesis?
Mich Talebzadeh
2023/03/06
unsubscribe
Deepthi Sathia Raj
2023/03/06
unsubscribe
William R
2023/03/05
[Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently and how to handle if achieve quotas of kinesis?
hueiyuan su
2023/03/05
Data duplication and loss occur after executing 'insert overwrite...' in Spark 3.1.1
周锋
2023/03/05
Re: How to pass variables across functions in spark structured streaming (PySpark)
Mich Talebzadeh
2023/03/04
Re: Unable to handle bignumeric datatype in spark/pyspark
Atheeth SH
2023/03/04
Re: How to pass variables across functions in spark structured streaming (PySpark)
Mich Talebzadeh
2023/03/04
Re: How to pass variables across functions in spark structured streaming (PySpark)
Mich Talebzadeh
2023/03/04
Re: How to pass variables across functions in spark structured streaming (PySpark)
Sean Owen
2023/03/04
Re: How to pass variables across functions in spark structured streaming (PySpark)
Mich Talebzadeh
2023/03/04
Re: How to pass variables across functions in spark structured streaming (PySpark)
Sean Owen
2023/03/04
How to pass variables across functions in spark structured streaming (PySpark)
Mich Talebzadeh
2023/03/04
Re: SPIP architecture diagrams
Mich Talebzadeh
2023/03/03
Re: Unable to handle bignumeric datatype in spark/pyspark
Atheeth SH
2023/03/03
Re: Unsubscribe
Atheeth SH
2023/03/03
Re: unsubscribe
Atheeth SH
2023/03/01
[ANNOUNCE] Apache Celeborn(incubating) 0.2.0 available
Ethan Feng
2023/02/27
Re: [New Project] sparksql-ml : Distributed Machine Learning using SparkSQL.
Russell Jurney
2023/02/27
Fwd: [New Project] sparksql-ml : Distributed Machine Learning using SparkSQL.
Chitral Verma
2023/02/27
Re: Spike on number of tasks - dynamic allocation
Mich Talebzadeh
2023/02/27
Re: Spike on number of tasks - dynamic allocation
murat migdisoglu
2023/02/27
Re: Spike on number of tasks - dynamic allocation
Mich Talebzadeh
2023/02/27
Spike on number of tasks - dynamic allocation
murat migdisoglu
2023/02/26
Fwd: 自动回复: Re: [DISCUSS] Show Python code examples first in Spark documentation
Mich Talebzadeh
2023/02/26
[JDBC] [PySpark] Possible bug when comparing incoming data frame from mssql and empty delta table
lennart
2023/02/25
Re: Unable to handle bignumeric datatype in spark/pyspark
Mich Talebzadeh
2023/02/25
Re: Unable to handle bignumeric datatype in spark/pyspark
Rajnil Guha
2023/02/25
Late arriving updates to fact tables
rajat kumar
2023/02/24
Re: [PySpark SQL] New column with the maximum of multiple terms?
Oliver Ruebenacker
2023/02/24
Re: [PySpark SQL] New column with the maximum of multiple terms?
Russell Jurney
2023/02/24
Re: SPIP architecture diagrams
Mich Talebzadeh
2023/02/24
Re: [PySpark SQL] New column with the maximum of multiple terms?
Oliver Ruebenacker
2023/02/24
Re: Unable to handle bignumeric datatype in spark/pyspark
Mich Talebzadeh
2023/02/23
Unable to handle bignumeric datatype in spark/pyspark
nidhi kher
2023/02/23
unsubscribe
Roberto Jr
2023/02/23
Re: [PySpark SQL] New column with the maximum of multiple terms?
Sean Owen
2023/02/23
Re: [PySpark SQL] New column with the maximum of multiple terms?
Bjørn Jørgensen
2023/02/23
Re: [PySpark SQL] New column with the maximum of multiple terms?
Russell Jurney
2023/02/23
Re: [PySpark SQL] New column with the maximum of multiple terms?
Oliver Ruebenacker
2023/02/23
Re: [PySpark SQL] New column with the maximum of multiple terms?
Sean Owen
2023/02/23
[PySpark SQL] New column with the maximum of multiple terms?
Oliver Ruebenacker
2023/02/22
Unsubscribe
Tang Jinxin
2023/02/22
Unsubscribe
Qijia Liu
2023/02/22
Re: Spark with bigquery : Data type issue
Mich Talebzadeh
2023/02/22
Spark with bigquery : Data type issue
nidhi kher
2023/02/22
Re: Spark with bigquery : Data type issue
nidhi kher
2023/02/20
SPIP: Adding work load identity to Spark on Kubernetes documents (supersedes Secret Management)
Mich Talebzadeh
2023/02/20
Re: Graceful shutdown SPARK Structured Streaming
Mich Talebzadeh
2023/02/19
Re: How to explode array columns of a dataframe having the same length
404
2023/02/19
Re: Graceful shutdown SPARK Structured Streaming
Bjørn Jørgensen
2023/02/19
Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process
Mich Talebzadeh
2023/02/18
Re: Unsubscribe
winnie hw
2023/02/18
Unsubscribe
Sendil Chidambaram
2023/02/18
Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process
Holden Karau
2023/02/18
Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process
Dongjoon Hyun
2023/02/18
SPIP: Shutting down spark structured streaming when the streaming process completed current process
Mich Talebzadeh
2023/02/18
Vote SPIP
Faisal Waris
2023/02/17
Update nested struct with null fields
Vikas Kumar
2023/02/16
Re: [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently?
Vikas Kumar
2023/02/16
[Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently?
hueiyuan su
2023/02/16
Re: How to explode array columns of a dataframe having the same length
Vikas Kumar
2023/02/16
Re: How to explode array columns of a dataframe having the same length
sam smith
2023/02/16
Re: How to explode array columns of a dataframe having the same length
Bjørn Jørgensen
2023/02/16
How can I set a value of Location with CustomDataSource ?
Zhuolin Ji
2023/02/16
Re: How to explode array columns of a dataframe having the same length
Navneet
2023/02/16
Re: Running Spark on Kubernetes (GKE) - failing on spark-submit
Mich Talebzadeh
2023/02/16
Re: How to explode array columns of a dataframe having the same length
Enrico Minack
2023/02/15
Re:Upgrading from Spark SQL 3.2 to 3.3 faild
lk_spark
2023/02/15
Upgrading from Spark SQL 3.2 to 3.3 faild
lk_spark
2023/02/15
Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)?
Jack Goodson
2023/02/15
[Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)?
hueiyuan su
2023/02/15
Re: ADLS Gen2 adfs sample yaml configuration
Jayabindu Singh
2023/02/15
Re: Running Spark on Kubernetes (GKE) - failing on spark-submit
karan alang
2023/02/15
Re: Running Spark on Kubernetes (GKE) - failing on spark-submit
Mich Talebzadeh
2023/02/15
Re: Running Spark on Kubernetes (GKE) - failing on spark-submit
Mich Talebzadeh
2023/02/14
Re: Running Spark on Kubernetes (GKE) - failing on spark-submit
karan alang
2023/02/14
ADLS Gen2 adfs sample yaml configuration
Kondala Ponnaboina (US)
2023/02/14
How to explode array columns of a dataframe having the same length
sam smith
2023/02/14
Re: Running Spark on Kubernetes (GKE) - failing on spark-submit
Ye Xianjin
2023/02/14
Re: Running Spark on Kubernetes (GKE) - failing on spark-submit
Khalid Mammadov
2023/02/13
Executor tab missing information
Prem Sahoo
2023/02/13
Re: Executor metrics are missing on Prometheus sink
Qian Sun
2023/02/13
Running Spark on Kubernetes (GKE) - failing on spark-submit
karan alang
2023/02/13
[Spark Core] Spark data loss/data duplication when executors die
Erik Eklund
2023/02/13
Re: How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
Enrico Minack
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
Sean Owen
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
Enrico Minack
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
Mich Talebzadeh
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
Sean Owen
2023/02/12
Re: How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/11
Re: How to improve efficiency of this piece of code (returning distinct column values)
Enrico Minack
2023/02/10
Re: How to improve efficiency of this piece of code (returning distinct column values)
Sean Owen
2023/02/10
Re: How to improve efficiency of this piece of code (returning distinct column values)
Mich Talebzadeh
2023/02/10
Re: How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/10
Re: How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/10
Re: How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/10
Re: How to improve efficiency of this piece of code (returning distinct column values)
Apostolos N. Papadopoulos
2023/02/10
Re: How to improve efficiency of this piece of code (returning distinct column values)
Sean Owen
2023/02/10
How to improve efficiency of this piece of code (returning distinct column values)
sam smith
2023/02/10
Re:
Sunil Prabhakara
2023/02/09
Fwd: [Spark SQL] : Delete is only supported on V2 tables.
Jeevan Chhajed
2023/02/09
Executor metrics are missing on prometheus sink
Qian Sun
2023/02/09
Jira Account for Contributions
Jack Goodson
2023/02/09
Unsubscribe
Patrik Medvedev
2023/02/08
Re: Unsubscribe
LinuxGuy
2023/02/08
[Spark SQL]: Spark 3.2 generates different results to query when columns name have mixed casing vs when they have same casing
Amit Singh Rathore
2023/02/08
Unsubscribe
fuwei901
2023/02/08
Is sparkSession.sql now an action in Spark 3 and later?
Sayeh Roshan
2023/02/08
Re: Graceful shutdown SPARK Structured Streaming
Brian Wylie
2023/02/08
Unsubscribe
fuwei901
2023/02/07
Unsubscribe
Tushar Machavolu
2023/02/07
Re: Spark with GPU
Alessandro Bellina
2023/02/07
Re: How to upgrade a spark structure streaming application
Mich Talebzadeh
2023/02/07
Fwd: Graceful shutdown SPARK Structured Streaming
Mich Talebzadeh
2023/02/07
[Spark SQL] : Delete is only supported on V2 tables.
Jeevan Chhajed
2023/02/07
How to upgrade a spark structure streaming application
Yoel Benharrous
2023/02/07
SQL GROUP BY alias with dots, was: Spark SQL question
Enrico Minack
2023/02/07
Unsubscribe
Spyros Gasteratos
2023/02/05
big data products
LinuxGuy
2023/02/05
Re: Spark with GPU
Jack Goodson
2023/02/05
Re: Spark with GPU
Mich Talebzadeh
2023/02/05
Spark with GPU
Irene Markelic
2023/02/02
Re: Create table before inserting in SQL
Harut Martirosyan
2023/02/02
Re: Create table before inserting in SQL
Mich Talebzadeh
2023/02/02
Re: Create table before inserting in SQL
Harut Martirosyan
2023/02/02
Re: Create table before inserting in SQL
Harut Martirosyan
2023/02/01
Re: Create table before inserting in SQL
Mich Talebzadeh
2023/02/01
Create table before inserting in SQL
Harut Martirosyan
2023/02/01
Spark Thrift Server issue with external HDFS table
Kalhara Gurugamage
2023/01/31
What is DataFilters and while joining why is the filter isnotnull[joinKey] applied twice
Nitin Siwach
2023/01/31
Fwd: [Spark Standalone Mode] How to read from kerberised HDFS in spark standalone mode
Wei Yan
2023/01/31
[Spark/deeplyR] how come spark is caching tables read through jdbc connection from oracle, even when memory=false is chosen
Joris Billen
2023/01/30
Re: Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast
Artemis User
2023/01/30
Re: Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast
Mich Talebzadeh
2023/01/30
Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast
Jain, Sanchi
2023/01/30
Re: Re: spark+kafka+dynamic resource allocation
Mich Talebzadeh
2023/01/29
Re: Re: spark+kafka+dynamic resource allocation
Lingzhe Sun
2023/01/29
Re: Re: spark+kafka+dynamic resource allocation
Mich Talebzadeh
2023/01/28
Re: Re: spark+kafka+dynamic resource allocation
Lingzhe Sun
2023/01/28
Fwd: Spark-submit doesn't load all app classes in the classpath
Soheil Pourbafrani
2023/01/28
Re: spark+kafka+dynamic resource allocation
ashok34...@yahoo.com.INVALID
2023/01/28
Re: Spark SQL question
Bjørn Jørgensen
2023/01/28
Re: Spark SQL question
Mich Talebzadeh
2023/01/27
spark+kafka+dynamic resource allocation
Lingzhe Sun
2023/01/27
Spark SQL question
Kohki Nishio
2023/01/27
Re: Question regarding Spark 3.X performance
Athanasios Kordelas
2023/01/27
Re: Question regarding Spark 3.X performance
Mich Talebzadeh
2023/01/26
Re: Question regarding Spark 3.X performance
Mich Talebzadeh
2023/01/26
Re: Question regarding Spark 3.X performance
Mich Talebzadeh
2023/01/26
Question regarding Spark 3.X performance
Athanasios Kordelas
2023/01/23
Re: Dynamic Scaling without Kubernetes
Mich Talebzadeh
2023/01/23
Re: Duplicates in Collaborative Filtering Output
Kartik Ohri
2023/01/23
Unsubscribe
Calum
2023/01/22
Duplicates in Collaborative Filtering Output
Kartik Ohri
2023/01/22
Re: Any advantages of using sql.adaptive.autoBroadcastJoinThreshold over sql.autoBroadcastJoinThreshold?
Balakrishnan Ayyappan
2023/01/22
Any advantages of using sql.adaptive.autoBroadcastJoinThreshold over sql.autoBroadcastJoinThreshold?
Soumyadeep Mukhopadhyay
2023/01/21
Re: Table created with saveAsTable behaves differently than a table created with spark.sql("CREATE TABLE....)
krexos
2023/01/21
Re: Table created with saveAsTable behaves differently than a table created with spark.sql("CREATE TABLE....)
Peyman Mohajerian
2023/01/21
Table created with saveAsTable behaves differently than a table created with spark.sql("CREATE TABLE....)
krexos
2023/01/20
unsubscribe
peng
Earlier messages
Later messages