Messages by Date
-
2024/12/19
[Spark Structured Streaming] Is it possible to enable AQE in some case?
bluzy
-
2024/12/06
Re: Spark 2.4 to Spark 3.5 migration - waiting for HMS
Matteo Moci
-
2024/12/05
Re: Spark 2.4 to Spark 3.5 migration - waiting for HMS
Mich Talebzadeh
-
2024/12/05
unsubscribe
Phil Stavridis
-
2024/12/05
Re: Spark 2.4 to Spark 3.5 migration - waiting for HMS
Matteo Moci
-
2024/12/04
Re: Spark 2.4 to Spark 3.5 migration - waiting for HMS
Matteo Moci
-
2024/12/04
Re: Spark 2.4 to Spark 3.5 migration - waiting for HMS
Matteo Moci
-
2024/12/04
Re: Spark 2.4 to Spark 3.5 migration - waiting for HMS
Mich Talebzadeh
-
2024/12/04
Spark 2.4 to Spark 3.5 migration - waiting for HMS
Matteo Moci
-
2024/12/03
unsubscribe
Phil Stavridis
-
2024/12/03
Re: [Spark Structured Streaming] How to delete old data that was created by Spark Structured Streaming?
Andrei L
-
2024/12/03
Re: [Spark Structured Streaming] How to delete old data that was created by Spark Structured Streaming?
Mich Talebzadeh
-
2024/12/03
Re: [Spark Structured Streaming] How to delete old data that was created by Spark Structured Streaming?
Yuri Oleynikov (יורי אולייניקוב)
-
2024/12/03
RE: [Spark Structured Streaming] How to delete old data that was created by Spark Structured Streaming?
Дубинкин Егор
-
2024/12/03
[Spark Structured Streaming] How to delete old data that was created by Spark Structured Streaming?
Дубинкин Егор
-
2024/12/03
[ANNOUNCE] Apache Sedona 1.7.0 released
Jia Yu
-
2024/12/01
Re: repartition before writing to table with bucketed partitioning
Soumasish
-
2024/12/01
Re: repartition before writing to table with bucketed partitioning
Henryk Česnolovič
-
2024/11/30
Re: repartition before writing to table with bucketed partitioning
Soumasish
-
2024/11/29
repartition before writing to table with bucketed partitioning
Henryk Česnolovič
-
2024/11/28
Why is spark not doing filter just after the scan to reduce shuffle at later stage.
Khemchand Nagar
-
2024/11/26
[ANNOUNCE] Apache Celeborn 0.5.2 available
Nicholas Jiang
-
2024/11/23
[Spark]: Is spark goal to remove spark native function extensions?
Nathan DEBUCQUOIS
-
2024/11/19
Can't import confluent_kafka package
Tzahi File
-
2024/11/18
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Sean Owen
-
2024/11/18
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/11/18
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
awadhesh singh
-
2024/11/18
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/11/17
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Xiao Li
-
2024/11/14
Re: Which shuffle operations trigger AQE and which don't?
Gurunandan
-
2024/11/13
Unsubscribe
surpass...@aliyun.com.INVALID
-
2024/11/13
Unsubscribe
rakesh sharma
-
2024/11/13
Re: [Spark SQL] [DISK_ONLY Persistence] getting "this.inMemSorter" is null exception
Ashwani Pundir
-
2024/11/12
Re: [Spark SQL] [DISK_ONLY Persistence] getting "this.inMemSorter" is null exception
Gurunandan
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Ángel
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Holden Karau
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Ángel
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Ángel
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/11/12
Re: Which shuffle operations trigger AQE and which don't?
Mich Talebzadeh
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Ángel
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/11/12
Getting "Cannot broadcast the table that is larger than 8GB error" - Clarification
Lakshminarayana Chari
-
2024/11/12
Which shuffle operations trigger AQE and which don't?
Perfect Stranger
-
2024/11/12
Unsubscribe
rakesh sharma
-
2024/11/12
Unsubscribe
rakesh sharma
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Ángel
-
2024/11/12
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/11/12
Job Opportunities in India,UK,Australia,UAE,Singapore or USA
sri hari kali charan Tummala
-
2024/11/11
Re: [Spark SQL] [DISK_ONLY Persistence] getting "this.inMemSorter" is null exception
Gurunandan
-
2024/11/11
Observation not working on jdbc write
Smokeriu
-
2024/11/10
Re: [BRAND] I have a question
Mark Thomas
-
2024/11/07
[SPARK]: standalone : cluster mode : spark-submit driverId issue
meivenkatkumar lakshminarayanan
-
2024/11/06
Re: ClassCastException in Spark3.5 when submit job to an old yarn cluster using netty 4.1.17
Gurunandan
-
2024/11/06
Re: [SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility
Gurunandan
-
2024/11/05
Re: Access binary representation of Dataframe
Sem
-
2024/11/05
Access binary representation of Dataframe
vincent gromakowski
-
2024/10/31
StreamingQueryListener in PySpark lagging behind
Andrzej Zera
-
2024/10/31
ClassCastException in Spark3.5 when submit job to an old yarn cluster using netty 4.1.17
Smokeriu
-
2024/10/30
Re: [SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility
Evelina Dumitrescu
-
2024/10/30
Re: [SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility
Gurunandan
-
2024/10/30
[SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility
Evelina Dumitrescu
-
2024/10/29
Re:
Gurunandan
-
2024/10/27
Re: [ANNOUNCE] Apache Spark 3.4.4 released
Mich Talebzadeh
-
2024/10/27
[ANNOUNCE] Apache Spark 3.4.4 released
Dongjoon Hyun
-
2024/10/27
Code change requirement
Avi Minsky
-
2024/10/27
[ANNOUNCE] Apache Kyuubi v1.10.0 is available
Bowen Liang
-
2024/10/26
[ANNOUNCE] Apache Kyuubi v1.10.0 is available
Bowen Liang
-
2024/10/25
Unsubscribe
Qichi Yang
-
2024/10/24
Help needed in Spark Job.
Khushal Manish
-
2024/10/24
PySpark Connect client hangs after query completes
peay
-
2024/10/24
Data is not displayed in the readable format
Perez
-
2024/10/23
Re: kubeflow spark operator & SparkHistoryService on k8s - spark driver/executor logs not showing up Spark History Server
Mat Schaffer
-
2024/10/23
kubeflow spark operator & SparkHistoryService on k8s - spark driver/executor logs not showing up Spark History Server
karan alang
-
2024/10/23
Unable to format data
Perez
-
2024/10/23
[spark user] Issues with Overwrite Mode in Spark Write Parquet Using Root User
Ilango
-
2024/10/22
Re: Spark 4.0 - Expected Stable Release Date
Holden Karau
-
2024/10/22
Re: Spark 4.0 - Expected Stable Release Date
Bjørn Jørgensen
-
2024/10/21
Spark 4.0 - Expected Stable Release Date
Arshad Ali
-
2024/10/21
Re: Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions
Mich Talebzadeh
-
2024/10/21
Re: Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions
Jason Tan
-
2024/10/21
Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions
Mich Talebzadeh
-
2024/10/20
Vulnerability Remediation inquiry
Benjamin Liu
-
2024/10/18
Re: Disk usage with transparent encryption
Rommel Holmes
-
2024/10/18
Disk usage with transparent encryption
Sébastien Rebecchi
-
2024/10/17
Re: spark connect server cannot set driver memory
Hill Liu
-
2024/10/17
Re: Inquiry on JDK 21 Stable Support Timeline for Apache Spark
Hill Liu
-
2024/10/17
Re: Spark Docker image with added packages
Ángel
-
2024/10/17
Re: Spark Docker image with added packages
Damien Hawes
-
2024/10/17
Re: Spark Docker image with added packages
Nimrod Ofek
-
2024/10/17
Inquiry on JDK 21 Stable Support Timeline for Apache Spark
tison c sunny chiriyankandath
-
2024/10/16
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/10/16
Re: Spark Docker image with added packages
Nimrod Ofek
-
2024/10/15
Re: Spark Docker image with added packages
karan alang
-
2024/10/15
Re: Spark Docker image with added packages
Mich Talebzadeh
-
2024/10/15
Re: Spark Docker image with added packages
Damien Hawes
-
2024/10/15
Re: Spark Docker image with added packages
Damien Hawes
-
2024/10/15
Spark Docker image with added packages
Nimrod Ofek
-
2024/10/14
Re: Unexpected longer timer when doing the same training
Ángel
-
2024/10/14
Unsubscribe
Sh Lim
-
2024/10/14
Unexpected longer timer when doing the same training
Olivier Sannier
-
2024/10/14
spark connect server cannot set driver memory
Yunhui Han
-
2024/10/14
Unsubscribe
Chanh Le
-
2024/10/13
Unsubscribe
Santhosh Gandhe
-
2024/10/11
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
karan alang
-
2024/10/11
CVE-2024-7254 spark-core_2.13-3.5.0.jar
Kaushik Zadoo
-
2024/10/08
Unsubscribe
Eve Liao
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Richard Eggert
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Holden Karau
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Holden Karau
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Holden Karau
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/10/07
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
Nimrod Ofek
-
2024/10/07
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Erik Eklund
-
2024/10/06
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
karan alang
-
2024/10/06
Unsubscribe
kritika jain
-
2024/10/06
Unsubscribe
Daniel Maangi
-
2024/10/06
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
Nimrod Ofek
-
2024/10/05
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Holden Karau
-
2024/10/05
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Ángel
-
2024/10/05
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Holden Karau
-
2024/10/05
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Russell Jurney
-
2024/10/05
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
karan alang
-
2024/10/05
Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?
Mich Talebzadeh
-
2024/10/04
Re: spark TLS connection to hive metastore
Ángel
-
2024/10/04
spark TLS connection to hive metastore
Stefano Bovina
-
2024/10/03
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
Nimrod Ofek
-
2024/10/02
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
karan alang
-
2024/10/02
Re: How to run spark connect in kubernetes?
kant kodali
-
2024/10/02
Re: How to run spark connect in kubernetes?
kant kodali
-
2024/10/01
How to run spark connect in kubernetes?
kant kodali
-
2024/10/01
kubeflow spark-operator - error in querying strimzi kafka using structured streaming
karan alang
-
2024/10/01
Re: Bugs with joins and SQL in Structured Streaming
Andrzej Zera
-
2024/09/30
Re: Bugs with joins and SQL in Structured Streaming
Jungtaek Lim
-
2024/09/30
Re: Rust Spark Connect
ed elliott
-
2024/09/29
Re: Bugs with joins and SQL in Structured Streaming
Jungtaek Lim
-
2024/09/28
Re: Bugs with joins and SQL in Structured Streaming
Jungtaek Lim
-
2024/09/26
Re: Help - Learning/Understanding spark web UI
Daniel Aronovic
-
2024/09/26
[ANNOUNCE] Announcing Apache Spark 4.0.0-preview2
Dongjoon Hyun
-
2024/09/26
Spark Job Opportunities !
sri hari kali charan Tummala
-
2024/09/26
Re: Help - Learning/Understanding spark web UI
Ilango
-
2024/09/26
Help - Learning/Understanding spark web UI
Karthick Nk
-
2024/09/25
When exactly does AQE coalesce small partitions or break up large partitions?
Perfect Stranger
-
2024/09/24
[ANNOUNCE] Apache Spark 3.5.3 released
Haejoon Lee
-
2024/09/23
Re: Structured Streaming and Spark Connect
刘唯
-
2024/09/23
Re: Structured Streaming and Spark Connect
Mich Talebzadeh
-
2024/09/23
Structured Streaming and Spark Connect
Anastasiia Sokhova
-
2024/09/23
Issues with CharType() and VarcharType() datatype
Souvik Saha
-
2024/09/21
Compatibility Issue: Spark 3.5.2 Schema Recognition vs. Spark 3.4.0 with Hive Metastore (Case Sensitivity)
Mich Talebzadeh
-
2024/09/21
Spark SQL readSideCharPadding issue while reading ENUM column from mysql
Suyash Ajmera
-
2024/09/20
Re: is it possible to run spark2 on EMR 7.2.0
Prem Sahoo
-
2024/09/17
Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser
joshita mishra
-
2024/09/17
Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser
Sudhanshu
-
2024/09/11
ERROR: GROUP BY position 0 is not in select list , when using catalyst parser
Rommel Holmes
-
2024/09/10
[Spark Core]: Spark 3.5.0 incompatible with Embedded Kafka
Adesh Dsilva
-
2024/09/09
Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Nagatomi Yasukazu
-
2024/09/09
Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Prabodh Agarwal
-
2024/09/09
Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Nagatomi Yasukazu
-
2024/09/08
Spark 3.2.1 vs Spark 3.5.2
Stephen Coy
-
2024/09/08
[CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Nagatomi Yasukazu
-
2024/09/05
Re: Spark Thrift Server - Not Scaling Down Executors 3.4.2+
Cheng Pan
-
2024/09/05
Spark Thrift Server - Not Scaling Down Executors 3.4.2+
Jayabindu Singh
-
2024/08/30
Setting forarch microbatch processing data count in structured streaming
Karthick Nk
-
2024/08/29
Re: Question about Releases and EOL
Mich Talebzadeh
-
2024/08/29
Question about Releases and EOL
Miles Fryhover (V)
-
2024/08/27
Fwd: [ANNOUNCE] Apache Sedona 1.6.1 released
Jia Yu
-
2024/08/27
Re: unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart
Mat Schaffer
-
2024/08/26
unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart
karan alang
-
2024/08/26
Job Opportunities in India or UK with Tier 2 Sponsorship - Spark Expert
sri hari kali charan Tummala
-
2024/08/24
Re: Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/23
Re: Batch to Kafka
Rommel Holmes
-
2024/08/23
Need support for vulnerability CVE-2023-39410
Ravichandran, Abhirami
-
2024/08/23
Expected Release date for Spark 4?
Vikash Lavaniya
-
2024/08/21
Re: Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/20
Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Cheng Pan
-
2024/08/20
Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Cheng Pan
-
2024/08/20
Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Aaron Grubb
-
2024/08/19
Re: Handling load distribution and addressing data skew.
Raghavendra Ganesh
-
2024/08/19
Re: Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/19
Re: [External] Re: Redundant(?) shuffle after join
Ofir Manor
-
2024/08/19
Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Aaron Grubb
-
2024/08/18
Spark Job Fails while writing data to a S3 location in Parquet
Nipuna Shantha
-
2024/08/16
Handling load distribution and addressing data skew.
Karthick
-
2024/08/16
Re: Redundant(?) shuffle after join
Mich Talebzadeh
-
2024/08/16
Re: Redundant(?) shuffle after join
Shay Elbaz
-
2024/08/16
Issue with pyspark : Add custom shutdown hook
aarushi agarwal
-
2024/08/15
Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/15
Re: Redundant(?) shuffle after join
Mich Talebzadeh
-
2024/08/15
Redundant(?) shuffle after join
Shay Elbaz
-
2024/08/14
Re: Need help understanding tuning docs
Subhasis Mukherjee
-
2024/08/14
Need help understanding tuning docs
Sreyan Chakravarty
-
2024/08/14
[Spark Connect ] Date Data type formatting issue
Ilango
-
2024/08/12
Re: [ANNOUNCE] Apache Spark 3.5.2 released
Xiao Li
-
2024/08/12
[ANNOUNCE] Apache Spark 3.5.2 released
Kent Yao
-
2024/08/08
Re: dynamically infer json data not working as expected
Perez