user
Thread
Date
Earlier messages
Later messages
Messages by Date
2024/08/12
[ANNOUNCE] Apache Spark 3.5.2 released
Kent Yao
2024/08/08
Re: dynamically infer json data not working as expected
Perez
2024/08/08
Re: dynamically infer json data not working as expected
Perez
2024/08/07
Is it possible to configure batch size immutability between two `mapInPandas`?
Azamat G.
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Prabodh Agarwal
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Ilango
2024/08/06
Re: Spark 3.5.0 bug - Writing a small paraquet dataframe to storage using spark 3.5.0 taking too long
Bijoy Deb
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Prabodh Agarwal
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Ilango
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Prabodh Agarwal
2024/08/06
[spark connect] unable to utilize stand alone cluster
Ilango
2024/08/06
Spark History CORS header ‘Access-Control-Allow-Origin’ missing
Thomas Mauran
2024/08/05
Re: dynamically infer json data not working as expected
Mich Talebzadeh
2024/08/05
Re: dynamically infer json data not working as expected
Perez
2024/08/05
dynamically infer json data not working as expected
Perez
2024/08/03
Feature Engineering for Data Engineers: Building Blocks for ML Success
Mich Talebzadeh
2024/08/01
Re: [Issue] Spark SQL - broadcast failure
Sudharshan V
2024/07/30
Error While Running Merge Statement With Iceberg
PRASHANT L
2024/07/30
A code change for spark ui in Sql tab
Donvi
2024/07/29
Re: [Spark Connect] connection issue
Prabodh Agarwal
2024/07/29
Re: [Spark Connect] connection issue
Ilango
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
Meena Rajani
2024/07/29
Re: [Spark Connect] connection issue
Prabodh Agarwal
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
Sadha Chilukoori
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
mike Jadoo
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
Sadha Chilukoori
2024/07/29
Re: [Spark Connect] connection issue
Ilango
2024/07/29
Question about installing Apache Spark [PySpark] computer requirements
mike Jadoo
2024/07/29
[ANNOUNCE] Apache Celeborn 0.5.1 available
Ethan Feng
2024/07/29
Re: [Spark Connect] connection issue
Prabodh Agarwal
2024/07/29
[ANNOUNCE] Apache Celeborn 0.4.2 available
Fu Chen
2024/07/29
[Spark Connect] connection issue
Ilango
2024/07/26
Issue with comparing structs (possible bug)
Dhruv Singla
2024/07/26
Re: Issue with comparing structs (possible bug)
Dhruv Singla
2024/07/23
[ANNOUNCE] Apache Kyuubi v1.9.2 is available
Fu Chen
2024/07/23
Re: [Issue] Spark SQL - broadcast failure
Sudharshan V
2024/07/23
Re: [Issue] Spark SQL - broadcast failure
Sudharshan V
2024/07/22
[Spark SQL]: Why the OptimizeSkewedJoin rule does not optimize FullOuterJoin?
王仲轩(万章)
2024/07/20
Re: issue forwarding SPARK_CONF_DIR to start workers
Holden Karau
2024/07/20
Re: issue forwarding SPARK_CONF_DIR to start workers
Patrice Duroux
2024/07/19
[spark connect] issue in testing spark connect
Ilango
2024/07/18
Error on Spark history UI api when used with Apache Knox
thomas.mau...@etu.umontpellier.fr.INVALID
2024/07/18
problem using spark 3.4 with spots
wafa gabouj
2024/07/16
Re: [Issue] Spark SQL - broadcast failure
Meena Rajani
2024/07/16
Re: [Issue] Spark SQL - broadcast failure
Mich Talebzadeh
2024/07/12
binary stream
Jeff Pang
2024/07/12
heap fragmentation in G1
aka.fe2s
2024/07/12
Re: Help wanted on securing spark with Apache Knox / JWT
Adam Binford
2024/07/11
Help wanted on securing spark with Apache Knox / JWT
Thomas Mauran
2024/07/08
Sometimes TaskContext configuration is almost empty
Asaf Mesika
2024/07/08
[Issue] Spark SQL - broadcast failure
Sudharshan V
2024/07/07
running snowflake query using spark connect on a standalone cluster
Prabodh Agarwal
2024/07/04
Need help to confirm vulnerable issue
Will.Qin
2024/07/02
Assistance needed with PySpark Streaming for retrieving past messages.
Mai Trang
2024/06/30
How to use spark.connect.Plan from dependency in a custom Spark Connect RelationPlugin?
Sem
2024/06/26
AWS Glue and Python
Perez
2024/06/26
Does Spark 4.0 add Sparkstreaming SQL
????
2024/06/25
log4j2.properties file load fails when upgrading from 3.3.0 to 3.5.1
Edgar H
2024/06/24
Help Needed: Distributed Logging in Spark Application
Zsuzsanna D
2024/06/23
Re: AttributeError: 'MulticlassMetrics' object has no attribute '_sc'
Saurabh Kumar
2024/06/23
AttributeError: 'MulticlassMetrics' object has no attribute '_sc'
Azhuvath, RajeevX
2024/06/21
Pyspark DataFrame.drop wrong type hints
Oliver Beagley
2024/06/21
Pyspark DataFrame.drop wrong type hints
Oliver Beagley
2024/06/20
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Anil Dasari
2024/06/20
Re: Spark Decommission
Rajesh Mahindra
2024/06/20
Re: Help in understanding Exchange in Spark UI
Mich Talebzadeh
2024/06/20
Help in understanding Exchange in Spark UI
Dhruv Singla
2024/06/19
Re: [SPARK-48423] Unable to save ML Pipeline to azure blob storage
Chhavi Bansal
2024/06/19
Re: Spark Decommission
Khaldi, Ahmed
2024/06/18
Spark Decommission
Rajesh Mahindra
2024/06/17
[K8S] Divergense in dockerfiles between official repositories.
Andrei L
2024/06/15
Re: Update mode in spark structured streaming
Mich Talebzadeh
2024/06/14
Update mode in spark structured streaming
Om Prakash
2024/06/11
Re: Re: OOM issue in Spark Driver
Mich Talebzadeh
2024/06/10
Re: Do we need partitioning while loading data from JDBC sources?
Gourav Sengupta
2024/06/09
Re: Unable to load MongoDB atlas data via PySpark because of BsonString error
Perez
2024/06/08
Unable to load MongoDB atlas data via PySpark because of BsonString error
Perez
2024/06/08
Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Someshwar Kale
2024/06/08
Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Chhavi Bansal
2024/06/08
Re: OOM issue in Spark Driver
Andrzej Zera
2024/06/07
OOM issue in Spark Driver
Karthick Nk
2024/06/07
Re: 7368396 - Apache Spark 3.5.1 (Support)
Sadha Chilukoori
2024/06/06
Re: Kubernetes cluster: change log4j configuration using uploaded `--files`
Mich Talebzadeh
2024/06/06
7368396 - Apache Spark 3.5.1 (Support)
SANTOS SOUZA, ALEX
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Perez
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Perez
2024/06/06
Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Someshwar Kale
2024/06/06
Kubernetes cluster: change log4j configuration using uploaded `--files`
Jennifer Wirth
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Mich Talebzadeh
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Perez
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Mich Talebzadeh
2024/06/05
[SPARK-48423] Unable to save ML Pipeline to azure blob storage
Chhavi Bansal
2024/06/05
[SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Chhavi Bansal
2024/06/05
Re: Terabytes data processing via Glue
Perez
2024/06/05
Do we need partitioning while loading data from JDBC sources?
Perez
2024/06/05
Inquiry Regarding Security Compliance of Apache Spark Docker Image
Tonmoy Sagar
2024/06/04
Re: Classification request
Dirk-Willem van Gulik
2024/06/04
Re: Classification request
Artemis User
2024/06/04
Classification request
VARGA, Sara
2024/06/03
[ANNOUNCE] Announcing Apache Spark 4.0.0-preview1
Wenchen Fan
2024/06/03
Re: Terabytes data processing via Glue
Russell Jurney
2024/06/02
Re: Terabytes data processing via Glue
Perez
2024/06/02
[ANNOUNCE] Apache Kyuubi released 1.9.1
Cheng Pan
2024/06/01
Terabytes data processing via Glue
Perez
2024/05/31
[apache-spark][spark-dataframe] DataFrameWriter.partitionBy does not guarantee previous sort result
leeyc0
2024/05/31
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
2024/05/31
Re: [s3a] Spark is not reading s3 object content
Mich Talebzadeh
2024/05/30
Re: Re: EXT: Dual Write to HDFS and MinIO in faster way
Subhasis Mukherjee
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Mich Talebzadeh
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Mich Talebzadeh
2024/05/29
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
2024/05/29
[Spark on k8s] A issue of k8s resource creation order
Tao Yang
2024/05/28
Tox and Pyspark
Perez
2024/05/28
Re: OOM concern
Perez
2024/05/28
Re: Re: EXT: Dual Write to HDFS and MinIO in faster way
Gera Shegalov
2024/05/28
Re: OOM concern
Russell Jurney
2024/05/28
Re: OOM concern
Mich Talebzadeh
2024/05/28
Re: OOM concern
Perez
2024/05/28
Re: OOM concern
Mich Talebzadeh
2024/05/27
Re: OOM concern
Perez
2024/05/27
Re: Spark Protobuf Deserialization
Sandish Kumar HN
2024/05/27
Re: OOM concern
Russell Jurney
2024/05/27
Re: OOM concern
Meena Rajani
2024/05/27
Re: [Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming?
Mich Talebzadeh
2024/05/27
Spark Protobuf Deserialization
Satyam Raj
2024/05/27
[Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming?
Juan Casse
2024/05/27
OOM concern
Perez
2024/05/27
Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing
Shay Elbaz
2024/05/27
Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing
Mich Talebzadeh
2024/05/27
Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing
Gaurav Madan
2024/05/26
Re: BUG :: UI Spark
Mich Talebzadeh
2024/05/26
Re: BUG :: UI Spark
Mich Talebzadeh
2024/05/26
Re: BUG :: UI Spark
Mich Talebzadeh
2024/05/26
Re: BUG :: UI Spark
Sathi Chowdhury
2024/05/26
Re: BUG :: UI Spark
Prem Sahoo
2024/05/24
Re: Can Spark Catalog Perform Multimodal Database Query Analysis
Mich Talebzadeh
2024/05/24
Can Spark Catalog Perform Multimodal Database Query Analysis
????
2024/05/24
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Anil Dasari
2024/05/23
Re: BUG :: UI Spark
Prem Sahoo
2024/05/23
Re: [s3a] Spark is not reading s3 object content
Mich Talebzadeh
2024/05/23
BUG :: UI Spark
Prem Sahoo
2024/05/23
[s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Anil Dasari
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Mich Talebzadeh
2024/05/22
Remote File change detection in S3 when spark queries are running and parquet files in S3 changes
Raghvendra Yadav
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Mich Talebzadeh
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Tathagata Das
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Anil Dasari
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Tathagata Das
2024/05/22
[ANNOUNCE] Apache Celeborn 0.4.1 available
Nicholas Jiang
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Mich Talebzadeh
2024/05/22
Re: Dstream HasOffsetRanges equivalent in Structured streaming
ashok34...@yahoo.com.INVALID
2024/05/21
Dstream HasOffsetRanges equivalent in Structured streaming
Anil Dasari
2024/05/21
Re: Re: EXT: Dual Write to HDFS and MinIO in faster way
Prem Sahoo
2024/05/21
Re: Re: EXT: Dual Write to HDFS and MinIO in faster way
eab...@163.com
2024/05/21
Re: A handy tool called spark-column-analyser
ashok34...@yahoo.com.INVALID
2024/05/21
Re: A handy tool called spark-column-analyser
Mich Talebzadeh
2024/05/21
Re: EXT: Dual Write to HDFS and MinIO in faster way
Prem Sahoo
2024/05/21
A handy tool called spark-column-analyser
Mich Talebzadeh
2024/05/16
Re: pyspark dataframe join with two different data type
Karthick Nk
2024/05/16
Request for Assistance: Adding User Authentication to Apache Spark Application
NIKHIL RAJ SHRIVASTAVA
2024/05/15
Re: pyspark dataframe join with two different data type
Karthick Nk
2024/05/15
How to provide a Zstd "training mode" dictionary object
Saha, Daniel
2024/05/15
Query Regarding UDF Support in Spark Connect with Kubernetes as Cluster Manager
Nagatomi Yasukazu
2024/05/14
Re: pyspark dataframe join with two different data type
Mich Talebzadeh
2024/05/14
Re: pyspark dataframe join with two different data type
Karthick Nk
2024/05/11
Display a warning in EMR welcome screen
Abhishek Basu
2024/05/11
Re: [spark-graphframes]: Generating incorrect edges
Nijland, J.G.W. (Jelle, Student M-CS)
2024/05/10
unsubscribe
J UDAY KIRAN
2024/05/10
Re: pyspark dataframe join with two different data type
Damien Hawes
2024/05/10
Re: pyspark dataframe join with two different data type
Karthick Nk
2024/05/08
Spark 3.5.x on Java 21?
Stephen Coy
2024/05/08
Re: [Spark Streaming]: Save the records that are dropped by watermarking in spark structured streaming
Mich Talebzadeh
2024/05/07
Spark not creating staging dir for insertInto partitioned table
Sanskar Modi
2024/05/07
[Spark Streaming]: Save the records that are dropped by watermarking in spark structured streaming
Nandha Kumar
2024/05/07
unsubscribe
Wojciech Bombik
2024/05/06
unsubscribe
Moise
2024/05/06
Re: ********Spark streaming issue to Elastic data**********
Mich Talebzadeh
2024/05/05
Re: ********Spark streaming issue to Elastic data**********
Karthick Nk
2024/05/04
unsubscribe
chen...@birdiexx.com
2024/05/03
unsubscribe
Bing
2024/05/03
Spark Materialized Views: Improve Query Performance and Data Management
Mich Talebzadeh
2024/05/03
Re: Issue with Materialized Views in Spark SQL
Mich Talebzadeh
2024/05/03
Help needed optimize spark history server performance
Vikas Tharyani
2024/05/03
Re: ********Spark streaming issue to Elastic data**********
Mich Talebzadeh
2024/05/03
Re: Issue with Materialized Views in Spark SQL
Mich Talebzadeh
2024/05/02
Re: Issue with Materialized Views in Spark SQL
Jungtaek Lim
2024/05/02
Re: Issue with Materialized Views in Spark SQL
Walaa Eldin Moustafa
2024/05/02
Issue with Materialized Views in Spark SQL
Mich Talebzadeh
2024/05/02
********Spark streaming issue to Elastic data**********
Karthick Nk
2024/05/01
unsubscribe
Nebi Aydin
2024/05/01
unsubscribe
Atakala Selam
2024/05/01
unsubscribe
Yoel Benharrous
2024/05/01
Traceback is missing content in pyspark when invoked with UDF
Indivar Mishra
2024/05/01
Re: [spark-graphframes]: Generating incorrect edges
Mich Talebzadeh
2024/04/30
Re: [spark-graphframes]: Generating incorrect edges
Stephen Coy
2024/04/30
unsubscribe
Wood Super
2024/04/30
unsubscribe
junhua . xie
Earlier messages
Later messages