user  

Messages by Date

• 2024/08/24 Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
• 2024/08/23 Re: Batch to Kafka Rommel Holmes
• 2024/08/23 Need support for vulnerability CVE-2023-39410 Ravichandran, Abhirami
• 2024/08/23 Expected Release date for Spark 4? Vikash Lavaniya
• 2024/08/21 Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
• 2024/08/20 Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Cheng Pan
• 2024/08/20 Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Cheng Pan
• 2024/08/20 Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Aaron Grubb
• 2024/08/19 Re: Handling load distribution and addressing data skew. Raghavendra Ganesh
• 2024/08/19 Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
• 2024/08/19 Re: [External] Re: Redundant(?) shuffle after join Ofir Manor
• 2024/08/19 Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Aaron Grubb
• 2024/08/18 Spark Job Fails while writing data to a S3 location in Parquet Nipuna Shantha
• 2024/08/16 Handling load distribution and addressing data skew. Karthick
• 2024/08/16 Re: Redundant(?) shuffle after join Mich Talebzadeh
• 2024/08/16 Re: Redundant(?) shuffle after join Shay Elbaz
• 2024/08/16 Issue with pyspark : Add custom shutdown hook aarushi agarwal
• 2024/08/15 Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
• 2024/08/15 Re: Redundant(?) shuffle after join Mich Talebzadeh
• 2024/08/15 Redundant(?) shuffle after join Shay Elbaz
• 2024/08/14 Re: Need help understanding tuning docs Subhasis Mukherjee
• 2024/08/14 Need help understanding tuning docs Sreyan Chakravarty
• 2024/08/14 [Spark Connect ] Date Data type formatting issue Ilango
• 2024/08/12 Re: [ANNOUNCE] Apache Spark 3.5.2 released Xiao Li
• 2024/08/12 [ANNOUNCE] Apache Spark 3.5.2 released Kent Yao
• 2024/08/08 Re: dynamically infer json data not working as expected Perez
• 2024/08/08 Re: dynamically infer json data not working as expected Perez
• 2024/08/07 Is it possible to configure batch size immutability between two `mapInPandas`? Azamat G.
• 2024/08/06 Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
• 2024/08/06 Re: [spark connect] unable to utilize stand alone cluster Ilango
• 2024/08/06 Re: Spark 3.5.0 bug - Writing a small paraquet dataframe to storage using spark 3.5.0 taking too long Bijoy Deb
• 2024/08/06 Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
• 2024/08/06 Re: [spark connect] unable to utilize stand alone cluster Ilango
• 2024/08/06 Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
• 2024/08/06 [spark connect] unable to utilize stand alone cluster Ilango
• 2024/08/06 Spark History CORS header ‘Access-Control-Allow-Origin’ missing Thomas Mauran
• 2024/08/05 Re: dynamically infer json data not working as expected Mich Talebzadeh
• 2024/08/05 Re: dynamically infer json data not working as expected Perez
• 2024/08/05 dynamically infer json data not working as expected Perez
• 2024/08/03 Feature Engineering for Data Engineers: Building Blocks for ML Success Mich Talebzadeh
• 2024/08/01 Re: [Issue] Spark SQL - broadcast failure Sudharshan V
• 2024/07/30 Error While Running Merge Statement With Iceberg PRASHANT L
• 2024/07/30 A code change for spark ui in Sql tab Donvi
• 2024/07/29 Re: [Spark Connect] connection issue Prabodh Agarwal
• 2024/07/29 Re: [Spark Connect] connection issue Ilango
• 2024/07/29 Re: Question about installing Apache Spark [PySpark] computer requirements Meena Rajani
• 2024/07/29 Re: [Spark Connect] connection issue Prabodh Agarwal
• 2024/07/29 Re: Question about installing Apache Spark [PySpark] computer requirements Sadha Chilukoori
• 2024/07/29 Re: Question about installing Apache Spark [PySpark] computer requirements mike Jadoo
• 2024/07/29 Re: Question about installing Apache Spark [PySpark] computer requirements Sadha Chilukoori
• 2024/07/29 Re: [Spark Connect] connection issue Ilango
• 2024/07/29 Question about installing Apache Spark [PySpark] computer requirements mike Jadoo
• 2024/07/29 [ANNOUNCE] Apache Celeborn 0.5.1 available Ethan Feng
• 2024/07/29 Re: [Spark Connect] connection issue Prabodh Agarwal
• 2024/07/29 [ANNOUNCE] Apache Celeborn 0.4.2 available Fu Chen
• 2024/07/29 [Spark Connect] connection issue Ilango
• 2024/07/26 Issue with comparing structs (possible bug) Dhruv Singla
• 2024/07/26 Re: Issue with comparing structs (possible bug) Dhruv Singla
• 2024/07/23 [ANNOUNCE] Apache Kyuubi v1.9.2 is available Fu Chen
• 2024/07/23 Re: [Issue] Spark SQL - broadcast failure Sudharshan V
• 2024/07/23 Re: [Issue] Spark SQL - broadcast failure Sudharshan V
• 2024/07/22 [Spark SQL]: Why the OptimizeSkewedJoin rule does not optimize FullOuterJoin? 王仲轩(万章)
• 2024/07/20 Re: issue forwarding SPARK_CONF_DIR to start workers Holden Karau
• 2024/07/20 Re: issue forwarding SPARK_CONF_DIR to start workers Patrice Duroux
• 2024/07/19 [spark connect] issue in testing spark connect Ilango
• 2024/07/18 Error on Spark history UI api when used with Apache Knox thomas.mau...@etu.umontpellier.fr.INVALID
• 2024/07/18 problem using spark 3.4 with spots wafa gabouj
• 2024/07/16 Re: [Issue] Spark SQL - broadcast failure Meena Rajani
• 2024/07/16 Re: [Issue] Spark SQL - broadcast failure Mich Talebzadeh
• 2024/07/12 binary stream Jeff Pang
• 2024/07/12 heap fragmentation in G1 aka.fe2s
• 2024/07/12 Re: Help wanted on securing spark with Apache Knox / JWT Adam Binford
• 2024/07/11 Help wanted on securing spark with Apache Knox / JWT Thomas Mauran
• 2024/07/08 Sometimes TaskContext configuration is almost empty Asaf Mesika
• 2024/07/08 [Issue] Spark SQL - broadcast failure Sudharshan V
• 2024/07/07 running snowflake query using spark connect on a standalone cluster Prabodh Agarwal
• 2024/07/04 Need help to confirm vulnerable issue Will.Qin
• 2024/07/02 Assistance needed with PySpark Streaming for retrieving past messages. Mai Trang
• 2024/06/30 How to use spark.connect.Plan from dependency in a custom Spark Connect RelationPlugin? Sem
• 2024/06/26 AWS Glue and Python Perez
• 2024/06/26 Does Spark 4.0 add Sparkstreaming SQL ????
• 2024/06/25 log4j2.properties file load fails when upgrading from 3.3.0 to 3.5.1 Edgar H
• 2024/06/24 Help Needed: Distributed Logging in Spark Application Zsuzsanna D
• 2024/06/23 Re: AttributeError: 'MulticlassMetrics' object has no attribute '_sc' Saurabh Kumar
• 2024/06/23 AttributeError: 'MulticlassMetrics' object has no attribute '_sc' Azhuvath, RajeevX
• 2024/06/21 Pyspark DataFrame.drop wrong type hints Oliver Beagley
• 2024/06/21 Pyspark DataFrame.drop wrong type hints Oliver Beagley
• 2024/06/20 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/06/20 Re: Spark Decommission Rajesh Mahindra
• 2024/06/20 Re: Help in understanding Exchange in Spark UI Mich Talebzadeh
• 2024/06/20 Help in understanding Exchange in Spark UI Dhruv Singla
• 2024/06/19 Re: [SPARK-48423] Unable to save ML Pipeline to azure blob storage Chhavi Bansal
• 2024/06/19 Re: Spark Decommission Khaldi, Ahmed
• 2024/06/18 Spark Decommission Rajesh Mahindra
• 2024/06/17 [K8S] Divergense in dockerfiles between official repositories. Andrei L
• 2024/06/15 Re: Update mode in spark structured streaming Mich Talebzadeh
• 2024/06/14 Update mode in spark structured streaming Om Prakash
• 2024/06/11 Re: Re: OOM issue in Spark Driver Mich Talebzadeh
• 2024/06/10 Re: Do we need partitioning while loading data from JDBC sources? Gourav Sengupta
• 2024/06/09 Re: Unable to load MongoDB atlas data via PySpark because of BsonString error Perez
• 2024/06/08 Unable to load MongoDB atlas data via PySpark because of BsonString error Perez
• 2024/06/08 Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Someshwar Kale
• 2024/06/08 Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Chhavi Bansal
• 2024/06/08 Re: OOM issue in Spark Driver Andrzej Zera
• 2024/06/07 OOM issue in Spark Driver Karthick Nk
• 2024/06/07 Re: 7368396 - Apache Spark 3.5.1 (Support) Sadha Chilukoori
• 2024/06/06 Re: Kubernetes cluster: change log4j configuration using uploaded `--files` Mich Talebzadeh
• 2024/06/06 7368396 - Apache Spark 3.5.1 (Support) SANTOS SOUZA, ALEX
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/06 Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Someshwar Kale
• 2024/06/06 Kubernetes cluster: change log4j configuration using uploaded `--files` Jennifer Wirth
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Mich Talebzadeh
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Mich Talebzadeh
• 2024/06/05 [SPARK-48423] Unable to save ML Pipeline to azure blob storage Chhavi Bansal
• 2024/06/05 [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Chhavi Bansal
• 2024/06/05 Re: Terabytes data processing via Glue Perez
• 2024/06/05 Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/05 Inquiry Regarding Security Compliance of Apache Spark Docker Image Tonmoy Sagar
• 2024/06/04 Re: Classification request Dirk-Willem van Gulik
• 2024/06/04 Re: Classification request Artemis User
• 2024/06/04 Classification request VARGA, Sara
• 2024/06/03 [ANNOUNCE] Announcing Apache Spark 4.0.0-preview1 Wenchen Fan
• 2024/06/03 Re: Terabytes data processing via Glue Russell Jurney
• 2024/06/02 Re: Terabytes data processing via Glue Perez
• 2024/06/02 [ANNOUNCE] Apache Kyuubi released 1.9.1 Cheng Pan
• 2024/06/01 Terabytes data processing via Glue Perez
• 2024/05/31 [apache-spark][spark-dataframe] DataFrameWriter.partitionBy does not guarantee previous sort result leeyc0
• 2024/05/31 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/31 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/30 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way Subhasis Mukherjee
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/29 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/29 [Spark on k8s] A issue of k8s resource creation order Tao Yang
• 2024/05/28 Tox and Pyspark Perez
• 2024/05/28 Re: OOM concern Perez
• 2024/05/28 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way Gera Shegalov
• 2024/05/28 Re: OOM concern Russell Jurney
• 2024/05/28 Re: OOM concern Mich Talebzadeh
• 2024/05/28 Re: OOM concern Perez
• 2024/05/28 Re: OOM concern Mich Talebzadeh
• 2024/05/27 Re: OOM concern Perez
• 2024/05/27 Re: Spark Protobuf Deserialization Sandish Kumar HN
• 2024/05/27 Re: OOM concern Russell Jurney
• 2024/05/27 Re: OOM concern Meena Rajani
• 2024/05/27 Re: [Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming? Mich Talebzadeh
• 2024/05/27 Spark Protobuf Deserialization Satyam Raj
• 2024/05/27 [Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming? Juan Casse
• 2024/05/27 OOM concern Perez
• 2024/05/27 Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing Shay Elbaz
• 2024/05/27 Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing Mich Talebzadeh
• 2024/05/27 Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing Gaurav Madan
• 2024/05/26 Re: BUG :: UI Spark Mich Talebzadeh
• 2024/05/26 Re: BUG :: UI Spark Mich Talebzadeh
• 2024/05/26 Re: BUG :: UI Spark Mich Talebzadeh
• 2024/05/26 Re: BUG :: UI Spark Sathi Chowdhury
• 2024/05/26 Re: BUG :: UI Spark Prem Sahoo
• 2024/05/24 Re: Can Spark Catalog Perform Multimodal Database Query Analysis Mich Talebzadeh
• 2024/05/24 Can Spark Catalog Perform Multimodal Database Query Analysis ????
• 2024/05/24 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/23 Re: BUG :: UI Spark Prem Sahoo
• 2024/05/23 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/23 BUG :: UI Spark Prem Sahoo
• 2024/05/23 [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Mich Talebzadeh
• 2024/05/22 Remote File change detection in S3 when spark queries are running and parquet files in S3 changes Raghvendra Yadav
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Mich Talebzadeh
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Tathagata Das
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Tathagata Das
• 2024/05/22 [ANNOUNCE] Apache Celeborn 0.4.1 available Nicholas Jiang
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Mich Talebzadeh
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming ashok34...@yahoo.com.INVALID
• 2024/05/21 Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/21 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way Prem Sahoo
• 2024/05/21 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way eab...@163.com
• 2024/05/21 Re: A handy tool called spark-column-analyser ashok34...@yahoo.com.INVALID
• 2024/05/21 Re: A handy tool called spark-column-analyser Mich Talebzadeh
• 2024/05/21 Re: EXT: Dual Write to HDFS and MinIO in faster way Prem Sahoo
• 2024/05/21 A handy tool called spark-column-analyser Mich Talebzadeh
• 2024/05/16 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/16 Request for Assistance: Adding User Authentication to Apache Spark Application NIKHIL RAJ SHRIVASTAVA
• 2024/05/15 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/15 How to provide a Zstd "training mode" dictionary object Saha, Daniel
• 2024/05/15 Query Regarding UDF Support in Spark Connect with Kubernetes as Cluster Manager Nagatomi Yasukazu
• 2024/05/14 Re: pyspark dataframe join with two different data type Mich Talebzadeh
• 2024/05/14 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/11 Display a warning in EMR welcome screen Abhishek Basu
• 2024/05/11 Re: [spark-graphframes]: Generating incorrect edges Nijland, J.G.W. (Jelle, Student M-CS)
• 2024/05/10 unsubscribe J UDAY KIRAN
• 2024/05/10 Re: pyspark dataframe join with two different data type Damien Hawes
• 2024/05/10 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/08 Spark 3.5.x on Java 21? Stephen Coy
• 2024/05/08 Re: [Spark Streaming]: Save the records that are dropped by watermarking in spark structured streaming Mich Talebzadeh
• 2024/05/07 Spark not creating staging dir for insertInto partitioned table Sanskar Modi

• Earlier messages
• Later messages