user  

Messages by Date

• 2024/07/20 Re: issue forwarding SPARK_CONF_DIR to start workers Holden Karau
• 2024/07/20 Re: issue forwarding SPARK_CONF_DIR to start workers Patrice Duroux
• 2024/07/19 [spark connect] issue in testing spark connect Ilango
• 2024/07/18 Error on Spark history UI api when used with Apache Knox thomas.mau...@etu.umontpellier.fr.INVALID
• 2024/07/18 problem using spark 3.4 with spots wafa gabouj
• 2024/07/16 Re: [Issue] Spark SQL - broadcast failure Meena Rajani
• 2024/07/16 Re: [Issue] Spark SQL - broadcast failure Mich Talebzadeh
• 2024/07/12 binary stream Jeff Pang
• 2024/07/12 heap fragmentation in G1 aka.fe2s
• 2024/07/12 Re: Help wanted on securing spark with Apache Knox / JWT Adam Binford
• 2024/07/11 Help wanted on securing spark with Apache Knox / JWT Thomas Mauran
• 2024/07/08 Sometimes TaskContext configuration is almost empty Asaf Mesika
• 2024/07/08 [Issue] Spark SQL - broadcast failure Sudharshan V
• 2024/07/07 running snowflake query using spark connect on a standalone cluster Prabodh Agarwal
• 2024/07/04 Need help to confirm vulnerable issue Will.Qin
• 2024/07/02 Assistance needed with PySpark Streaming for retrieving past messages. Mai Trang
• 2024/06/30 How to use spark.connect.Plan from dependency in a custom Spark Connect RelationPlugin? Sem
• 2024/06/26 AWS Glue and Python Perez
• 2024/06/26 Does Spark 4.0 add Sparkstreaming SQL ????
• 2024/06/25 log4j2.properties file load fails when upgrading from 3.3.0 to 3.5.1 Edgar H
• 2024/06/24 Help Needed: Distributed Logging in Spark Application Zsuzsanna D
• 2024/06/23 Re: AttributeError: 'MulticlassMetrics' object has no attribute '_sc' Saurabh Kumar
• 2024/06/23 AttributeError: 'MulticlassMetrics' object has no attribute '_sc' Azhuvath, RajeevX
• 2024/06/21 Pyspark DataFrame.drop wrong type hints Oliver Beagley
• 2024/06/21 Pyspark DataFrame.drop wrong type hints Oliver Beagley
• 2024/06/20 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/06/20 Re: Spark Decommission Rajesh Mahindra
• 2024/06/20 Re: Help in understanding Exchange in Spark UI Mich Talebzadeh
• 2024/06/20 Help in understanding Exchange in Spark UI Dhruv Singla
• 2024/06/19 Re: [SPARK-48423] Unable to save ML Pipeline to azure blob storage Chhavi Bansal
• 2024/06/19 Re: Spark Decommission Khaldi, Ahmed
• 2024/06/18 Spark Decommission Rajesh Mahindra
• 2024/06/17 [K8S] Divergense in dockerfiles between official repositories. Andrei L
• 2024/06/15 Re: Update mode in spark structured streaming Mich Talebzadeh
• 2024/06/14 Update mode in spark structured streaming Om Prakash
• 2024/06/11 Re: Re: OOM issue in Spark Driver Mich Talebzadeh
• 2024/06/10 Re: Do we need partitioning while loading data from JDBC sources? Gourav Sengupta
• 2024/06/09 Re: Unable to load MongoDB atlas data via PySpark because of BsonString error Perez
• 2024/06/08 Unable to load MongoDB atlas data via PySpark because of BsonString error Perez
• 2024/06/08 Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Someshwar Kale
• 2024/06/08 Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Chhavi Bansal
• 2024/06/08 Re: OOM issue in Spark Driver Andrzej Zera
• 2024/06/07 OOM issue in Spark Driver Karthick Nk
• 2024/06/07 Re: 7368396 - Apache Spark 3.5.1 (Support) Sadha Chilukoori
• 2024/06/06 Re: Kubernetes cluster: change log4j configuration using uploaded `--files` Mich Talebzadeh
• 2024/06/06 7368396 - Apache Spark 3.5.1 (Support) SANTOS SOUZA, ALEX
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/06 Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Someshwar Kale
• 2024/06/06 Kubernetes cluster: change log4j configuration using uploaded `--files` Jennifer Wirth
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Mich Talebzadeh
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/06 Re: Do we need partitioning while loading data from JDBC sources? Mich Talebzadeh
• 2024/06/05 [SPARK-48423] Unable to save ML Pipeline to azure blob storage Chhavi Bansal
• 2024/06/05 [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation) Chhavi Bansal
• 2024/06/05 Re: Terabytes data processing via Glue Perez
• 2024/06/05 Do we need partitioning while loading data from JDBC sources? Perez
• 2024/06/05 Inquiry Regarding Security Compliance of Apache Spark Docker Image Tonmoy Sagar
• 2024/06/04 Re: Classification request Dirk-Willem van Gulik
• 2024/06/04 Re: Classification request Artemis User
• 2024/06/04 Classification request VARGA, Sara
• 2024/06/03 [ANNOUNCE] Announcing Apache Spark 4.0.0-preview1 Wenchen Fan
• 2024/06/03 Re: Terabytes data processing via Glue Russell Jurney
• 2024/06/02 Re: Terabytes data processing via Glue Perez
• 2024/06/02 [ANNOUNCE] Apache Kyuubi released 1.9.1 Cheng Pan
• 2024/06/01 Terabytes data processing via Glue Perez
• 2024/05/31 [apache-spark][spark-dataframe] DataFrameWriter.partitionBy does not guarantee previous sort result leeyc0
• 2024/05/31 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/31 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/30 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way Subhasis Mukherjee
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/30 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/29 Re: [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/29 [Spark on k8s] A issue of k8s resource creation order Tao Yang
• 2024/05/28 Tox and Pyspark Perez
• 2024/05/28 Re: OOM concern Perez
• 2024/05/28 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way Gera Shegalov
• 2024/05/28 Re: OOM concern Russell Jurney
• 2024/05/28 Re: OOM concern Mich Talebzadeh
• 2024/05/28 Re: OOM concern Perez
• 2024/05/28 Re: OOM concern Mich Talebzadeh
• 2024/05/27 Re: OOM concern Perez
• 2024/05/27 Re: Spark Protobuf Deserialization Sandish Kumar HN
• 2024/05/27 Re: OOM concern Russell Jurney
• 2024/05/27 Re: OOM concern Meena Rajani
• 2024/05/27 Re: [Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming? Mich Talebzadeh
• 2024/05/27 Spark Protobuf Deserialization Satyam Raj
• 2024/05/27 [Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming? Juan Casse
• 2024/05/27 OOM concern Perez
• 2024/05/27 Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing Shay Elbaz
• 2024/05/27 Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing Mich Talebzadeh
• 2024/05/27 Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing Gaurav Madan
• 2024/05/26 Re: BUG :: UI Spark Mich Talebzadeh
• 2024/05/26 Re: BUG :: UI Spark Mich Talebzadeh
• 2024/05/26 Re: BUG :: UI Spark Mich Talebzadeh
• 2024/05/26 Re: BUG :: UI Spark Sathi Chowdhury
• 2024/05/26 Re: BUG :: UI Spark Prem Sahoo
• 2024/05/24 Re: Can Spark Catalog Perform Multimodal Database Query Analysis Mich Talebzadeh
• 2024/05/24 Can Spark Catalog Perform Multimodal Database Query Analysis ????
• 2024/05/24 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/23 Re: BUG :: UI Spark Prem Sahoo
• 2024/05/23 Re: [s3a] Spark is not reading s3 object content Mich Talebzadeh
• 2024/05/23 BUG :: UI Spark Prem Sahoo
• 2024/05/23 [s3a] Spark is not reading s3 object content Amin Mosayyebzadeh
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Mich Talebzadeh
• 2024/05/22 Remote File change detection in S3 when spark queries are running and parquet files in S3 changes Raghvendra Yadav
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Mich Talebzadeh
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Tathagata Das
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Tathagata Das
• 2024/05/22 [ANNOUNCE] Apache Celeborn 0.4.1 available Nicholas Jiang
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming Mich Talebzadeh
• 2024/05/22 Re: Dstream HasOffsetRanges equivalent in Structured streaming ashok34...@yahoo.com.INVALID
• 2024/05/21 Dstream HasOffsetRanges equivalent in Structured streaming Anil Dasari
• 2024/05/21 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way Prem Sahoo
• 2024/05/21 Re: Re: EXT: Dual Write to HDFS and MinIO in faster way eab...@163.com
• 2024/05/21 Re: A handy tool called spark-column-analyser ashok34...@yahoo.com.INVALID
• 2024/05/21 Re: A handy tool called spark-column-analyser Mich Talebzadeh
• 2024/05/21 Re: EXT: Dual Write to HDFS and MinIO in faster way Prem Sahoo
• 2024/05/21 A handy tool called spark-column-analyser Mich Talebzadeh
• 2024/05/16 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/16 Request for Assistance: Adding User Authentication to Apache Spark Application NIKHIL RAJ SHRIVASTAVA
• 2024/05/15 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/15 How to provide a Zstd "training mode" dictionary object Saha, Daniel
• 2024/05/15 Query Regarding UDF Support in Spark Connect with Kubernetes as Cluster Manager Nagatomi Yasukazu
• 2024/05/14 Re: pyspark dataframe join with two different data type Mich Talebzadeh
• 2024/05/14 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/11 Display a warning in EMR welcome screen Abhishek Basu
• 2024/05/11 Re: [spark-graphframes]: Generating incorrect edges Nijland, J.G.W. (Jelle, Student M-CS)
• 2024/05/10 unsubscribe J UDAY KIRAN
• 2024/05/10 Re: pyspark dataframe join with two different data type Damien Hawes
• 2024/05/10 Re: pyspark dataframe join with two different data type Karthick Nk
• 2024/05/08 Spark 3.5.x on Java 21? Stephen Coy
• 2024/05/08 Re: [Spark Streaming]: Save the records that are dropped by watermarking in spark structured streaming Mich Talebzadeh
• 2024/05/07 Spark not creating staging dir for insertInto partitioned table Sanskar Modi
• 2024/05/07 [Spark Streaming]: Save the records that are dropped by watermarking in spark structured streaming Nandha Kumar
• 2024/05/07 unsubscribe Wojciech Bombik
• 2024/05/06 unsubscribe Moise
• 2024/05/06 Re: ********Spark streaming issue to Elastic data********** Mich Talebzadeh
• 2024/05/05 Re: ********Spark streaming issue to Elastic data********** Karthick Nk
• 2024/05/04 unsubscribe chen...@birdiexx.com
• 2024/05/03 unsubscribe Bing
• 2024/05/03 Spark Materialized Views: Improve Query Performance and Data Management Mich Talebzadeh
• 2024/05/03 Re: Issue with Materialized Views in Spark SQL Mich Talebzadeh
• 2024/05/03 Help needed optimize spark history server performance Vikas Tharyani
• 2024/05/03 Re: ********Spark streaming issue to Elastic data********** Mich Talebzadeh
• 2024/05/03 Re: Issue with Materialized Views in Spark SQL Mich Talebzadeh
• 2024/05/02 Re: Issue with Materialized Views in Spark SQL Jungtaek Lim
• 2024/05/02 Re: Issue with Materialized Views in Spark SQL Walaa Eldin Moustafa
• 2024/05/02 Issue with Materialized Views in Spark SQL Mich Talebzadeh
• 2024/05/02 ********Spark streaming issue to Elastic data********** Karthick Nk
• 2024/05/01 unsubscribe Nebi Aydin
• 2024/05/01 unsubscribe Atakala Selam
• 2024/05/01 unsubscribe Yoel Benharrous
• 2024/05/01 Traceback is missing content in pyspark when invoked with UDF Indivar Mishra
• 2024/05/01 Re: [spark-graphframes]: Generating incorrect edges Mich Talebzadeh
• 2024/04/30 Re: [spark-graphframes]: Generating incorrect edges Stephen Coy
• 2024/04/30 unsubscribe Wood Super
• 2024/04/30 unsubscribe junhua . xie
• 2024/04/30 unsubscribe Yoel Benharrous
• 2024/04/30 Re: spark.sql.shuffle.partitions=auto Mich Talebzadeh
• 2024/04/30 Re: Spark on Kubernetes Mich Talebzadeh
• 2024/04/30 spark.sql.shuffle.partitions=auto second_co...@yahoo.com.INVALID
• 2024/04/29 Spark on Kubernetes Tarun raghav
• 2024/04/28 Re: Python for the kids and now PySpark Meena Rajani
• 2024/04/27 Re: Python for the kids and now PySpark Farshid Ashouri
• 2024/04/26 [Release Question]: Estimate on 3.5.2 release? Paul Gerver
• 2024/04/26 [SparkListener] Accessing classes loaded via the '--packages' option Damien Hawes
• 2024/04/25 unsubscribe Code Tutelage
• 2024/04/25 Re:RE: How to add MaxDOP option in spark mssql JDBC Elite
• 2024/04/25 Re: [spark-graphframes]: Generating incorrect edges Nijland, J.G.W. (Jelle, Student M-CS)
• 2024/04/24 DataFrameReader: timestampFormat default value keen
• 2024/04/24 Re: [spark-graphframes]: Generating incorrect edges Mich Talebzadeh
• 2024/04/24 Re: [spark-graphframes]: Generating incorrect edges Nijland, J.G.W. (Jelle, Student M-CS)
• 2024/04/24 Re: [spark-graphframes]: Generating incorrect edges Mich Talebzadeh
• 2024/04/24 RE: How to add MaxDOP option in spark mssql JDBC Appel, Kevin
• 2024/04/24 [spark-graphframes]: Generating incorrect edges Nijland, J.G.W. (Jelle, Student M-CS)
• 2024/04/23 How to add MaxDOP option in spark mssql JDBC Elite
• 2024/04/22 How to use Structured Streaming in Spark SQL ????
• 2024/04/20 How to access the internal hidden columns of table by spark jdbc casel.chen
• 2024/04/19 Accounting the impact of failures in spark jobs Faiz Halde
• 2024/04/18 StreamingQueryListener integration with Spark native metric sink (JmxSink) Mason Chen
• 2024/04/18 [ANNOUNCE] Apache Spark 3.4.3 released Dongjoon Hyun
• 2024/04/17 [Spark SQL][How-To] Remove builtin function support from Spark Matthew McMillian
• 2024/04/17 [Spark SQL][How-To] Remove builtin function support from Spark Matthew McMillian
• 2024/04/17 should OutputCommitCoordinator fail stages for authorized committer failures when using s3a optimized committers? Dylan McClelland
• 2024/04/16 [Spark SQL] xxhash64 default seed of 42 confusion Igor Calabria
• 2024/04/15 auto create event log directory if not exist second_co...@yahoo.com.INVALID
• 2024/04/14 Re: Spark streaming job for kafka transaction does not consume read_committed messages correctly. Kidong Lee
• 2024/04/14 Re: Spark streaming job for kafka transaction does not consume read_committed messages correctly. Mich Talebzadeh
• 2024/04/13 Re: Spark streaming job for kafka transaction does not consume read_committed messages correctly. Kidong Lee
• 2024/04/13 Re: Spark streaming job for kafka transaction does not consume read_committed messages correctly. Kidong Lee
• 2024/04/13 Re: Spark streaming job for kafka transaction does not consume read_committed messages correctly. Mich Talebzadeh
• 2024/04/12 Spark streaming job for kafka transaction does not consume read_committed messages correctly. Kidong Lee
• 2024/04/11 Spark column headings, camelCase or snake case? Mich Talebzadeh
• 2024/04/11 Re: External Spark shuffle service for k8s Bjørn Jørgensen
• 2024/04/11 Re: [Spark SQL]: Source code for PartitionedFile Ashley McManamon

• Earlier messages
• Later messages