user  

Messages by Thread

• • [ANNOUNCE] Apache Kyuubi v1.10.0 is available Bowen Liang
• Help needed in Spark Job. Khushal Manish
• PySpark Connect client hangs after query completes peay
• Data is not displayed in the readable format Perez
• kubeflow spark operator & SparkHistoryService on k8s - spark driver/executor logs not showing up Spark History Server karan alang
  • Re: kubeflow spark operator & SparkHistoryService on k8s - spark driver/executor logs not showing up Spark History Server Mat Schaffer
• Unable to format data Perez
• [spark user] Issues with Overwrite Mode in Spark Write Parquet Using Root User Ilango
• Spark 4.0 - Expected Stable Release Date Arshad Ali
  • Re: Spark 4.0 - Expected Stable Release Date Bjørn Jørgensen
  • Re: Spark 4.0 - Expected Stable Release Date Holden Karau
• Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions Mich Talebzadeh
  • Re: Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions Jason Tan
  • Re: Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions Mich Talebzadeh
• Vulnerability Remediation inquiry Benjamin Liu
• Disk usage with transparent encryption Sébastien Rebecchi
  • Re: Disk usage with transparent encryption Rommel Holmes
• Inquiry on JDK 21 Stable Support Timeline for Apache Spark tison c sunny chiriyankandath
  • Re: Inquiry on JDK 21 Stable Support Timeline for Apache Spark Hill Liu
• Spark Docker image with added packages Nimrod Ofek
  • Re: Spark Docker image with added packages Damien Hawes
  • Re: Spark Docker image with added packages Damien Hawes
  • Re: Spark Docker image with added packages Nimrod Ofek
  • Re: Spark Docker image with added packages Damien Hawes
  • Re: Spark Docker image with added packages Ángel
  • Re: Spark Docker image with added packages Nimrod Ofek
  • Re: Spark Docker image with added packages Mich Talebzadeh
  • Re: Spark Docker image with added packages karan alang
• Unexpected longer timer when doing the same training Olivier Sannier
  • Re: Unexpected longer timer when doing the same training Ángel
• spark connect server cannot set driver memory Yunhui Han
  • Re: spark connect server cannot set driver memory Hill Liu
• CVE-2024-7254 spark-core_2.13-3.5.0.jar Kaushik Zadoo
• Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Mich Talebzadeh
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Erik Eklund
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Xiao Li
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? awadhesh singh
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Sean Owen
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Richard Eggert
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
• spark TLS connection to hive metastore Stefano Bovina
  • Re: spark TLS connection to hive metastore Ángel
  • Re: spark TLS connection to hive metastore Ángel
• How to run spark connect in kubernetes? kant kodali
  • Re: How to run spark connect in kubernetes? kant kodali
  • Re: How to run spark connect in kubernetes? kant kodali
• kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming Nimrod Ofek
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming Nimrod Ofek
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming Nimrod Ofek
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
• Re: Rust Spark Connect ed elliott
• [ANNOUNCE] Announcing Apache Spark 4.0.0-preview2 Dongjoon Hyun
• Spark Job Opportunities ! sri hari kali charan Tummala
• Help - Learning/Understanding spark web UI Karthick Nk
  • Re: Help - Learning/Understanding spark web UI Ilango
  • Re: Help - Learning/Understanding spark web UI Daniel Aronovic
• When exactly does AQE coalesce small partitions or break up large partitions? Perfect Stranger
• [ANNOUNCE] Apache Spark 3.5.3 released Haejoon Lee
• Structured Streaming and Spark Connect Anastasiia Sokhova
  • Re: Structured Streaming and Spark Connect Mich Talebzadeh
  • Re: Structured Streaming and Spark Connect 刘唯
• Issues with CharType() and VarcharType() datatype Souvik Saha
• Compatibility Issue: Spark 3.5.2 Schema Recognition vs. Spark 3.4.0 with Hive Metastore (Case Sensitivity) Mich Talebzadeh
• Spark SQL readSideCharPadding issue while reading ENUM column from mysql Suyash Ajmera
• Re: is it possible to run spark2 on EMR 7.2.0 Prem Sahoo
• ERROR: GROUP BY position 0 is not in select list , when using catalyst parser Rommel Holmes
  • Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser Sudhanshu
  • Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser joshita mishra
• [Spark Core]: Spark 3.5.0 incompatible with Embedded Kafka Adesh Dsilva
• Spark 3.2.1 vs Spark 3.5.2 Stephen Coy
• [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Nagatomi Yasukazu
  • Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Nagatomi Yasukazu
  • Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Prabodh Agarwal
  • Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Nagatomi Yasukazu
• Spark Thrift Server - Not Scaling Down Executors 3.4.2+ Jayabindu Singh
  • Re: Spark Thrift Server - Not Scaling Down Executors 3.4.2+ Cheng Pan
• Setting forarch microbatch processing data count in structured streaming Karthick Nk
• Question about Releases and EOL Miles Fryhover (V)
  • Re: Question about Releases and EOL Mich Talebzadeh
• Fwd: [ANNOUNCE] Apache Sedona 1.6.1 released Jia Yu
• unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart karan alang
  • Re: unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart Mat Schaffer
• Job Opportunities in India or UK with Tier 2 Sponsorship - Spark Expert sri hari kali charan Tummala
• Re: Batch to Kafka Rommel Holmes
• Need support for vulnerability CVE-2023-39410 Ravichandran, Abhirami
• Expected Release date for Spark 4? Vikash Lavaniya
• Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Aaron Grubb
  • Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Aaron Grubb
  • Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Cheng Pan
  • Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Cheng Pan
• Spark Job Fails while writing data to a S3 location in Parquet Nipuna Shantha
• Handling load distribution and addressing data skew. Karthick
  • Re: Handling load distribution and addressing data skew. Raghavendra Ganesh
• Issue with pyspark : Add custom shutdown hook aarushi agarwal
• Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
  • Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
  • Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
  • Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
• Redundant(?) shuffle after join Shay Elbaz
  • Re: Redundant(?) shuffle after join Mich Talebzadeh
  • Re: Redundant(?) shuffle after join Shay Elbaz
  • Re: Redundant(?) shuffle after join Mich Talebzadeh
  • Re: [External] Re: Redundant(?) shuffle after join Ofir Manor
• Need help understanding tuning docs Sreyan Chakravarty
  • Re: Need help understanding tuning docs Subhasis Mukherjee
• [Spark Connect ] Date Data type formatting issue Ilango
• [ANNOUNCE] Apache Spark 3.5.2 released Kent Yao
  • Re: [ANNOUNCE] Apache Spark 3.5.2 released Xiao Li
• Is it possible to configure batch size immutability between two `mapInPandas`? Azamat G.
• Re: Spark 3.5.0 bug - Writing a small paraquet dataframe to storage using spark 3.5.0 taking too long Bijoy Deb
• [spark connect] unable to utilize stand alone cluster Ilango
  • Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
  • Re: [spark connect] unable to utilize stand alone cluster Ilango
  • Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
  • Re: [spark connect] unable to utilize stand alone cluster Ilango
  • Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
• Spark History CORS header ‘Access-Control-Allow-Origin’ missing Thomas Mauran
• dynamically infer json data not working as expected Perez
  • Re: dynamically infer json data not working as expected Perez
  • Re: dynamically infer json data not working as expected Mich Talebzadeh
  • Re: dynamically infer json data not working as expected Perez
  • Re: dynamically infer json data not working as expected Perez
• Feature Engineering for Data Engineers: Building Blocks for ML Success Mich Talebzadeh
• Error While Running Merge Statement With Iceberg PRASHANT L
• A code change for spark ui in Sql tab Donvi
• Question about installing Apache Spark [PySpark] computer requirements mike Jadoo
  • Re: Question about installing Apache Spark [PySpark] computer requirements Sadha Chilukoori
  • Re: Question about installing Apache Spark [PySpark] computer requirements mike Jadoo
  • Re: Question about installing Apache Spark [PySpark] computer requirements Sadha Chilukoori
  • Re: Question about installing Apache Spark [PySpark] computer requirements Meena Rajani
• [ANNOUNCE] Apache Celeborn 0.5.1 available Ethan Feng
• [ANNOUNCE] Apache Celeborn 0.4.2 available Fu Chen
• [Spark Connect] connection issue Ilango
  • Re: [Spark Connect] connection issue Prabodh Agarwal
  • Re: [Spark Connect] connection issue Ilango
  • Re: [Spark Connect] connection issue Prabodh Agarwal
  • Re: [Spark Connect] connection issue Ilango
  • Re: [Spark Connect] connection issue Prabodh Agarwal
• Issue with comparing structs (possible bug) Dhruv Singla
  • Re: Issue with comparing structs (possible bug) Dhruv Singla
• [ANNOUNCE] Apache Kyuubi v1.9.2 is available Fu Chen
• [Spark SQL]: Why the OptimizeSkewedJoin rule does not optimize FullOuterJoin? 王仲轩(万章)
• Re: issue forwarding SPARK_CONF_DIR to start workers Patrice Duroux
  • Re: issue forwarding SPARK_CONF_DIR to start workers Holden Karau
• [spark connect] issue in testing spark connect Ilango
• Error on Spark history UI api when used with Apache Knox thomas.mau...@etu.umontpellier.fr.INVALID
• problem using spark 3.4 with spots wafa gabouj
• binary stream Jeff Pang
• heap fragmentation in G1 aka.fe2s
• Help wanted on securing spark with Apache Knox / JWT Thomas Mauran
  • Re: Help wanted on securing spark with Apache Knox / JWT Adam Binford
• Sometimes TaskContext configuration is almost empty Asaf Mesika
• [Issue] Spark SQL - broadcast failure Sudharshan V
  • Re: [Issue] Spark SQL - broadcast failure Mich Talebzadeh
  • Re: [Issue] Spark SQL - broadcast failure Meena Rajani
  • Re: [Issue] Spark SQL - broadcast failure Sudharshan V
  • Re: [Issue] Spark SQL - broadcast failure Sudharshan V
  • Re: [Issue] Spark SQL - broadcast failure Sudharshan V
• running snowflake query using spark connect on a standalone cluster Prabodh Agarwal
• Need help to confirm vulnerable issue Will.Qin
• Assistance needed with PySpark Streaming for retrieving past messages. Mai Trang
• How to use spark.connect.Plan from dependency in a custom Spark Connect RelationPlugin? Sem
• AWS Glue and Python Perez
• Does Spark 4.0 add Sparkstreaming SQL ????
• log4j2.properties file load fails when upgrading from 3.3.0 to 3.5.1 Edgar H
• Help Needed: Distributed Logging in Spark Application Zsuzsanna D
• AttributeError: 'MulticlassMetrics' object has no attribute '_sc' Azhuvath, RajeevX
  • Re: AttributeError: 'MulticlassMetrics' object has no attribute '_sc' Saurabh Kumar
• Pyspark DataFrame.drop wrong type hints Oliver Beagley
  • Pyspark DataFrame.drop wrong type hints Oliver Beagley
• Help in understanding Exchange in Spark UI Dhruv Singla
  • Re: Help in understanding Exchange in Spark UI Mich Talebzadeh

• Earlier messages
• Later messages