user  

Messages by Thread

• • Re: [Spark Structured Streaming] How to delete old data that was created by Spark Structured Streaming? Andrei L
  • RE: [Spark Structured Streaming] How to delete old data that was created by Spark Structured Streaming? Дубинкин Егор
• [ANNOUNCE] Apache Sedona 1.7.0 released Jia Yu
• repartition before writing to table with bucketed partitioning Henryk Česnolovič
  • Re: repartition before writing to table with bucketed partitioning Soumasish
  • Re: repartition before writing to table with bucketed partitioning Henryk Česnolovič
  • Re: repartition before writing to table with bucketed partitioning Soumasish
• Why is spark not doing filter just after the scan to reduce shuffle at later stage. Khemchand Nagar
• [ANNOUNCE] Apache Celeborn 0.5.2 available Nicholas Jiang
• [Spark]: Is spark goal to remove spark native function extensions? Nathan DEBUCQUOIS
• Can't import confluent_kafka package Tzahi File
• Getting "Cannot broadcast the table that is larger than 8GB error" - Clarification Lakshminarayana Chari
• Which shuffle operations trigger AQE and which don't? Perfect Stranger
  • Re: Which shuffle operations trigger AQE and which don't? Mich Talebzadeh
  • Re: Which shuffle operations trigger AQE and which don't? Gurunandan
• Job Opportunities in India,UK,Australia,UAE,Singapore or USA sri hari kali charan Tummala
• Re: [Spark SQL] [DISK_ONLY Persistence] getting "this.inMemSorter" is null exception Gurunandan
  • Re: [Spark SQL] [DISK_ONLY Persistence] getting "this.inMemSorter" is null exception Gurunandan
  • Re: [Spark SQL] [DISK_ONLY Persistence] getting "this.inMemSorter" is null exception Ashwani Pundir
• Observation not working on jdbc write Smokeriu
• Re: [BRAND] I have a question Mark Thomas
• [SPARK]: standalone : cluster mode : spark-submit driverId issue meivenkatkumar lakshminarayanan
• Access binary representation of Dataframe vincent gromakowski
  • Re: Access binary representation of Dataframe Sem
• StreamingQueryListener in PySpark lagging behind Andrzej Zera
• ClassCastException in Spark3.5 when submit job to an old yarn cluster using netty 4.1.17 Smokeriu
  • Re: ClassCastException in Spark3.5 when submit job to an old yarn cluster using netty 4.1.17 Gurunandan
• [SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility Evelina Dumitrescu
  • Re: [SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility Gurunandan
  • Re: [SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility Evelina Dumitrescu
  • Re: [SPARK CORE] Incompatible configuration used between Spark and HBaseTestingUtility Gurunandan
• Re: Gurunandan
• [ANNOUNCE] Apache Spark 3.4.4 released Dongjoon Hyun
  • Re: [ANNOUNCE] Apache Spark 3.4.4 released Mich Talebzadeh
• Code change requirement Avi Minsky
• [ANNOUNCE] Apache Kyuubi v1.10.0 is available Bowen Liang
  • [ANNOUNCE] Apache Kyuubi v1.10.0 is available Bowen Liang
• Help needed in Spark Job. Khushal Manish
• PySpark Connect client hangs after query completes peay
• Data is not displayed in the readable format Perez
• kubeflow spark operator & SparkHistoryService on k8s - spark driver/executor logs not showing up Spark History Server karan alang
  • Re: kubeflow spark operator & SparkHistoryService on k8s - spark driver/executor logs not showing up Spark History Server Mat Schaffer
• Unable to format data Perez
• [spark user] Issues with Overwrite Mode in Spark Write Parquet Using Root User Ilango
• Spark 4.0 - Expected Stable Release Date Arshad Ali
  • Re: Spark 4.0 - Expected Stable Release Date Bjørn Jørgensen
  • Re: Spark 4.0 - Expected Stable Release Date Holden Karau
• Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions Mich Talebzadeh
  • Re: Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions Jason Tan
  • Re: Issue with VAE Model - KerasTensor Incompatibility with TensorFlow Functions Mich Talebzadeh
• Vulnerability Remediation inquiry Benjamin Liu
• Disk usage with transparent encryption Sébastien Rebecchi
  • Re: Disk usage with transparent encryption Rommel Holmes
• Inquiry on JDK 21 Stable Support Timeline for Apache Spark tison c sunny chiriyankandath
  • Re: Inquiry on JDK 21 Stable Support Timeline for Apache Spark Hill Liu
• Spark Docker image with added packages Nimrod Ofek
  • Re: Spark Docker image with added packages Damien Hawes
  • Re: Spark Docker image with added packages Damien Hawes
  • Re: Spark Docker image with added packages Nimrod Ofek
  • Re: Spark Docker image with added packages Damien Hawes
  • Re: Spark Docker image with added packages Ángel
  • Re: Spark Docker image with added packages Nimrod Ofek
  • Re: Spark Docker image with added packages Mich Talebzadeh
  • Re: Spark Docker image with added packages karan alang
• Unexpected longer timer when doing the same training Olivier Sannier
  • Re: Unexpected longer timer when doing the same training Ángel
• spark connect server cannot set driver memory Yunhui Han
  • Re: spark connect server cannot set driver memory Hill Liu
• CVE-2024-7254 spark-core_2.13-3.5.0.jar Kaushik Zadoo
• Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Mich Talebzadeh
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Erik Eklund
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Holden Karau
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Ángel
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Xiao Li
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? awadhesh singh
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Sean Owen
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Richard Eggert
  • Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is? Russell Jurney
• spark TLS connection to hive metastore Stefano Bovina
  • Re: spark TLS connection to hive metastore Ángel
  • Re: spark TLS connection to hive metastore Ángel
• How to run spark connect in kubernetes? kant kodali
  • Re: How to run spark connect in kubernetes? kant kodali
  • Re: How to run spark connect in kubernetes? kant kodali
• kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming Nimrod Ofek
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming Nimrod Ofek
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming Nimrod Ofek
  • Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming karan alang
• Re: Rust Spark Connect ed elliott
• [ANNOUNCE] Announcing Apache Spark 4.0.0-preview2 Dongjoon Hyun
• Spark Job Opportunities ! sri hari kali charan Tummala
• Help - Learning/Understanding spark web UI Karthick Nk
  • Re: Help - Learning/Understanding spark web UI Ilango
  • Re: Help - Learning/Understanding spark web UI Daniel Aronovic
• When exactly does AQE coalesce small partitions or break up large partitions? Perfect Stranger
• [ANNOUNCE] Apache Spark 3.5.3 released Haejoon Lee
• Structured Streaming and Spark Connect Anastasiia Sokhova
  • Re: Structured Streaming and Spark Connect Mich Talebzadeh
  • Re: Structured Streaming and Spark Connect 刘唯
• Issues with CharType() and VarcharType() datatype Souvik Saha
• Compatibility Issue: Spark 3.5.2 Schema Recognition vs. Spark 3.4.0 with Hive Metastore (Case Sensitivity) Mich Talebzadeh
• Spark SQL readSideCharPadding issue while reading ENUM column from mysql Suyash Ajmera
• Re: is it possible to run spark2 on EMR 7.2.0 Prem Sahoo
• ERROR: GROUP BY position 0 is not in select list , when using catalyst parser Rommel Holmes
  • Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser Sudhanshu
  • Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser joshita mishra
• [Spark Core]: Spark 3.5.0 incompatible with Embedded Kafka Adesh Dsilva
• Spark 3.2.1 vs Spark 3.5.2 Stephen Coy
• [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Nagatomi Yasukazu
  • Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Nagatomi Yasukazu
  • Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Prabodh Agarwal
  • Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect? Nagatomi Yasukazu
• Spark Thrift Server - Not Scaling Down Executors 3.4.2+ Jayabindu Singh
  • Re: Spark Thrift Server - Not Scaling Down Executors 3.4.2+ Cheng Pan
• Setting forarch microbatch processing data count in structured streaming Karthick Nk
• Question about Releases and EOL Miles Fryhover (V)
  • Re: Question about Releases and EOL Mich Talebzadeh
• Fwd: [ANNOUNCE] Apache Sedona 1.6.1 released Jia Yu
• unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart karan alang
  • Re: unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart Mat Schaffer
• Job Opportunities in India or UK with Tier 2 Sponsorship - Spark Expert sri hari kali charan Tummala
• Re: Batch to Kafka Rommel Holmes
• Need support for vulnerability CVE-2023-39410 Ravichandran, Abhirami
• Expected Release date for Spark 4? Vikash Lavaniya
• Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Aaron Grubb
  • Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Aaron Grubb
  • Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Cheng Pan
  • Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration? Cheng Pan
• Spark Job Fails while writing data to a S3 location in Parquet Nipuna Shantha
• Handling load distribution and addressing data skew. Karthick
  • Re: Handling load distribution and addressing data skew. Raghavendra Ganesh
• Issue with pyspark : Add custom shutdown hook aarushi agarwal
• Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
  • Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
  • Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
  • Re: Spark Reads from MapR and Write to MinIO fails for few batches Prem Sahoo
• Redundant(?) shuffle after join Shay Elbaz
  • Re: Redundant(?) shuffle after join Mich Talebzadeh
  • Re: Redundant(?) shuffle after join Shay Elbaz
  • Re: Redundant(?) shuffle after join Mich Talebzadeh
  • Re: [External] Re: Redundant(?) shuffle after join Ofir Manor
• Need help understanding tuning docs Sreyan Chakravarty
  • Re: Need help understanding tuning docs Subhasis Mukherjee
• [Spark Connect ] Date Data type formatting issue Ilango
• [ANNOUNCE] Apache Spark 3.5.2 released Kent Yao
  • Re: [ANNOUNCE] Apache Spark 3.5.2 released Xiao Li
• Is it possible to configure batch size immutability between two `mapInPandas`? Azamat G.
• Re: Spark 3.5.0 bug - Writing a small paraquet dataframe to storage using spark 3.5.0 taking too long Bijoy Deb
• [spark connect] unable to utilize stand alone cluster Ilango
  • Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
  • Re: [spark connect] unable to utilize stand alone cluster Ilango
  • Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
  • Re: [spark connect] unable to utilize stand alone cluster Ilango
  • Re: [spark connect] unable to utilize stand alone cluster Prabodh Agarwal
• Spark History CORS header ‘Access-Control-Allow-Origin’ missing Thomas Mauran
• dynamically infer json data not working as expected Perez
  • Re: dynamically infer json data not working as expected Perez
  • Re: dynamically infer json data not working as expected Mich Talebzadeh
  • Re: dynamically infer json data not working as expected Perez
  • Re: dynamically infer json data not working as expected Perez
• Feature Engineering for Data Engineers: Building Blocks for ML Success Mich Talebzadeh
• Error While Running Merge Statement With Iceberg PRASHANT L
• A code change for spark ui in Sql tab Donvi
• Question about installing Apache Spark [PySpark] computer requirements mike Jadoo
  • Re: Question about installing Apache Spark [PySpark] computer requirements Sadha Chilukoori
  • Re: Question about installing Apache Spark [PySpark] computer requirements mike Jadoo
  • Re: Question about installing Apache Spark [PySpark] computer requirements Sadha Chilukoori
  • Re: Question about installing Apache Spark [PySpark] computer requirements Meena Rajani
• [ANNOUNCE] Apache Celeborn 0.5.1 available Ethan Feng
• [ANNOUNCE] Apache Celeborn 0.4.2 available Fu Chen
• [Spark Connect] connection issue Ilango
  • Re: [Spark Connect] connection issue Prabodh Agarwal
  • Re: [Spark Connect] connection issue Ilango
  • Re: [Spark Connect] connection issue Prabodh Agarwal

• Earlier messages
• Later messages