user  

Messages by Thread

• Kind help request Lorenzo Ferrando
  • Re: Kind help request Sean Owen
• Topics for Spark online classes & webinars, next steps Mich Talebzadeh
• Single node spark issue in Sparkly/RStudio elango vaidyanathan
• Understanding executor memory behavior Nikhil Goyal
  • Re: Understanding executor memory behavior Sean Owen
• logging pickle files on local run of spark.ml Pipeline model Mnisi, Caleb
  • Re: logging pickle files on local run of spark.ml Pipeline model Sean Owen
• Question related to asynchronously map transformation using java spark structured streaming Emmanouil Kritharakis
  • Re: Question related to asynchronously map transformation using java spark structured streaming Emmanouil Kritharakis
  • Re: Question related to asynchronously map transformation using java spark structured streaming Sean Owen
  • Re: Question related to asynchronously map transformation using java spark structured streaming Mich Talebzadeh
• Question related to parallelism using structed streaming parallelism Emmanouil Kritharakis
  • Re: Question related to parallelism using structed streaming parallelism Mich Talebzadeh
  • Re: Question related to parallelism using structed streaming parallelism Mich Talebzadeh
  • Re: Question related to parallelism using structed streaming parallelism Sean Owen
  • Re: Question related to parallelism using structed streaming parallelism Mich Talebzadeh
  • Re: Question related to parallelism using structed streaming parallelism Sean Owen
  • Re: Question related to parallelism using structed streaming parallelism Mich Talebzadeh
  • Re: Question related to parallelism using structed streaming parallelism Sean Owen
• Spark 3.3.2 not running with Antlr4 runtime latest version Sahu, Karuna
  • Re: Spark 3.3.2 not running with Antlr4 runtime latest version Sean Owen
  • Re: Spark 3.3.2 not running with Antlr4 runtime latest version yangjie01
• spark on k8s daemonset collect log 404
  • Re: spark on k8s daemonset collect log Cheng Pan
• Extending spark connectors versus providing utility libraries Jarus Local
• Extending Spark Connector versus Providing utility library Jarus Local
• Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars asma zgolli
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Denny Lee
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Denny Lee
  • Re: Topics for Spark online classes & webinars Bjørn Jørgensen
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Denny Lee
  • Re: Topics for Spark online classes & webinars asma zgolli
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Bjørn Jørgensen
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Mich Talebzadeh
  • Re: Topics for Spark online classes & webinars Joris Billen
• What could be the cause of an execution freeze on Hadoop for small datasets? sam smith
  • Re: What could be the cause of an execution freeze on Hadoop for small datasets? Mich Talebzadeh
  • Re: What could be the cause of an execution freeze on Hadoop for small datasets? sam smith
  • Re: What could be the cause of an execution freeze on Hadoop for small datasets? Mich Talebzadeh
  • Re: What could be the cause of an execution freeze on Hadoop for small datasets? sam smith
• How to allocate vcores to driver (client mode) sam smith
• org.apache.spark.shuffle.FetchFailedException in dataproc Gary Liu
  • Re: org.apache.spark.shuffle.FetchFailedException in dataproc Mich Talebzadeh
  • Re: org.apache.spark.shuffle.FetchFailedException in dataproc Gary Liu
  • Re: org.apache.spark.shuffle.FetchFailedException in dataproc Mich Talebzadeh
  • Re: org.apache.spark.shuffle.FetchFailedException in dataproc Gary Liu
• Spark StructuredStreaming - watermark not working as expected karan alang
  • Re: Spark StructuredStreaming - watermark not working as expected Mich Talebzadeh
  • Re: Spark StructuredStreaming - watermark not working as expected karan alang
  • Re: Spark StructuredStreaming - watermark not working as expected Mich Talebzadeh
  • Re: Spark StructuredStreaming - watermark not working as expected karan alang
  • Re: Spark StructuredStreaming - watermark not working as expected karan alang
  • Re: Spark StructuredStreaming - watermark not working as expected Mich Talebzadeh
  • Re: Spark StructuredStreaming - watermark not working as expected karan alang
• How to share a dataset file across nodes sam smith
  • Re: How to share a dataset file across nodes Sean Owen
  • Re: How to share a dataset file across nodes Mich Talebzadeh
• eqNullSafe breaks Sorted Merge Bucket Join? Thomas Wang
• read a binary file and save in another location second_co...@yahoo.com.INVALID
  • Re: read a binary file and save in another location Russell Jurney
  • Re: read a binary file and save in another location Mich Talebzadeh
  • Re: read a binary file and save in another location Russell Jurney
• Spark Thrift Server - Autoscaling on K8 Jayabindu Singh
  • Re: [EXTERNAL] Spark Thrift Server - Autoscaling on K8 Saurabh Gulati
• How to use Fair Scheduler Pools 李杰
  • How to use Fair Scheduler Pools 李杰
• [Spark] How to find which type of key is illegal during from_json() function hueiyuan su
• spark-submit: No "driver-" id printed in standalone mode Travis Athougies
• [ANNOUNCE] Apache Kyuubi released 1.7.0 Cheng Pan
• Online classes for spark topics ashok34...@yahoo.com.INVALID
  • Re: Online classes for spark topics Mich Talebzadeh
  • Re: Online classes for spark topics ashok34...@yahoo.com.INVALID
  • Re: Online classes for spark topics Mich Talebzadeh
  • Re: Online classes for spark topics karan alang
  • Re: Online classes for spark topics asma zgolli
  • Re: Online classes for spark topics Winston Lai
  • Re: Online classes for spark topics Sofia’s World
  • Re: Online classes for spark topics Denny Lee
  • Re: Online classes for spark topics Deepak Sharma
  • Re: Online classes for spark topics Mich Talebzadeh
  • Re: [EXTERNAL] Re: Online classes for spark topics Saurabh Gulati
  • Re: [EXTERNAL] Re: Online classes for spark topics Winston Lai
  • Re: [EXTERNAL] Re: Online classes for spark topics asma zgolli
  • Re: Online classes for spark topics neeraj bhadani
  • Re: Online classes for spark topics Denny Lee
  • Re: Online classes for spark topics Mich Talebzadeh
  • Re: Online classes for spark topics vaquar khan
• 回复：Re: Build SPARK from source with SBT failed ckgppl_yan
  • Re: 回复：Re: Build SPARK from source with SBT failed Artemis User
  • Re: 回复：Re: Build SPARK from source with SBT failed Sean Owen
  • Re: 回复：Re: Build SPARK from source with SBT failed Tufan Rakshit
• Re: Build SPARK from source with SBT failed Sean Owen
• Pandas UDFs vs Inbuilt pyspark functions neha garde
  • Re: Pandas UDFs vs Inbuilt pyspark functions Sean Owen
• [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently and how to handle if achieve quotas of kinesis? hueiyuan su
  • Re: [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently and how to handle if achieve quotas of kinesis? Mich Talebzadeh
• Data duplication and loss occur after executing 'insert overwrite...' in Spark 3.1.1 周锋
• How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
  • Re: How to pass variables across functions in spark structured streaming (PySpark) Sean Owen
  • Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
  • Re: How to pass variables across functions in spark structured streaming (PySpark) Sean Owen
  • Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
  • Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
  • Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
• [ANNOUNCE] Apache Celeborn(incubating) 0.2.0 available Ethan Feng
• Fwd: [New Project] sparksql-ml : Distributed Machine Learning using SparkSQL. Chitral Verma
  • Re: [New Project] sparksql-ml : Distributed Machine Learning using SparkSQL. Russell Jurney
• Fwd: 自动回复: Re: [DISCUSS] Show Python code examples first in Spark documentation Mich Talebzadeh
• [JDBC] [PySpark] Possible bug when comparing incoming data frame from mssql and empty delta table lennart
• Late arriving updates to fact tables rajat kumar
• Re: SPIP architecture diagrams Mich Talebzadeh
  • Re: SPIP architecture diagrams Mich Talebzadeh
• Unable to handle bignumeric datatype in spark/pyspark nidhi kher
  • Re: Unable to handle bignumeric datatype in spark/pyspark Mich Talebzadeh
  • Re: Unable to handle bignumeric datatype in spark/pyspark Rajnil Guha
  • Re: Unable to handle bignumeric datatype in spark/pyspark Mich Talebzadeh
  • Re: Unable to handle bignumeric datatype in spark/pyspark Atheeth SH
  • Re: Unable to handle bignumeric datatype in spark/pyspark Atheeth SH
• [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Sean Owen
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Russell Jurney
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Bjørn Jørgensen
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Sean Owen
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Russell Jurney
  • Re: [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
• Spark with bigquery : Data type issue nidhi kher
  • Re: Spark with bigquery : Data type issue nidhi kher
  • Re: Spark with bigquery : Data type issue Mich Talebzadeh
• SPIP: Adding work load identity to Spark on Kubernetes documents (supersedes Secret Management) Mich Talebzadeh
• SPIP: Shutting down spark structured streaming when the streaming process completed current process Mich Talebzadeh
  • Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process Dongjoon Hyun
  • Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process Holden Karau
  • Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process Mich Talebzadeh
• Vote SPIP Faisal Waris
• Update nested struct with null fields Vikas Kumar
• [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently? hueiyuan su
  • Re: [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently? Vikas Kumar
• How can I set a value of Location with CustomDataSource ? Zhuolin Ji
• Upgrading from Spark SQL 3.2 to 3.3 faild lk_spark
  • Re:Upgrading from Spark SQL 3.2 to 3.3 faild lk_spark
• [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? hueiyuan su
  • Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? Jack Goodson
  • Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? Mich Talebzadeh
  • Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? Mich Talebzadeh
  • Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? hueiyuan su
• ADLS Gen2 adfs sample yaml configuration Kondala Ponnaboina (US)
  • Re: ADLS Gen2 adfs sample yaml configuration Jayabindu Singh
• How to explode array columns of a dataframe having the same length sam smith
  • Re: How to explode array columns of a dataframe having the same length Enrico Minack
  • Re: How to explode array columns of a dataframe having the same length Navneet
  • Re: How to explode array columns of a dataframe having the same length Bjørn Jørgensen
  • Re: How to explode array columns of a dataframe having the same length sam smith
  • Re: How to explode array columns of a dataframe having the same length Vikas Kumar
  • Re: How to explode array columns of a dataframe having the same length 404
  • Adding OpenSearch as a secondary index provider to SparkSQL Anirudha Jadhav
  • Re: Adding OpenSearch as a secondary index provider to SparkSQL Mich Talebzadeh
• Executor tab missing information Prem Sahoo
• Running Spark on Kubernetes (GKE) - failing on spark-submit karan alang
  • Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Khalid Mammadov
  • Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Ye Xianjin
  • Re: Running Spark on Kubernetes (GKE) - failing on spark-submit karan alang
  • Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Mich Talebzadeh
  • Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Mich Talebzadeh
  • Re: Running Spark on Kubernetes (GKE) - failing on spark-submit karan alang
  • Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Mich Talebzadeh
• [Spark Core] Spark data loss/data duplication when executors die Erik Eklund
• How to improve efficiency of this piece of code (returning distinct column values) sam smith
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
  • Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
  • Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Mich Talebzadeh
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Apostolos N. Papadopoulos
  • Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Enrico Minack
  • Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
  • Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Mich Talebzadeh
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Enrico Minack
  • Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
  • Re: How to improve efficiency of this piece of code (returning distinct column values) Enrico Minack
  • Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
• Re: Sunil Prabhakara
• Executor metrics are missing on prometheus sink Qian Sun
  • Re: Executor metrics are missing on Prometheus sink Qian Sun
• Jira Account for Contributions Jack Goodson

• Earlier messages
• Later messages