user

Messages by Date

2023/05/06 Re: Does spark read the same file twice, if two stages are using the same DataFrame? Winston Lai
2023/05/06 Re: Can Spark SQL (not DataFrame or Dataset) aggregate array into map of element of count? Mich Talebzadeh
2023/05/06 Re: Write DataFrame with Partition and choose Filename in PySpark Mich Talebzadeh
2023/05/05 Can Spark SQL (not DataFrame or Dataset) aggregate array into map of element of count? Yong Zhang
2023/05/05 Re: Write DataFrame with Partition and choose Filename in PySpark Marco Costantini
2023/05/04 Re: Write DataFrame with Partition and choose Filename in PySpark Mich Talebzadeh
2023/05/04 Re: Write DataFrame with Partition and choose Filename in PySpark Marco Costantini
2023/05/04 Re: Write DataFrame with Partition and choose Filename in PySpark Mich Talebzadeh
2023/05/04 Write DataFrame with Partition and choose Filename in PySpark Marco Costantini
2023/05/04 Re: Write custom JSON from DataFrame in PySpark Marco Costantini
2023/05/04 Re: Write custom JSON from DataFrame in PySpark Enrico Minack
2023/05/03 Write custom JSON from DataFrame in PySpark Marco Costantini
2023/05/03 How to create spark udf use functioncatalog? tzxxh
2023/05/03 unsubscribe Kang
2023/05/02 Re: How to determine the function of tasks on each stage in an Apache Spark application? Trường Trần Phan An
2023/05/02 CVE-2023-32007: Apache Spark: Shell command injection via Spark UI Arnout Engelen
2023/05/01 Unsubscribe rau-jannik
2023/05/01 Unsubscribe peng
2023/05/01 Unsubscribe sandeep vura
2023/05/01 Re: Change column values using several when conditions Bjørn Jørgensen
2023/05/01 Change column values using several when conditions marc nicole
2023/04/30 How to change column values using several when conditions ? marc nicole
2023/04/30 Any experience with K8s Remote Shuffling Service at scale? Andrey Gourine
2023/04/30 Re: Tensorflow on Spark CPU Sean Owen
2023/04/30 How to read text files with GBK encoding in the spark core lianyou1...@126.com
2023/04/29 Re: Tensorflow on Spark CPU second_co...@yahoo.com.INVALID
2023/04/29 Re: Tensorflow on Spark CPU Sean Owen
2023/04/29 Tensorflow on Spark CPU second_co...@yahoo.com.INVALID
2023/04/28 driver and executors shared same Kubernetes PVC second_co...@yahoo.com.INVALID
2023/04/28 Re: ***pyspark.sql.functions.monotonically_increasing_id()*** Winston Lai
2023/04/28 ***pyspark.sql.functions.monotonically_increasing_id()*** Karthick Nk
2023/04/27 Re: config: minOffsetsPerTrigger not working Abhishek Singla
2023/04/27 Re: config: minOffsetsPerTrigger not working Mich Talebzadeh
2023/04/27 config: minOffsetsPerTrigger not working Abhishek Singla
2023/04/27 Re: What is the best way to organize a join within a foreach? Amit Joshi
2023/04/26 RE: Spark Kubernetes Operator Aldo Culquicondor
2023/04/26 Re: What is the best way to organize a join within a foreach? Mich Talebzadeh
2023/04/26 Re: What is the best way to organize a join within a foreach? Marco Costantini
2023/04/26 Re: What is the best way to organize a join within a foreach? Mich Talebzadeh
2023/04/26 Re: What is the best way to organize a join within a foreach? ayan guha
2023/04/26 Re: What is the best way to organize a join within a foreach? Mich Talebzadeh
2023/04/25 Re: What is the best way to organize a join within a foreach? Marco Costantini
2023/04/25 Re: unsubscribe santhosh Gandhe
2023/04/25 Re: What is the best way to organize a join within a foreach? Mich Talebzadeh
2023/04/25 Re: What is the best way to organize a join within a foreach? Marco Costantini
2023/04/25 Re: What is the best way to organize a join within a foreach? Mich Talebzadeh
2023/04/25 Re: What is the best way to organize a join within a foreach? Marco Costantini
2023/04/25 Re: What is the best way to organize a join within a foreach? Mich Talebzadeh
2023/04/24 unsubscribe yxj1141
2023/04/24 What is the best way to organize a join within a foreach? Marco Costantini
2023/04/24 What is the best way to organize a join within a foreach? Marco Costantini
2023/04/24 Unsubcribing phiroc
2023/04/24 Reg: create spark using virtual machine through chef sunkara akhil sai teja
2023/04/24 Re: Use Spark Aggregator in PySpark Enrico Minack
2023/04/23 Use Spark Aggregator in PySpark Thomas Wang
2023/04/23 Re: Spark Aggregator with ARRAY<BOOLEAN> input and ARRAY<LONG> output Thomas Wang
2023/04/23 Re: Spark Aggregator with ARRAY<BOOLEAN> input and ARRAY<LONG> output Raghavendra Ganesh
2023/04/23 Spark Aggregator with ARRAY<BOOLEAN> input and ARRAY<LONG> output Thomas Wang
2023/04/23 State of GraphX and GraphFrames g
2023/04/20 Dependency injection for spark executors Deepak Patankar
2023/04/20 Re: Partition by on dataframe causing a Sort Nikhil Goyal
2023/04/20 Partition by on dataframe causing a Sort Nikhil Goyal
2023/04/18 Re: [Spark on SBT] Executor just keeps running Dhruv Singla
2023/04/17 Re: Spark Multiple Hive Metastore Catalog Support Ankit Gupta
2023/04/17 [Spark on SBT] Executor just keeps running Dhruv Singla
2023/04/17 Re: Spark Multiple Hive Metastore Catalog Support Cheng Pan
2023/04/17 Re: Spark Multiple Hive Metastore Catalog Support Elliot West
2023/04/17 Spark Log Shipper to Cloud Bucket Jayabindu Singh
2023/04/17 Re: Spark Multiple Hive Metastore Catalog Support Ankit Gupta
2023/04/15 Re: Non string type partitions Bjørn Jørgensen
2023/04/15 Re: Non string type partitions Charles vinodh
2023/04/15 CVE-2023-22946: Apache Spark proxy-user privilege escalation from malicious configuration class Sean R. Owen
2023/04/14 Scala commands syntax shortcuts(alias) Ankit Singla
2023/04/14 Re: Spark Kubernetes Operator Yuval Itzchakov
2023/04/14 Re: Spark Kubernetes Operator Mich Talebzadeh
2023/04/14 Spark Kubernetes Operator Yuval Itzchakov
2023/04/14 Re: Accessing python runner file in AWS EKS kubernetes cluster as in local:// Mich Talebzadeh
2023/04/14 Re: How to determine the function of tasks on each stage in an Apache Spark application? Jacek Laskowski
2023/04/14 Re: How to create spark udf use functioncatalog? Jacek Laskowski
2023/04/14 How to create spark udf use functioncatalog? ??????
2023/04/13 [ANNOUNCE] Apache Spark 3.2.4 released Dongjoon Hyun
2023/04/13 Re: How to determine the function of tasks on each stage in an Apache Spark application? Trường Trần Phan An
2023/04/13 Re: _spark_metadata path issue with S3 lifecycle policy Yuval Itzchakov
2023/04/13 Re: _spark_metadata path issue with S3 lifecycle policy Yuri Oleynikov (‫יורי אולייניקוב‬‎)
2023/04/13 Re: _spark_metadata path issue with S3 lifecycle policy Yuval Itzchakov
2023/04/13 Re: _spark_metadata path issue with S3 lifecycle policy Yuri Oleynikov (‫יורי אולייניקוב‬‎)
2023/04/13 _spark_metadata path issue with S3 lifecycle policy Yuval Itzchakov
2023/04/12 Re: How to determine the function of tasks on each stage in an Apache Spark application? Maytas Monsereenusorn
2023/04/12 Re: Accessing python runner file in AWS EKS kubernetes cluster as in local:// Mich Talebzadeh
2023/04/12 Re: Accessing python runner file in AWS EKS kubernetes cluster as in local:// Bjørn Jørgensen
2023/04/12 Accessing python runner file in AWS EKS kubernetes cluster as in local:// Mich Talebzadeh
2023/04/12 Re: Re: spark streaming and kinesis integration Mich Talebzadeh
2023/04/12 Re: How to determine the function of tasks on each stage in an Apache Spark application? Jacek Laskowski
2023/04/12 Re: Re: spark streaming and kinesis integration 孙令哲
2023/04/12 Re: Re: spark streaming and kinesis integration Yi Huang
2023/04/12 Re: Re: spark streaming and kinesis integration Rajesh Katkar
2023/04/12 Re: [SparkSQL, SparkUI, RESTAPI] How to extract the WholeStageCodeGen ids from SparkUI Jacek Laskowski
2023/04/12 PySpark tests are failed with the java.util.ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.apache.spark.sql.sources.FakeSourceOne not found Ranga Reddy
2023/04/12 Re: Non string type partitions Charles vinodh
2023/04/11 Re: Re: spark streaming and kinesis integration Lingzhe Sun
2023/04/11 Re: [SparkSQL, SparkUI, RESTAPI] How to extract the WholeStageCodeGen ids from SparkUI Chitral Verma
2023/04/11 Re: Non string type partitions Chitral Verma
2023/04/11 Non string type partitions Charles vinodh
2023/04/10 Re: spark streaming and kinesis integration Mich Talebzadeh
2023/04/10 Re: spark streaming and kinesis integration Mich Talebzadeh
2023/04/10 Re: spark streaming and kinesis integration Rajesh Katkar
2023/04/10 [ANNOUNCE] Apache Uniffle(Incubating) 0.7.0 available Junfan Zhang
2023/04/09 Re: Troubleshooting ArrayIndexOutOfBoundsException in long running Spark application Andrew Redd
2023/04/07 [SparkSQL, SparkUI, RESTAPI] How to extract the WholeStageCodeGen ids from SparkUI Chenghao Lyu
2023/04/06 Re: spark streaming and kinesis integration Rajesh Katkar
2023/04/06 RE: spark streaming and kinesis integration Jonske, Kurt
2023/04/06 Re: spark streaming and kinesis integration Mich Talebzadeh
2023/04/06 Re: spark streaming and kinesis integration Mich Talebzadeh
2023/04/06 spark streaming and kinesis integration Rajesh Katkar
2023/04/05 Raise exception whilst casting instead of defaulting to null Yeachan Park
2023/04/05 Re: Potability of dockers built on different cloud platforms Mich Talebzadeh
2023/04/05 Re: Troubleshooting ArrayIndexOutOfBoundsException in long running Spark application Mich Talebzadeh
2023/04/05 Troubleshooting ArrayIndexOutOfBoundsException in long running Spark application me
2023/04/05 Troubleshooting ArrayIndexOutOfBoundsException in long running Spark application me
2023/04/05 Re: Potability of dockers built on different cloud platforms Ken Peng
2023/04/05 Potability of dockers built on different cloud platforms ashok34...@yahoo.com.INVALID
2023/04/04 Re: Creating InMemory relations with data in ColumnarBatches Bobby Evans
2023/04/04 Re: Slack for PySpark users Mich Talebzadeh
2023/04/04 Re: Slack for PySpark users Bjørn Jørgensen
2023/04/04 Re: Slack for PySpark users Mich Talebzadeh
2023/04/03 Re: Slack for PySpark users shani . alishar
2023/04/03 Re: Slack for PySpark users Dongjoon Hyun
2023/04/03 Re: Slack for PySpark users Denny Lee
2023/04/03 Re: Slack for PySpark users Dongjoon Hyun
2023/04/03 Re: Slack for PySpark users Mich Talebzadeh
2023/04/03 Re: Slack for PySpark users Jungtaek Lim
2023/04/03 Re: Slack for PySpark users Jungtaek Lim
2023/04/03 Re: Looping through a series of telephone numbers Gera Shegalov
2023/04/03 Re: Slack for PySpark users Dongjoon Hyun
2023/04/03 Re: Slack for PySpark users Mich Talebzadeh
2023/04/03 Re: Slack for PySpark users Dongjoon Hyun
2023/04/02 Re: Looping through a series of telephone numbers Mich Talebzadeh
2023/04/02 Re: Looping through a series of telephone numbers Philippe de Rochambeau
2023/04/02 Re: Looping through a series of telephone numbers Philippe de Rochambeau
2023/04/02 Re: Looping through a series of telephone numbers Anastasios Zouzias
2023/04/02 Re: Looping through a series of telephone numbers Bjørn Jørgensen
2023/04/02 Re: Looping through a series of telephone numbers Mich Talebzadeh
2023/04/02 Re: Looping through a series of telephone numbers Sean Owen
2023/04/02 Re: Looping through a series of telephone numbers Philippe de Rochambeau
2023/04/01 Re: Looping through a series of telephone numbers Mich Talebzadeh
2023/04/01 Looping through a series of telephone numbers Philippe de Rochambeau
2023/04/01 Re: Help me learn about JOB TASK and DAG in Apache Spark Mich Talebzadeh
2023/04/01 Re: Help me learn about JOB TASK and DAG in Apache Spark Khalid Mammadov
2023/03/31 Re: Help me learn about JOB TASK and DAG in Apache Spark Mich Talebzadeh
2023/03/31 Re: Help me learn about JOB TASK and DAG in Apache Spark AN-TRUONG Tran Phan
2023/03/31 Re: Help me learn about JOB TASK and DAG in Apache Spark Mich Talebzadeh
2023/03/30 Re: Creating InMemory relations with data in ColumnarBatches praveen sinha
2023/03/30 Re: Slack for PySpark users Jungtaek Lim
2023/03/30 Re: Creating InMemory relations with data in ColumnarBatches Mich Talebzadeh
2023/03/30 Re: Slack for PySpark users Mich Talebzadeh
2023/03/30 Re: Slack for PySpark users Denny Lee
2023/03/30 Re: Slack for PySpark users shani . alishar
2023/03/30 Re: Slack for PySpark users Mridul Muralidharan
2023/03/30 unsubscribe Daniel Tavares de Santana
2023/03/30 Re: Slack for PySpark users Bjørn Jørgensen
2023/03/30 Creating InMemory relations with data in ColumnarBatches praveen sinha
2023/03/30 Re: Slack for PySpark users Mich Talebzadeh
2023/03/30 Re: Slack for PySpark users Dongjoon Hyun
2023/03/30 Re: Slack for PySpark users Xiao Li
2023/03/30 Re: Slack for PySpark users Mich Talebzadeh
2023/03/30 Re: Slack for PySpark users Dongjoon Hyun
2023/03/30 [ANNOUNCE] Apache Celeborn(incubating) 0.2.1 available rexxiong
2023/03/30 Re: Slack for PySpark users Mich Talebzadeh
2023/03/30 Re: Slack for PySpark users Mich Talebzadeh
2023/03/30 Re: Slack for PySpark users shani . alishar
2023/03/29 Re: Slack for PySpark users Xiao Li
2023/03/28 Re: spark.catalog.listFunctions type signatures Guillaume Masse
2023/03/28 Re: spark.catalog.listFunctions type signatures Jacek Laskowski
2023/03/28 spark.catalog.listFunctions type signatures Guillaume Masse
2023/03/28 Re: Topics for Spark online classes & webinars Mich Talebzadeh
2023/03/28 Re: Topics for Spark online classes & webinars Mich Talebzadeh
2023/03/28 Re: Topics for Spark online classes & webinars Bjørn Jørgensen
2023/03/28 Re: Topics for Spark online classes & webinars Mich Talebzadeh
2023/03/28 Re: What is the range of the PageRank value of graphx lee
2023/03/28 Re: What is the range of the PageRank value of graphx Sean Owen
2023/03/28 What is the range of the PageRank value of graphx lee
2023/03/28 Re: Slack for PySpark users Mich Talebzadeh
2023/03/28 Re: Topics for Spark online classes & webinars asma zgolli
2023/03/28 Re: Slack for PySpark users asma zgolli
2023/03/28 Re: Slack for PySpark users Shani Alisar
2023/03/27 Re: Slack for PySpark users asma zgolli
2023/03/27 Re: Slack for PySpark users Winston Lai
2023/03/27 Re: Slack for PySpark users Denny Lee
2023/03/27 Re: Slack for PySpark users Hyukjin Kwon
2023/03/27 Slack for PySpark users keen
2023/03/26 Re: Question related to asynchronously map transformation using java spark structured streaming Mich Talebzadeh
2023/03/26 Re: Question related to asynchronously map transformation using java spark structured streaming Sean Owen
2023/03/26 Re: Question related to asynchronously map transformation using java spark structured streaming Emmanouil Kritharakis
2023/03/26 How to calculate the spark.kryoserializer.buffer.max? Arthur Li
2023/03/25 Re: Kind help request Sean Owen
2023/03/25 Kind help request Lorenzo Ferrando
2023/03/24 Re: Adding OpenSearch as a secondary index provider to SparkSQL Mich Talebzadeh
2023/03/24 Adding OpenSearch as a secondary index provider to SparkSQL Anirudha Jadhav
2023/03/21 Re: Question related to parallelism using structed streaming parallelism Mich Talebzadeh
2023/03/21 Re: Question related to parallelism using structed streaming parallelism Sean Owen