Re: [DISCUSS] Apache Spark 3.5 LTS Period (~ 2026 April)

2024-11-01 Thread Dongjoon Hyun
The PR was approved and merged into Apache Spark website officially. Thank you, Kent, Liang-Chi, Mridul, Hyukjin, and all. Dongjoon On 2024/10/31 03:34:18 Dongjoon Hyun wrote: > Here is a concrete PR for this. > > - https://github.com/apache/spark-website/pull/565 > > Dongjoon > > On 2024/10/

Re: [Spark SQL] KafkaWriteTask: allow customising timestamp - PR

2024-11-01 Thread Martin Andersson
Why do you need to change the kafka native timestamp? It is the time the message was produced, defined by the configuration log.message.timestamp.type, by default the time the record was created client-side. If yo