Re: LLM script for error message improvement

2023-08-02 Thread Ruifeng Zheng
+1 from my side, I'm fine to have it as a helper script On Thu, Aug 3, 2023 at 10:53 AM Hyukjin Kwon wrote: > I think adding that dev tool script to improve the error message is fine. > > On Thu, 3 Aug 2023 at 10:24, Haejoon Lee > wrote: > >> Dear contributors, I hope you are doing well! >> >>

Re: Spark writing API

2023-08-02 Thread Andrew Melo
Hello Spark Devs Could anyone help me with this? Thanks, Andrew On Wed, May 31, 2023 at 20:57 Andrew Melo wrote: > Hi all > > I've been developing for some time a Spark DSv2 plugin "Laurelin" ( > https://github.com/spark-root/laurelin > ) to read the ROOT (https://root.cern) file format (which

Re: LLM script for error message improvement

2023-08-02 Thread Hyukjin Kwon
I think adding that dev tool script to improve the error message is fine. On Thu, 3 Aug 2023 at 10:24, Haejoon Lee wrote: > Dear contributors, I hope you are doing well! > > I see there are contributors who are interested in working on error > message improvements and persistent contribution, so

LLM script for error message improvement

2023-08-02 Thread Haejoon Lee
Dear contributors, I hope you are doing well! I see there are contributors who are interested in working on error message improvements and persistent contribution, so I want to share an llm-based error message improvement script for helping your contribution. You can find a detail for the script

Query hints visible to DSV2 connectors?

2023-08-02 Thread Alex Cruise
Hey folks, I'm adding an optional feature to my DSV2 connector where it can choose between a row-based or columnar PartitionReader dynamically depending on a query's schema. I'd like to be able to supply a hint at query time that's visible to the connector, but at the moment I can't see any way to

[VOTE][RESULT] XML data source support

2023-08-02 Thread Sandip Agarwala
The vote passes with 7 +1s (4 binding +1s). Thank you all for your comments and votes! (* = binding) Adrian Pop-Tifrea Hyukjin Kwon * Jia Fan Mich Talebzadeh Maciej Szymkiewicz * Sean Owen * Xiao Li * SPIP link: https://docs.google.com/document/d/1ZaOBT4-YFtN58UCx2cdFhlsKbie1ugAn-Fgz_Dddz-Q/edit?

Re: [Reminder] Spark 3.5 RC Cut

2023-08-02 Thread Bjørn Jørgensen
@Dongjoon Hyun FYI [image: image.png] We better ask common-...@hadoop.apache.org. ons. 2. aug. 2023 kl. 18:03 skrev Dongjoon Hyun : > Oh, I got it, Emil and Bjorn. > > Dongjoon. > > On Wed, Aug 2, 2023 at 12:32 AM Bjørn Jørgensen > wrote: > >> "*As far as I can tell this makes both 3.3.5 and 3

Re: [Reminder] Spark 3.5 RC Cut

2023-08-02 Thread Dongjoon Hyun
Oh, I got it, Emil and Bjorn. Dongjoon. On Wed, Aug 2, 2023 at 12:32 AM Bjørn Jørgensen wrote: > "*As far as I can tell this makes both 3.3.5 and 3.3.6 unusable with s3 > without providing an alternative committer code.*" > > https://github.com/apache/hadoop/pull/5706#issuecomment-1619927992 >

Re: [Reminder] Spark 3.5 RC Cut

2023-08-02 Thread Bjørn Jørgensen
"*As far as I can tell this makes both 3.3.5 and 3.3.6 unusable with s3 without providing an alternative committer code.*" https://github.com/apache/hadoop/pull/5706#issuecomment-1619927992 ons. 2. aug. 2023 kl. 08:05 skrev Emil Ejbyfeldt : > > Apache Spark is not affected by HADOOP-18757 becau