Sorry for the late reply, I think sqlparser-rs users are quite a bit more varied than DataFusion and there is not a large overlap between the contributors of the two projects. I currently seem to be the one reviewing / merging most sqlparser-rs reviews, and I would definitely love some more help.
However, given that the project is not an Apache project, I did not have good luck attracting help. A related discussion is here [1]. If the DataFusion community would like to accelerate releases, we can also try to do that without bringing it into Apache governance. Specifically, it would be great to have help reviewing the PRs -- the actual release process is pretty low overhead. The reviews are what take the vast majority of the maintenance time. Andrew [1]: https://github.com/sqlparser-rs/sqlparser-rs/issues/818 On Sat, Feb 17, 2024 at 4:44 PM Aldrin <octalene....@pm.me.invalid> wrote: > do users of sqlparser-rs mostly use datafusion? I don't know the > community, but it seems like it would be an annoying change for users who > use it with a different query engine. Just a thought > > Sent from Proton Mail <https://proton.me/mail/home> for iOS > > > On Sat, Feb 17, 2024 at 10:26, Andy Grove <andygrov...@gmail.com > <On+Sat,+Feb+17,+2024+at+10:26,+Andy+Grove+%3C%3Ca+href=>> wrote: > > I agree that it simplifies shipping new SQL features in DataFusion since we > can develop the changes in the parser concurrently with the changes in > other DataFusion crates and then release them all together. > > The name of the crate would not need to change, so downstream users should > see no impact. > > We would need to decide if we want to keep a separate version number or > bring it in line with DataFusion version numbers (I have no preference > either way). > > > > On Sat, Feb 17, 2024 at 11:09 AM Mehmet Ozan Kabak <o...@synnada.ai> > wrote: > > > Doing this will probably reduce the time-to-ship for DataFusion features > > that need parsing support due to increased convenience, so I’m inclined > to > > see it in a positive light. > > > > What would be the impact of doing this on people who use only > > sqlparser-rs, if any? > > > > > On Feb 17, 2024, at 7:16 PM, Andy Grove <andygrov...@gmail.com> wrote: > > > > > > The sqlparser-rs project [1] seems to have become the de-facto SQL > parser > > > for Rust, with almost 4 million downloads so far. This was originally > > part > > > of DataFusion very early on, and I moved it into a separate project > > because > > > it seemed useful for other projects. This was before DataFusion was > known > > > as a composable query engine, and with hindsight, I probably should > have > > > left it as part of the DataFusion project. > > > > > > Now that DataFusion has a reputation as a composable query engine, I > > think > > > it would make sense to move this code back into DataFusion, where it > > would > > > benefit from a larger community of maintainers. > > > > > > I would like to hear thoughts from the Apache Arrow / DataFusion > > community. > > > Does this seem like a good idea? > > > > > > Thanks, > > > > > > Andy. > > > > > > [1] https://github.com/sqlparser-rs/sqlparser-rs > > > > > >
