Hi Nic, I am definitely in favor of the proposal because: - arrow can be confusing due to the various subprojects / specifications / implementations, so context-specific answers could help reduce this confusion - even if the LLM's answer is not entirely accurate, it provides useful pointers to the relevant sections of the documentation - it aggregates content from multiple sources [1] (zulip is not supported yet, but we can submit a request) - it is already being used by several large projects - as far as I know, they are actively working on improving accuracy - analytics [2] could help us to improve the documentation
Regards, Krisztian [1]: https://docs.kapa.ai/data-sources/supported-data-sources [2]: https://docs.kapa.ai/analytics/overview > On 2025. Feb 17., at 12:18, Nic Crane <thisis...@gmail.com> wrote: > > I was chatting earlier with Alenka, who mentioned this LinkedIn post[1] by > Ritchie Vink from Polars, which talks about the Polars project's use of an > AI service which ingests their docs and answers user questions based on the > results. > > It's provided by an organisation called kapa.ai which offers this service > often free to open source projects [2], and I was wondering if it's > something we might consider trying? > > It'd give us useful insights into where we have gaps in our docs where we > can improve things, or what are common things that users struggle with. It > claims to have better results than basic LLM search due to using and citing > the docs directly, and acknowledging when it doesn't know the answer - > though we'd need to test it out to > > There's an example of the widget on the Django CMS docs [3] under the "Ask > AI" link which provides a popup where the AI bot appears and users can ask > questions. > > I had suspected there might be conflict with the website policy [4] but it > appears that the ASF already allows its usage [5][6]. > > What do folks think of the idea of us experimenting with this for Arrow? > > Nic > > [1] > https://www.linkedin.com/posts/ritchievink_python-api-reference-polars-documentation-activity-7296175345987170305-ZEUI/ > [2] https://docs.kapa.ai/kapa-for-open-source > [3] https://www.django-cms.org/en/support/ > [4] https://privacy.apache.org/policies/website-policy.html > [5] https://privacy.apache.org/policies/privacy-policy-public.html > [6] https://privacy.apache.org/faq/committers.html
