Re: Apache Arrow Cookbook

2021-08-09 Thread Nic
As of a few days ago, GitHub's "Issues" feature is now active on the Arrow cookbook repo and is the way we hope to get feedback, discuss issues, and requests for recipes etc. There are already a few ongoing discussions around implementation details. https://github.com/apache/arrow-cookbook/issues

Re: Apache Arrow Cookbook

2021-07-28 Thread Wes McKinney
hi Alessandro — I just merged the PR, thank you! I would still like us to move to use ipython_directive in the authoring of Python examples so that authors do not have to copy-paste console output into the recipes, but that doesn't have to be addressed right now. Thanks, Wes On Wed, Jul 28, 2021

Re: Apache Arrow Cookbook

2021-07-28 Thread Alessandro Molina
Hi everybody, The Cookbook PR has been open for more than a week at this point and we have received tons of great feedback and suggestions, many of which we incorporated already. For the benefit of being able to verify the publishing workflow and the CI I'd love to ask if there is anyone who could

Re: Apache Arrow Cookbook

2021-07-20 Thread Alessandro Molina
The Pull Request for the Cookbook has been created ( https://github.com/apache/arrow-cookbook/pull/1 ) I left as comments in the PR the steps that need to be done to enable compilation of the cookbook once the PR is merged (enabling actions, gh pages etc...) anyone willing to merge it should probab

Re: Apache Arrow Cookbook

2021-07-14 Thread Wes McKinney
I just initialized https://github.com/apache/arrow-cookbook On Wed, Jul 14, 2021 at 1:33 PM Wes McKinney wrote: > > On Wed, Jul 14, 2021 at 8:33 AM Alessandro Molina > wrote: > > > > On Tue, Jul 13, 2021 at 2:40 PM Wes McKinney wrote: > > > > > I requested its creation here > > > > > > https:/

Re: Apache Arrow Cookbook

2021-07-14 Thread Wes McKinney
On Wed, Jul 14, 2021 at 8:33 AM Alessandro Molina wrote: > > On Tue, Jul 13, 2021 at 2:40 PM Wes McKinney wrote: > > > I requested its creation here > > > > https://github.com/apache/arrow-cookbook > > > > If you can set up a PR into this repo (not sure if I need to push an > > empty "initial com

Re: Apache Arrow Cookbook

2021-07-14 Thread Alessandro Molina
On Tue, Jul 13, 2021 at 2:40 PM Wes McKinney wrote: > I requested its creation here > > https://github.com/apache/arrow-cookbook > > If you can set up a PR into this repo (not sure if I need to push an > empty "initial commit" repo, but let me know), Seems your concern was correct, you can't op

Re: Apache Arrow Cookbook

2021-07-13 Thread Wes McKinney
I requested its creation here https://github.com/apache/arrow-cookbook If you can set up a PR into this repo (not sure if I need to push an empty "initial commit" repo, but let me know), please make sure everyone who has contributed has an ICLA on file with the ASF secretary. I'm not sure that it

Re: Apache Arrow Cookbook

2021-07-13 Thread Alessandro Molina
How should we move forward to "request" an arrow-cookbook repository under the apache organization? Is there a form or request that has to be submitted? Another thing we were wondering, is that being able to deal with contributions using GitHub Issues would lower the barrier for users who find issu

Re: Apache Arrow Cookbook

2021-07-09 Thread Wes McKinney
Some benefits of separating the cookbook from the documentation would be to decouple its release / publication from Arrow releases, so you can roll out new content to the published version as soon as it's merged into the repository, where in the same fashion we might not want to publish inter-relea

Re: Apache Arrow Cookbook

2021-07-08 Thread Alessandro Molina
Thinking about it, I think that having the cookbook into its own repository (apache/arrow-cookbook) might lower the barrier for contributors. You only need to clone the cookbook and running `make` does also take care of installing the required dependencies, so in theory you don't even need to care

Re: Apache Arrow Cookbook

2021-07-08 Thread Nic
One of the possible aims for the cookbook is having interlinked documentation between function docs and the cookbook, and both the R and Python docs include tests that all of the outputs are expected. Including these tests means that we can immediately see if any code changes render any recipes in

Re: Apache Arrow Cookbook

2021-07-08 Thread Antoine Pitrou
Hi Rares, Documentation bugs and improvement requests are welcome, feel free to file them on the JIRA! Regards Antoine. Le 08/07/2021 à 01:45, Rares Vernica a écrit : Awesome! We would find C++ versions of these recipes very useful. From our experience the C++ API is much much harder to

Re: Apache Arrow Cookbook

2021-07-07 Thread Matt Topol
Personally I'd love to see a cookbook where a recipe is accompanied by examples of how to accomplish it in multiple languages rather than having separate cookbooks for each language. Though that may just be me wanting to see more love for the Golang implementation On Wed, Jul 7, 2021, 8:57 PM

Re: Apache Arrow Cookbook

2021-07-07 Thread Eduardo Ponce
Here is additional food for thought. The cookbook currently contains examples for C++, R, and Python. Is there a plan (or wish) to eventually extend a single cookbook to include examples from other languages (eg., Rust, Java)? If so, then putting the cookbook into its own (language agnostic) repo w

Re: Apache Arrow Cookbook

2021-07-07 Thread Eduardo Ponce
Great work! I would recommend having the cookbook in its own repo so that its updates are not constrained by the timeline used for updating the public Arrow documentation. This will allow users that are not involved in Arrow development to contribute or provide suggestions to the cookbook fairly ea

Re: Apache Arrow Cookbook

2021-07-07 Thread Rares Vernica
Awesome! We would find C++ versions of these recipes very useful. From our experience the C++ API is much much harder to deal with and error prone than the R/Python one. Cheers, Rares On Wed, Jul 7, 2021 at 9:07 AM Alessandro Molina < alessan...@ursacomputing.com> wrote: > Yes, that was mostly w

Re: Apache Arrow Cookbook

2021-07-07 Thread Alessandro Molina
Yes, that was mostly what I meant when I wrote that the next step is opening a PR against the apache/arrow repository itself :D We moved forward in a separate repository initially to be able to cycle more quickly, but we reached a point where we think we can start integrating the cookbook with the

Re: Apache Arrow Cookbook

2021-07-07 Thread Wes McKinney
What do you think about developing this cookbook in an Apache Arrow repository (it could be something like apache/arrow-cookbook, if not part of the main development repo)? Creating expanded documentation resources for learning how to use Apache Arrow to solve problems seems certainly within the bo

Re: Apache Arrow Cookbook

2021-07-07 Thread Alessandro Molina
We finally have a first preview of the cookbook available for R and Python, for anyone interested the two versions are visible at http://ursacomputing.com/arrow-cookbook/py/index.html and http://ursacomputing.com/arrow-cookbook/r/index.html A new version of the cookbook is automatically published o

Re: Apache Arrow Cookbook

2021-06-21 Thread Michael Lavina
Awesome idea! I would definitely either copy paste or link to Paul’s codepens of Arrow-JS examples https://codepen.io/trxcllnt/pens/public That’s basically how I know, how to use arrow-js. -Michael P.S. Just a general thank you credit for Paul Taylor and his awesome work on arrow-js and those

RE: Apache Arrow Cookbook

2021-06-21 Thread dana
Great idea! -Original Message- From: Alessandro Molina Sent: Monday, June 21, 2021 11:34 AM To: dev@arrow.apache.org Subject: Apache Arrow Cookbook Hi, I'd like to share with the ML an idea which me and Nic Crane have been experimenting with. It's still in the early stage, but we hope