Re: Do we have nightly source tar ball

2022-07-07 Thread Li Jin
Thanks! This is very helpful. On Thu, Jul 7, 2022 at 11:33 AM Jacob Wujciak wrote: > The crossbow tarballs do not contain the arrow source, they only contain > the crossbow source (aka a few yaml files). > > On Thu, Jul 7, 2022 at 5:29 PM Li Jin wrote: > > > Thanks both! > > > > This looks use

Re: Do we have nightly source tar ball

2022-07-07 Thread Jacob Wujciak
The crossbow tarballs do not contain the arrow source, they only contain the crossbow source (aka a few yaml files). On Thu, Jul 7, 2022 at 5:29 PM Li Jin wrote: > Thanks both! > > This looks useful - I wonder if the version between the crossbow tarball > and pypi dist matches (i.e. are they pub

Re: Do we have nightly source tar ball

2022-07-07 Thread Jacob Wujciak
Hello Li, The jobs that create the wheels and sdist a part of the nightly packaging builds [1]. Within the log [2] you can check the exact sha the wheels/sdist are built with and use https://github.com/apache/arrow/tarball/ to get the matching source tarball. Best Jacob [1]: https://github.com/u

Re: Do we have nightly source tar ball

2022-07-07 Thread Li Jin
Thanks both! This looks useful - I wonder if the version between the crossbow tarball and pypi dist matches (i.e. are they published together)? i.e. the latest crossbow source is "Nightly-test-2022-07-07" and the pypi fury is "pyarrow-9.0.0.dev341.tar.gz" On Thu, Jul 7, 2022 at 11:19 AM Joris V

Re: Do we have nightly source tar ball

2022-07-07 Thread Joris Van den Bossche
We do upload nightly wheels to an alternative PyPI index (see https://arrow.apache.org/docs/python/install.html#installing-nightly-packages), at https://pypi.fury.io/arrow-nightlies/pyarrow, and it seems we actually also upload an sdist there. (it could still be more reliable to used HEAD, though,

Re: Do we have nightly source tar ball

2022-07-07 Thread David Li
Ah. Hmm, while the Crossbow releases do include wheels, they don't include the source (the source link there is for the CI scripts, not Arrow itself). I'm not sure if there's anything else that packages the Python sources. On Thu, Jul 7, 2022, at 11:10, Li Jin wrote: > Thanks David - I am curr

Re: Do we have nightly source tar ball

2022-07-07 Thread Li Jin
Thanks David - I am currently using [1]. A slight issue is that I don't have the corresponding sdist for "pyarrow" so I'm wondering if there is an easy way for me to grab matching [1] source and pyarrow source tarball. Not a big issue, I can create the pyarrow dist from [1] On Thu, Jul 7, 2022 at

Re: Do we have nightly source tar ball

2022-07-07 Thread David Li
Does it work to just use the HEAD [1]? Otherwise, the nightly CI jobs do generate releases, but I don't think there's much of a guarantee around the naming/format being stable [2]. I'm not sure if there's an explicit/dedicated "nightly source release" (I'm not aware of one), or how that would d

Do we have nightly source tar ball

2022-07-07 Thread Li Jin
Hello, I wonder if we have nightly source tarball published somewhere? Li