+1
Installed the wheel and tested it by running simple usage and reading
a parquet file from arrow testing data.
>>> import datafusion
>>> ctx = datafusion.SessionContext()
>>> df =
>>> ctx.read_parquet('/path/to/testing/data/parquet/generated_simple_numerics/blogs.parquet')
>>> df.show()
...
>>> df.limit(1).show()
+------------------------------------------+----------------------+
| reply | blog_id |
+------------------------------------------+----------------------+
| {"reply_id": 332770973, "next_id": null} | -1473106667809783919 |
+------------------------------------------+----------------------+
On Fri, Nov 25, 2022 at 11:16 AM Andrew Lamb <[email protected]> wrote:
>
> +1
>
> I verified the signatures, and installed the wheel and tested out reading
> some parquet. It worked great!
>
> Thank you for doing this Andy -- the python binding are so important
>
>
> >>> df = ctx.read_parquet('/Users/alamb/Downloads/cpu.parquet')
> >>> df.limit(10).show()
> +-----------+-----------------------------------+---------------------+-------------+------------------+---------------------+--------------+-----------+------------+---------------+-------------+--------------------+-------------------+
> | cpu | host | time |
> usage_guest | usage_guest_nice | usage_idle | usage_iowait |
> usage_irq | usage_nice | usage_softirq | usage_steal | usage_system |
> usage_user |
> +-----------+-----------------------------------+---------------------+-------------+------------------+---------------------+--------------+-----------+------------+---------------+-------------+--------------------+-------------------+
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:45:50 | 0
> | 0 | 88.22131916285875 | 0 | 0
> | 0 | 0 | 0 | 7.92122538297707 |
> 3.857455454801022 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:46:00 | 0
> | 0 | 32.20033554948997 | 0 | 0
> | 0 | 0 | 0 | 16.199589883629166 |
> 51.60007456610322 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:46:10 | 0
> | 0 | 0.20071504695935447 | 0 | 0
> | 0 | 0 | 0 | 14.614564385643801 |
> 85.18472056714127 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:46:20 | 0
> | 0 | 0.2313367513523604 | 0 | 0
> | 0 | 0 | 0 | 13.967737901756506 |
> 85.80092534727326 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:46:30 | 0
> | 0 | 0.8125507843064688 | 0 | 0
> | 0 | 0 | 0 | 9.569348084258632 |
> 89.61810113119842 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:46:40 | 0
> | 0 | 0.700087511006769 | 0 | 0
> | 0 | 0 | 0 | 9.744968120985714 |
> 89.55494436780741 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:46:50 | 0
> | 0 | 3.7204128301494865 | 0 | 0
> | 0 | 0 | 0 | 19.522897225075514 |
> 76.75668994472105 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:47:00 | 0
> | 0 | 0.19592971785649965 | 0 | 0
> | 0 | 0 | 0 | 18.986221716745344 |
> 80.8178485658948 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:47:10 | 0
> | 0 | 2.2297170696832063 | 0 | 0
> | 0 | 0 | 0 | 13.821747548435754 |
> 83.94853538128119 |
> | cpu-total | MacBook-Pro-8.hsd1.ma.comcast.net | 2022-09-30T12:47:20 | 0
> | 0 | 1.5260491584825744 | 0 | 0
> | 0 | 0 | 0 | 11.851898180099917 |
> 86.62205266189078 |
> +-----------+-----------------------------------+---------------------+-------------+------------------+---------------------+--------------+-----------+------------+---------------+-------------+--------------------+-------------------+
>
> On Fri, Nov 25, 2022 at 1:45 PM Andy Grove <[email protected]> wrote:
>
> > Hi,
> >
> > I would like to propose a release of Apache Arrow DataFusion Python
> > Bindings,
> > version 0.7.0.
> >
> > This release candidate is based on commit:
> > 605a07514147a8b37cdd5c4c85bb55123df97faf [1]
> > The proposed release tarball and signatures are hosted at [2].
> > The changelog is located at [3].
> > The Python wheels are located at [4].
> >
> > Please download, verify checksums and signatures, run the unit tests, test
> > the wheels, and vote
> > on the release. The vote will be open for at least 72 hours.
> >
> > Only votes from PMC members are binding, but all members of the community
> > are
> > encouraged to test the release and vote with "(non-binding)".
> >
> > [ ] +1 Release this as Apache Arrow DataFusion Python 0.7.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow DataFusion Python 0.7.0
> > because...
> >
> > Here is my vote:
> >
> > +1
> >
> > [1]:
> >
> > https://github.com/apache/arrow-datafusion-python/tree/605a07514147a8b37cdd5c4c85bb55123df97faf
> > [2]:
> >
> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-datafusion-python-0.7.0-rc1
> > [3]:
> >
> > https://github.com/apache/arrow-datafusion-python/blob/605a07514147a8b37cdd5c4c85bb55123df97faf/CHANGELOG.md
> > [4]:
> >
> > https://github.com/apache/arrow-datafusion-python/suites/9509495257/artifacts/451325570
> >
