Re: Continuous benchmarking setup

2018-05-18 Thread Wes McKinney
I know the tool we are using for Python benchmarks is Python-specific -- it would be interesting to see if there's a way to ingest benchmark output (as JSON or some other output) from other programming languages. On Mon, May 14, 2018 at 8:56 AM, Brian Hulette wrote: > Is anyone aware of a way we

Re: Continuous benchmarking setup

2018-05-14 Thread Brian Hulette
Is anyone aware of a way we could set up similar continuous benchmarks for JS? We wrote some benchmarks earlier this year but currently have no automated way of running them. Brian On 05/11/2018 08:21 PM, Wes McKinney wrote: Thanks Tom and Antoine! Since these benchmarks are literally runni

Re: Continuous benchmarking setup

2018-05-11 Thread Wes McKinney
Thanks Tom and Antoine! Since these benchmarks are literally running on a machine in my closet at home, there may be some downtime in the future. At some point we should document a process of setting up a new machine from scratch to be the nightly bare metal benchmark slave. - Wes On Fri, May 11

Re: Continuous benchmarking setup

2018-05-11 Thread Antoine Pitrou
Hi again, Tom has configured the benchmarking machine to run and publish Arrow's ASV-based benchmarks. The latest results can now be seen at: https://pandas.pydata.org/speed/arrow/ I expect these are regenerated on a regular (daily?) basis. Thanks Tom :-) Regards Antoine. On Wed, 11 Apr 20

Re: Continuous benchmarking setup

2018-04-23 Thread Tom Augspurger
es > > On Fri, Apr 13, 2018 at 8:36 AM, Tom Augspurger > wrote: > > They are run daily and published to http://pandas.pydata.org/speed/ > > > > > > > > From: Antoine Pitrou > > Sent: Friday, April 13, 2018 4:2

Re: Continuous benchmarking setup

2018-04-23 Thread Wes McKinney
published to http://pandas.pydata.org/speed/ > > > > From: Antoine Pitrou > Sent: Friday, April 13, 2018 4:28:11 AM > To: dev@arrow.apache.org > Subject: Re: Continuous benchmarking setup > > > Nice! Are the benchmark results publish

Re: Continuous benchmarking setup

2018-04-13 Thread Tom Augspurger
They are run daily and published to http://pandas.pydata.org/speed/ From: Antoine Pitrou Sent: Friday, April 13, 2018 4:28:11 AM To: dev@arrow.apache.org Subject: Re: Continuous benchmarking setup Nice! Are the benchmark results published somewhere? Le 13

Re: Continuous benchmarking setup

2018-04-13 Thread Antoine Pitrou
/full.yml might > work. I'll have to redeploy with the update. > > > From: Wes McKinney > Sent: Thursday, April 12, 2018 7:24:20 PM > To: dev@arrow.apache.org > Subject: Re: Continuous benchmarking setup > > hi Antoine, > > I ha

Re: Continuous benchmarking setup

2018-04-12 Thread Tom Augspurger
Sent: Thursday, April 12, 2018 7:24:20 PM To: dev@arrow.apache.org Subject: Re: Continuous benchmarking setup hi Antoine, I have a bare metal machine at home (affectionately known as the "pandabox") that's available via SSH that we've been using for continuous benchmarking for

Re: Continuous benchmarking setup

2018-04-12 Thread Wes McKinney
hi Antoine, I have a bare metal machine at home (affectionately known as the "pandabox") that's available via SSH that we've been using for continuous benchmarking for other projects. Arrow is welcome to use it. I can give you access to the machine if you would like. Hopefully, we can suitably the