Re: [VOTE] Split JS implementation and Release Process

2025-05-07 Thread Brian Hulette
+1 On Wed, May 7, 2025 at 8:38 AM Bryce Mecum wrote: > +1 (binding) > > On Wed, May 7, 2025 at 1:48 AM Raúl Cumplido wrote: > > > > Hi, > > > > I would like to propose splitting the JS implementation and the > > corresponding release process to its own repository. > > > > Motivation: > > > > *

Re: Kapa.ai bot now live on the dev docs

2025-04-05 Thread Brian Hulette
Very cool, I tried a few queries and it provided good answers. nit: any chance the popup can be made to respect the light/dark mode toggle in the docs? It seems to always use a light color scheme. On Fri, Mar 28, 2025 at 5:05 PM Nic Crane wrote: > Cookbooks aren't part of the sources but we can

Re: [DISCUSS] Do we want to enable GitHub Discussions for apache/arrow?

2025-03-18 Thread Brian Hulette
+1 for mirroring to user@ to reinforce that GH Discussions are for user support and not dev discussion. On Mon, Mar 17, 2025 at 11:40 PM David Li wrote: > I think we could try it for both -java and -adbc. > > On Tue, Mar 18, 2025, at 15:34, Jean-Baptiste Onofré wrote: > > +1 > > > > Do we want t

Re: [DISCUSS] Updating what are considered reference implementations?

2023-01-11 Thread Brian Hulette
I think this [1] is the thread where the policy was proposed, but it doesn't look like we ever settled on "Java and C++" vs. "any two implementations", or had a vote. I worry that requiring maintainers to add new format features to two "complete" implementations will just lead to fragmentation. Pe

Re: [VOTE] Remove compute from Arrow JS

2021-10-27 Thread Brian Hulette
+1 I don't think there's much reason to keep the compute code around when there's a more performant, easier to use alternative. I think the only unique feature of the arrow compute code was the ability to optimize queries on dictionary-encoded columns, but Jeff added this to Arquero almost a year

Re: Improving PR workload management for Arrow maintainers

2021-06-29 Thread Brian Hulette
I review a decent number of PRs for Apache Beam, and I've built some of my own tooling to help keep track of open PRs. I wrote a script that pulls metadata about all relevant PRs and uses some heuristics to categorize them into: - incoming review - outgoing review - "CC'd" - where I've been mention

Re: [ANNOUNCE] New Arrow committer: Dominik Moritz

2021-06-02 Thread Brian Hulette
Congratulations Dominik! Well deserved! Really excited to see some momentum in the JavaScript library On Wed, Jun 2, 2021 at 2:44 PM Dominik Moritz wrote: > Thank you for the warm welcome, Wes. > > I look forward to continue working with you all on Arrow and in particular > the Arrow JavaScrip

Re: Long title on github page

2021-05-17 Thread Brian Hulette
Thank you for bringing this up Dominik. I sampled some of the descriptions for other Apache projects I frequent, the ones with a meaningful description have a single sentence: github.com/apache/spark - Apache Spark - A unified analytics engine for large-scale data processing github.com/apache/beam

Re: [DISCUSS] New Types (Schema.fbs vs Extension Types)

2021-04-30 Thread Brian Hulette
+1 this looks good to me. My only concern is with criteria #3 " Is the underlying encoding of the type already semantically supported by a type?". I think this is a good criteria, but it's inconsistent with the current spec. By that criteria some existing types (Timestamp, Time, Duration, Date) sh

Re: [DISCUSS] How to describe computation on Arrow data?

2021-03-18 Thread Brian Hulette
I agree this would be a great development. It would also be useful for leveraging compute engines from JS via wasm. I've thought about something like this in the context of multi-language relational workloads in Apache Beam, mostly just leading me to wonder if something like it already exists. But

Arrow JS Meetup (02/13)

2021-02-09 Thread Brian Hulette
Hi all, +Dominik Moritz recently reached out to +Paul Taylor and myself to set up an Arrow JS meetup with the goal of re-building some momentum around the Arrow JS library. We've scheduled it for this coming Saturday, 02/13 at 11:30 AM PST. Rough Agenda: - Arrow JS Design Principles, Future Pla

Re: [javascript] streaming IPC examples?

2021-01-24 Thread Brian Hulette
+Paul Taylor would your work with whatwg streams be relevant here? Are there any examples that would be useful for Ryan? Brian On Sat, Jan 23, 2021 at 4:52 PM Ryan McKinley wrote: > Hello- > > I am exploring options to support streaming in grafana. We have a golang > websocket server and am e

Re: [javascript] cant get timestamps in arrow 2.0

2020-12-18 Thread Brian Hulette
glib/Ruby) supports Feather/IPC > files with compression. > > Neal > > On Fri, Dec 18, 2020 at 8:18 AM Brian Hulette wrote: > > > Hi Andrew, > > I'm glad you got this working! The javascript library only implements the > > arrow IPC spec, it doesn't have

Re: [javascript] cant get timestamps in arrow 2.0

2020-12-18 Thread Brian Hulette
Hi Andrew, I'm glad you got this working! The javascript library only implements the arrow IPC spec, it doesn't have any special handling for feather and its compression support. It's good to know that you can read uncompressed feather files, but I'd only expect it to read an IPC stream or file. T

Re: [Discuss] [Rust] Looking to add Wasm32 compile target for rust library

2020-07-20 Thread Brian Hulette
gt; Fwiw, I believe at least the core c++ library already can be compiled to > >> wasm. I think perspective does this [1] > >> > >> > >> I'm curious What are you hoping to achieve with embedded wasm in > spark? > >> > >> Thanks, > &

Re: [Discuss] [Rust] Looking to add Wasm32 compile target for rust library

2020-07-14 Thread Brian Hulette
That sounds great! I'd like to have some support for using the rust and/or C++ libraries in the browser via wasm as well. As long as the community is ok with your overall approach "to add compiler conditionals around any I/O features and libc dependent features of these two libraries," I think it m

Re: [JavaScript] how to set column name after creation?

2020-06-26 Thread Brian Hulette
Hi Ryan, Here or user@arrow.apache.orgis a fine place to ask :) The metadata on Table/Column/Field objects are all immutable, so doing this right now would require creating a new instance of Table with the field renamed, which takes quite a lot of boilerplate. A helper for renaming a column (or ev

Re: Why downloading sources of pyarrow and its requirements takes several minutes?

2020-05-29 Thread Brian Hulette
+1 fo a jira to track this. I looked into it a little bit just out of curiosity. I passed --verbose to pip to get insight into what's going on in in the "Installing build dependencies..." step. I did this for both 0.15.1 and 0.16. They took 4:10 and 5:57 respectively. It looks like 0.16.0 spent 2

Re: [DISCUSS] Leveraging cloud computing resources for Arrow test workloads

2020-03-12 Thread Brian Hulette
* What kind of devops tooling would be appropriate to provision and manage the instances, scaling up and down based on need? * What CI/CD platform would be appropriate to dispatch work to the cloud nodes (taking into consideration the high costs of sysadmin, and seeking to minimize nodes sitting un

Re: [DISCUSS][Java] Support non-nullable vectors

2020-03-11 Thread Brian Hulette
> And there is a "nullable" metadata-only flag at the > Field level. Could the same kinds of optimizations be implemented in > Java without introducing a "nullable" concept? Note Liya Fan did suggest pulling the nullable flag from the Field when the vector is created in item (1) of the proposed ch

Re: [Format] Dictionary edge cases (encoding nulls and nested dictionaries)

2020-02-09 Thread Brian Hulette
> It seems we should potentially disallow dictionaries to contain null values? +1 - I've always thought it was odd you could encode null values in two different places for dictionary encoded columns. You could argue it's more efficient to encode the nulls in the dictionary, but I think if we're goi

Re: [Java] PR Reviewers

2020-01-25 Thread Brian Hulette
I'm still pretty new to the Java implementation, but I can probably help out with some reviews. On Thu, Jan 23, 2020 at 8:41 PM Micah Kornfield wrote: > I mentioned this elsewhere but my intent is to stop doing java reviews for > the immediate future once I wrap up the few that I have requested

Re: [DISCUSS][JAVA] Correct the behavior of ListVector isEmpty

2020-01-24 Thread Brian Hulette
What about returning null for a null list? It looks like now the function returns a primitive boolean, so I guess that would be a substantial change, but null seems more correct to me. On Thu, Jan 23, 2020, 21:38 Micah Kornfield wrote: > I would vote for treating nulls as empty. > > On Fri, Jan

[jira] [Created] (ARROW-7674) Add helpful message for captcha challenge in merge_arrow_pr.py

2020-01-24 Thread Brian Hulette (Jira)
Brian Hulette created ARROW-7674: Summary: Add helpful message for captcha challenge in merge_arrow_pr.py Key: ARROW-7674 URL: https://issues.apache.org/jira/browse/ARROW-7674 Project: Apache Arrow

Re: pyarrow and macOS 10.15

2019-10-11 Thread Brian Hulette
ues.apache.org/jira/browse/ARROW-6860 > > It would be great if the Beam community could work with us to resolve > issues around shipping C++ Protocol Buffers. We don't want you to be > stuck on pyarrow 0.13.0 and have your users be subjected to bugs and > other issues. > >

pyarrow and macOS 10.15

2019-10-10 Thread Brian Hulette
In Beam we've had a few users report issues importing Beam Python after upgrading to macOS 10.15 Catalina, and it seems like our pyarrow import is the root cause [1]. Given that I don't see any reports of this on the arrow side I suspect that this is an issue just with pyarrow 0.14 (in Beam we've r

Re: [ANNOUNCE] New Arrow PMC member: Micah Kornfield

2019-08-09 Thread Brian Hulette
Congratulations Micah! Well deserved :) On Fri, Aug 9, 2019 at 9:02 AM Francois Saint-Jacques < fsaintjacq...@gmail.com> wrote: > Congrats! > > well deserved. > > On Fri, Aug 9, 2019 at 11:12 AM Wes McKinney wrote: > > > > The Project Management Committee (PMC) for Apache Arrow has invited > > M

Re: [DISCUSS][Format] FixedSizeList w/ row-length not specified as part of the type

2019-07-31 Thread Brian Hulette
h individual record could have a different > size. > > > This could be consistent within a given batch, but wouldn't need to be. > > > For example, if I wanted to send a 3-channel image, but the image size > may > > > vary for each record, then I could use &

Re: [DISCUSS][Format] FixedSizeList w/ row-length not specified as part of the type

2019-07-29 Thread Brian Hulette
I think it may be helpful to clarify what you mean by dimensions that are not known in advance. I believe the intention here is that this unknown dimension is consistent within a record batch, but it is allowed to vary from batch to batch. Otherwise, I would say you could just delay creating the sc

Re: [DISCUSS] Format additions for encoding/compression (Was: [Discuss] Format additions to Arrow for sparse data and data integrity)

2019-07-22 Thread Brian Hulette
To me, the most important aspect of this proposal is the addition of sparse encodings, and I'm curious if there are any more objections to that specifically. So far I believe the only one is that it will make computation libraries more complicated. This is absolutely true, but I think it's worth th

[jira] [Created] (ARROW-5741) [JS] Make numeric vector from functions consistent with TypedArray.from

2019-06-26 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-5741: Summary: [JS] Make numeric vector from functions consistent with TypedArray.from Key: ARROW-5741 URL: https://issues.apache.org/jira/browse/ARROW-5741 Project

[jira] [Created] (ARROW-5740) [JS] Add ability to run tests in headless browsers

2019-06-26 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-5740: Summary: [JS] Add ability to run tests in headless browsers Key: ARROW-5740 URL: https://issues.apache.org/jira/browse/ARROW-5740 Project: Apache Arrow

[jira] [Created] (ARROW-5714) [JS] Inconsistent behavior in Int64Builder with/without BigNum

2019-06-24 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-5714: Summary: [JS] Inconsistent behavior in Int64Builder with/without BigNum Key: ARROW-5714 URL: https://issues.apache.org/jira/browse/ARROW-5714 Project: Apache Arrow

[jira] [Created] (ARROW-5689) [JS] Remove hard-coded Field.nullable

2019-06-21 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-5689: Summary: [JS] Remove hard-coded Field.nullable Key: ARROW-5689 URL: https://issues.apache.org/jira/browse/ARROW-5689 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-5688) [JS] Add test for EOS in File Format

2019-06-21 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-5688: Summary: [JS] Add test for EOS in File Format Key: ARROW-5688 URL: https://issues.apache.org/jira/browse/ARROW-5688 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-5491) Remove unecessary semicolons following MACRO definitions

2019-06-03 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-5491: Summary: Remove unecessary semicolons following MACRO definitions Key: ARROW-5491 URL: https://issues.apache.org/jira/browse/ARROW-5491 Project: Apache Arrow

[JS] Proposal for numeric vector `from` functions

2019-05-31 Thread Brian Hulette
I think the current behavior of `from` functions on IntVector and FloatVector can be quite confusing for new arrow users. The current behavior can be summarized as: - if the argument is any type of TypedArray (including one of a mismatched type), create a new vector backed by that array's buffer. -

Confluence edit access

2019-05-17 Thread Brian Hulette
Can I get edit access on confluence? I wanted to answer some of the questions about JS here: https://cwiki.apache.org/confluence/display/ARROW/Columnar+Format+1.0+Milestone My username is bhulette Thanks! Brian

[jira] [Created] (ARROW-5313) [Format] Comments on Field table are a bit confusing

2019-05-13 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-5313: Summary: [Format] Comments on Field table are a bit confusing Key: ARROW-5313 URL: https://issues.apache.org/jira/browse/ARROW-5313 Project: Apache Arrow

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-21 Thread Brian Hulette
+1 (non-binding) Ran `dev/release/js-verify-release-candidate.sh 0.4.1 1` with Node v11.12.0 On Thu, Mar 21, 2019 at 1:54 PM Krisztián Szűcs wrote: > +1 (binding) > > Ran `dev/release/js-verify-release-candidate.sh 0.4.1 1` > with Node v11.12.0 on OSX 10.14.3 and it looks good. > > On Thu, Mar

[jira] [Created] (ARROW-4991) [CI] Bump travis node version to 11.12

2019-03-21 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4991: Summary: [CI] Bump travis node version to 11.12 Key: ARROW-4991 URL: https://issues.apache.org/jira/browse/ARROW-4991 Project: Apache Arrow Issue Type: Bug

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC0

2019-03-21 Thread Brian Hulette
I just merged https://github.com/apache/arrow/pull/4006 that bumps the node requirement to 11.12 to avoid this issue. Krisztian, can you cut an RC1 with that change included? Brian On Thu, Mar 21, 2019 at 10:06 AM Brian Hulette wrote: > It looks like this was an issue with node v11.11 that

[jira] [Created] (ARROW-4988) Bump required node version to 11.12

2019-03-21 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4988: Summary: Bump required node version to 11.12 Key: ARROW-4988 URL: https://issues.apache.org/jira/browse/ARROW-4988 Project: Apache Arrow Issue Type: Bug

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC0

2019-03-21 Thread Brian Hulette
t; (node_modules/jest-util/build/create_process_object.js:15:34) > ``` > > This is the same error as in the nightlies but the fix there doesn't help > for me locally. > > Uwe > > On Thu, Mar 21, 2019, at 2:41 AM, Brian Hulette wrote: > > +1 (non-binding) > > &

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC0

2019-03-20 Thread Brian Hulette
+1 (non-binding) Ran js-verify-release-candidate.sh on Archlinux w/ node v11.12.0 Thanks Krisztian! Brian On Wed, Mar 20, 2019 at 5:40 PM Paul Taylor wrote: > +1 non-binding > > Ran `dev/release/js-verify-release-candidate.sh 0.4.1 0` on MacOS High > Sierra w/ node v11.6.0 > > > On Wed, Mar 20

Re: [DISCUSS] Cutting a JavaScript 0.4.1 bugfix release

2019-03-20 Thread Brian Hulette
Thanks Wes. Krisztian - Uwe cut 0.4.0 for us and said he was pretty comfortable with the process, so you may be able to defer to him if you don't have time. On Wed, Mar 20, 2019 at 3:26 PM Wes McKinney wrote: > It seems based on [1] that we are overdue in cutting a bugfix JS > release because o

Re: Timeline for 0.13 Arrow release

2019-03-20 Thread Brian Hulette
I think that makes sense. I would really like to make JS part of the mainstream releases, but we already have JS-0.4.1 ready to go [1] with primarily bugfixes for JS-0.4.0. I think we should just cut that and integrate JS in 0.14. [1] https://issues.apache.org/jira/projects/ARROW/versions/12344961

Re: Flaky Travis CI builds on master

2019-02-27 Thread Brian Hulette
Another instance of #1 for the JS builds: https://travis-ci.org/apache/arrow/jobs/498967250#L992 I filed https://issues.apache.org/jira/browse/ARROW-4695 about it before seeing this thread. As noted there I was able to replicate the timeout on my laptop at least once. I didn't think to monitor mem

[jira] [Created] (ARROW-4695) [JS] Tests timing out on Travis

2019-02-27 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4695: Summary: [JS] Tests timing out on Travis Key: ARROW-4695 URL: https://issues.apache.org/jira/browse/ARROW-4695 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-4686) Only accept 'y' or 'n' in merge_arrow_pr.py prompts

2019-02-26 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4686: Summary: Only accept 'y' or 'n' in merge_arrow_pr.py prompts Key: ARROW-4686 URL: https://issues.apache.org/jira/browse/ARROW-4686 P

Re: Arrow on WebAssembly

2019-02-19 Thread Brian Hulette
Hi Franco, I'm not aware of anyone trying this in Rust, but Tim Paine at JPMC recently contributed a patch [1] to make it possible to compile the C++ implementation with emscripten, so that he could use it in Perspective [2]. Could you use the C++ lib instead? It would be great if either implement

[jira] [Created] (ARROW-4551) [JS] Investigate using Symbols to access Row columns by index

2019-02-12 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4551: Summary: [JS] Investigate using Symbols to access Row columns by index Key: ARROW-4551 URL: https://issues.apache.org/jira/browse/ARROW-4551 Project: Apache Arrow

[jira] [Created] (ARROW-4524) [JS] only invoke `Object.defineProperty` once per table

2019-02-09 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4524: Summary: [JS] only invoke `Object.defineProperty` once per table Key: ARROW-4524 URL: https://issues.apache.org/jira/browse/ARROW-4524 Project: Apache Arrow

[jira] [Created] (ARROW-4523) [JS] Add row proxy generation benchmark

2019-02-09 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4523: Summary: [JS] Add row proxy generation benchmark Key: ARROW-4523 URL: https://issues.apache.org/jira/browse/ARROW-4523 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-4519) Publish JS API Docs for v0.4.0

2019-02-08 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-4519: Summary: Publish JS API Docs for v0.4.0 Key: ARROW-4519 URL: https://issues.apache.org/jira/browse/ARROW-4519 Project: Apache Arrow Issue Type: Task

Re: [VOTE] Release Apache Arrow JS 0.4.0 - RC1

2019-01-31 Thread Brian Hulette
+1 verified on Archlinux with Node v11.9.0 Thanks a lot for putting the RC together Uwe! On Thu, Jan 31, 2019 at 8:08 AM Uwe L. Korn wrote: > +1 (binding), > > verified on Ubuntu 16.04 with > `./dev/release/js-verify-release-candidate.sh 0.4.0 1` and Node v11.9.0 via > nvm. > > Uwe > > On Thu,

Re: Benchmarking dashboard proposal

2019-01-18 Thread Brian Hulette
We also have some JS benchmarks [1]. Currently they're only really run on an ad-hoc basis to manually test major changes but it would be great to include them in this. [1] https://github.com/apache/arrow/tree/master/js/perf On Fri, Jan 18, 2019 at 12:34 AM Uwe L. Korn wrote: > Hello, > > note t

Re: Arrow JS 0.4.0 Release

2018-12-31 Thread Brian Hulette
is to promote the > > growth and development of a healthy community. This includes making > > sure that the project releases. The JS developer community hasn't > > grown much, though. My approach to such a problem is to act as a > > "community of one" until i

Re: Arrow JS 0.4.0 Release

2018-12-13 Thread Brian Hulette
> > > > With the amount of maintenance work on my plate I have to declare > > bankruptcy on doing any more than I am right now. Can another PMC > > volunteer to be the RM for the 0.4.0 JavaScript release? > > > > Thanks > > Wes > > On Tue, Dec 4, 2018 at

[jira] [Created] (ARROW-3993) [JS] CI Jobs Failing

2018-12-10 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3993: Summary: [JS] CI Jobs Failing Key: ARROW-3993 URL: https://issues.apache.org/jira/browse/ARROW-3993 Project: Apache Arrow Issue Type: Task

Arrow JS 0.4.0 Release

2018-12-04 Thread Brian Hulette
Hi all, It's been quite a while since our last major Arrow JS release (0.3.0 on February 22!), and since then we've added several new features that will make Arrow JS much easier to adopt. We've added convenience functions for creating Arrow vectors and tables natively in JavaScript, an IPC writer,

[jira] [Created] (ARROW-3691) [JS] Update dependencies, switch to terser

2018-11-02 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3691: Summary: [JS] Update dependencies, switch to terser Key: ARROW-3691 URL: https://issues.apache.org/jira/browse/ARROW-3691 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-3689) [JS] Upgrade to TS 3.1

2018-11-01 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3689: Summary: [JS] Upgrade to TS 3.1 Key: ARROW-3689 URL: https://issues.apache.org/jira/browse/ARROW-3689 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-3667) [JS] Incorrectly reads record batches with an all null column

2018-10-31 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3667: Summary: [JS] Incorrectly reads record batches with an all null column Key: ARROW-3667 URL: https://issues.apache.org/jira/browse/ARROW-3667 Project: Apache Arrow

[jira] [Created] (ARROW-3523) [JS] Assign dictionary IDs in IPC writer rather than on creation

2018-10-15 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3523: Summary: [JS] Assign dictionary IDs in IPC writer rather than on creation Key: ARROW-3523 URL: https://issues.apache.org/jira/browse/ARROW-3523 Project: Apache Arrow

[jira] [Created] (ARROW-3425) [JS] Programmatically created dictionary vectors don't get dictionary IDs

2018-10-03 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3425: Summary: [JS] Programmatically created dictionary vectors don't get dictionary IDs Key: ARROW-3425 URL: https://issues.apache.org/jira/browse/ARROW-3425 Pr

Re: Putting out a new JavaScript release?

2018-09-10 Thread Brian Hulette
Thanks for bringing this up Wes. My hope was to get out an 0.4.0 release that just includes the IPC writer and usability improvements relatively soon, and push the refactor out to 0.5.0. Paul's refactor is very exciting and will definitely be good for the project, but I don't think either of us has

[jira] [Created] (ARROW-3113) Merge tool can't specify JS fix version

2018-08-23 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3113: Summary: Merge tool can't specify JS fix version Key: ARROW-3113 URL: https://issues.apache.org/jira/browse/ARROW-3113 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-3074) [JS] Date.indexOf generates an error

2018-08-17 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3074: Summary: [JS] Date.indexOf generates an error Key: ARROW-3074 URL: https://issues.apache.org/jira/browse/ARROW-3074 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-3073) [JS] Add DateVector.from

2018-08-17 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-3073: Summary: [JS] Add DateVector.from Key: ARROW-3073 URL: https://issues.apache.org/jira/browse/ARROW-3073 Project: Apache Arrow Issue Type: New Feature

Re: Creating a user@ mailing list

2018-08-16 Thread Brian Hulette
Agreed. I was concerned about the plan to drop Slack because it was a place users would come to ask questions (for better or worse). I assumed that was because those users were just uncomfortable with mailing lists, but I think Uwe is right, they're probably just uncomfortable with *this* mailing l

[jira] [Created] (ARROW-2909) [JS] Add convenience function for creating a table from a list of vectors

2018-07-25 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2909: Summary: [JS] Add convenience function for creating a table from a list of vectors Key: ARROW-2909 URL: https://issues.apache.org/jira/browse/ARROW-2909 Project

[jira] [Created] (ARROW-2819) [JS] Fails to build with TS 2.8.3

2018-07-09 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2819: Summary: [JS] Fails to build with TS 2.8.3 Key: ARROW-2819 URL: https://issues.apache.org/jira/browse/ARROW-2819 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-2797) [JS] comparison predicates don't work on 64-bit integers

2018-07-05 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2797: Summary: [JS] comparison predicates don't work on 64-bit integers Key: ARROW-2797 URL: https://issues.apache.org/jira/browse/ARROW-2797 Project: Apache

[jira] [Created] (ARROW-2789) [JS] Minor DataFrame improvements

2018-07-03 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2789: Summary: [JS] Minor DataFrame improvements Key: ARROW-2789 URL: https://issues.apache.org/jira/browse/ARROW-2789 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2778) Add Utf8Vector.from

2018-07-01 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2778: Summary: Add Utf8Vector.from Key: ARROW-2778 URL: https://issues.apache.org/jira/browse/ARROW-2778 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-2772) [JS] Commit package-lock.json and/or yarn.lock

2018-07-01 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2772: Summary: [JS] Commit package-lock.json and/or yarn.lock Key: ARROW-2772 URL: https://issues.apache.org/jira/browse/ARROW-2772 Project: Apache Arrow Issue

[jira] [Created] (ARROW-2771) [JS] Add row proxy object accessor

2018-06-30 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2771: Summary: [JS] Add row proxy object accessor Key: ARROW-2771 URL: https://issues.apache.org/jira/browse/ARROW-2771 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2767) [JS] Add generic to Table for column names

2018-06-29 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2767: Summary: [JS] Add generic to Table for column names Key: ARROW-2767 URL: https://issues.apache.org/jira/browse/ARROW-2767 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2766) [JS] Add ability to construct a Table from a list of Arrays/TypedArrays

2018-06-29 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2766: Summary: [JS] Add ability to construct a Table from a list of Arrays/TypedArrays Key: ARROW-2766 URL: https://issues.apache.org/jira/browse/ARROW-2766 Project

[jira] [Created] (ARROW-2765) [JS] add Vector.map

2018-06-29 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2765: Summary: [JS] add Vector.map Key: ARROW-2765 URL: https://issues.apache.org/jira/browse/ARROW-2765 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-2764) [JS] Easy way to add a column to a Table

2018-06-29 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2764: Summary: [JS] Easy way to add a column to a Table Key: ARROW-2764 URL: https://issues.apache.org/jira/browse/ARROW-2764 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2762) [JS] Remove unused perf/config.js

2018-06-28 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2762: Summary: [JS] Remove unused perf/config.js Key: ARROW-2762 URL: https://issues.apache.org/jira/browse/ARROW-2762 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-2584) [JS] Node v10 issues

2018-05-15 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2584: Summary: [JS] Node v10 issues Key: ARROW-2584 URL: https://issues.apache.org/jira/browse/ARROW-2584 Project: Apache Arrow Issue Type: Bug

Re: Continuous benchmarking setup

2018-05-14 Thread Brian Hulette
Is anyone aware of a way we could set up similar continuous benchmarks for JS? We wrote some benchmarks earlier this year but currently have no automated way of running them. Brian On 05/11/2018 08:21 PM, Wes McKinney wrote: Thanks Tom and Antoine! Since these benchmarks are literally runni

Re: [Format] Pointer types / span types

2018-05-02 Thread Brian Hulette
with developing community standards based on the building blocks we already have - Wes On Wed, May 2, 2018 at 3:38 PM, Brian Hulette wrote: If this were accomplished at the application level, how would it work with the IPC formats? I'd think you'd need to have two separate files (o

Re: [Format] Pointer types / span types

2018-05-02 Thread Brian Hulette
If this were accomplished at the application level, how would it work with the IPC formats? I'd think you'd need to have two separate files (or streams), since array 1 and array 2 will be different lengths. Perhaps that could be an argument for making span a core logical type? Brian On 05/02

Re: [Format] Pointer types / span types

2018-04-30 Thread Brian Hulette
Yes my first reaction to both of these requests is - would dictionary-encoding work? - would a List work? I think for the former the analogy is more clear, for the latter, technically a List encodes start and stop indices with an offset array rather than separate arrays for start and stop indic

Re: Allow dictionary-encoded children?

2018-04-06 Thread Brian Hulette
due to the fact that Parquet uses repetition and definition levels to encode arbitrarily nested data types. These are more space-efficient when they are correctly encoded but don't provide random access. Uwe On Fri, Apr 6, 2018, at 4:42 PM, Brian Hulette wrote: I've been considering a u

[jira] [Created] (ARROW-2412) [Integration] Add nested dictionary integration test

2018-04-06 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2412: Summary: [Integration] Add nested dictionary integration test Key: ARROW-2412 URL: https://issues.apache.org/jira/browse/ARROW-2412 Project: Apache Arrow

[jira] [Created] (ARROW-2410) [JS] Add DataFrame.scanAsync

2018-04-06 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2410: Summary: [JS] Add DataFrame.scanAsync Key: ARROW-2410 URL: https://issues.apache.org/jira/browse/ARROW-2410 Project: Apache Arrow Issue Type: Improvement

Allow dictionary-encoded children?

2018-04-06 Thread Brian Hulette
I've been considering a use-case with a dictionary-encoded struct column, which may contain some dictionary-encoded columns itself. More specifically, in this use-case each row represents a single observation in a geospatial track, which includes a position, a time, and some track-level metadat

[jira] [Created] (ARROW-2327) [JS] Table.fromStruct missing from externs

2018-03-19 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2327: Summary: [JS] Table.fromStruct missing from externs Key: ARROW-2327 URL: https://issues.apache.org/jira/browse/ARROW-2327 Project: Apache Arrow Issue Type

Re: [VOTE] Apache Arrow JavaScript 0.3.1 - RC1

2018-03-15 Thread Brian Hulette
+1 (non-binding). Ran js-verify-release-candidate.sh with Node 8.9.1 on Ubuntu 16.04. Thanks Wes! On 03/15/2018 05:17 AM, Uwe L. Korn wrote: +1 (binding). Ran js-verify-release-candidate.sh with Node 9.8.0 On Thu, Mar 15, 2018, at 1:50 AM, Wes McKinney wrote: +1 (binding). Ran js-verify-rele

Re: gReetings

2018-03-14 Thread Brian Hulette
If you prefer slack over (or in addition to) the mailing list there's also the Arrow slack. We recently made a #javascript channel there for discussions about that implementation, you could certainly do the same for R. [1] https://apachearrow.slack.com [2] https://apachearrowslackin.herokuapp.

[jira] [Created] (ARROW-2297) [JS] babel-jest is not listed as a dev dependency

2018-03-12 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2297: Summary: [JS] babel-jest is not listed as a dev dependency Key: ARROW-2297 URL: https://issues.apache.org/jira/browse/ARROW-2297 Project: Apache Arrow Issue

Re: [VOTE] Release Apache Arrow JavaScript 0.3.1 - RC0

2018-03-12 Thread Brian Hulette
-1 (non-binding) I get an error when running js-verify-release-candidate.sh, which I can also replicate with a fresh clone of arrow on commit 17b09ca0676995cb62ea1f9b6d6fa2afd99c33c6 by running `npm install` and then `npm run test -- -t ts`: [10:21:08] Starting 'test:ts'... ● Validation Error:

Re: Making a bugfix Arrow JS release

2018-03-07 Thread Brian Hulette
Naveen, Yes I think when we initially discussed adding the JS dataframe ops we argued that it could be a separate library within the Apache Arrow monorepo, since some users will just want the ability to read/write arrow data, and we shouldn't force them to pull in a dataframe API they won't b

Re: Making a bugfix Arrow JS release

2018-03-06 Thread Brian Hulette
We're just wrapping up https://github.com/apache/arrow/pull/1678, and I would also like to merge https://github.com/apache/arrow/pull/1683, even though its technically not a bugfix.. it makes the df interface much more useful. Once we merge those I'd be happy cutting a bugfix release, unless

[jira] [Created] (ARROW-2236) [JS] Add more complete set of predicates

2018-02-28 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-2236: Summary: [JS] Add more complete set of predicates Key: ARROW-2236 URL: https://issues.apache.org/jira/browse/ARROW-2236 Project: Apache Arrow Issue Type

  1   2   >