Re: Review request for Dataset Java API PRs

2021-08-22 Thread Hongze Zhang
Hello guys, sorry I have to to request for review here again since progress didn't seem to be made yet :(. These PRs are important to Dataset Java implementation as the first version of it was too basic to serve advanced use cases. If reviewing of the big write support PR[1] sounds to be a bit of c

Re: Review request for Dataset Java API PRs

2021-08-05 Thread Hongze Zhang
Thanks everyone for the quick response! By the way I might raise this review request a little bit late because I was working on some other projects in the last few months either. Now I just have some time to push this forward. :) About ARROW-11776: On Wed, 2021-08-04 at 08:45 -0700, Micah Kornfi

Re: Review request for Dataset Java API PRs

2021-08-04 Thread Paul Whalen
I would love to see a component or some standardization around Java using the C Data Interface. I’ve been prototyping JNI bindings for DataFusion in the last week or so with some success, and was getting ready to ask where/how such a thing might fit in. I’ll be sure to watch that JIRA. (I also

Re: Review request for Dataset Java API PRs

2021-08-04 Thread Antoine Pitrou
I don't know about the rest of these tasks, but sharing data between Arrow Java and C++ should definitely use the C data interface. It seems there's work in progress here, feel free to collaborate: https://issues.apache.org/jira/browse/ARROW-12965 Regards Antoine. Le 04/08/2021 à 17:45, M

Re: Review request for Dataset Java API PRs

2021-08-04 Thread Micah Kornfield
Hi Hongze, Sorry I started taking a look at these a while ago, but my focus has been elsewhere with the time I have available to contribute to the project. One thing that can also help is if there is a way to divide any of the PRs into smaller standalone components it would likely help get them me

Re: Review request for Dataset Java API PRs

2021-08-04 Thread Wes McKinney
hi Hongze — I am not sure who will be able to review these, but in the future feel free to raise your Java PRs on the mailing list even sooner, no need to wait for more than a month. There are far fewer active Java developers vs. C++ or Rust, so it can help to get people's attention on your work.