Re: Merge a pull request with GitHub API

2022-05-31 Thread Sutou Kouhei
Hi, There are no objections. I've merged this: https://github.com/apache/arrow/pull/13184 Thanks, -- kou In <20220525.061541.194737838528371525@clear-code.com> "Re: Merge a pull request with GitHub API" on Wed, 25 May 2022 06:15:41 +0900 (JST), Sutou Kouhei

Re: [Discuss][C++] macOS minimum requirements

2022-06-01 Thread Sutou Kouhei
Hi, In "[Discuss][C++] macOS minimum requirements" on Wed, 1 Jun 2022 16:22:17 +0200, Antoine Pitrou wrote: > The topic came up recently of bumping up our minimal macOS > requirements from 10.11 to 10.13 (*). Do people have any particular > concerns about this? > > (*) https://github.com/

Re: [Dev] Switch to token authentication for archery & merge script

2022-06-01 Thread Sutou Kouhei
Hi, I like this. I tried this before but it didn't work. I tried the pull request and it worked! Thanks, -- kou In "[Dev] Switch to token authentication for archery & merge script" on Wed, 1 Jun 2022 13:44:06 +0200, Jacob Wujciak wrote: > Hello Everyone, > > I would like to propose th

[C++] Can we remove cpp/src/arrow/dbi/hiveserver2?

2022-06-02 Thread Sutou Kouhei
Hi, We have Hive adapter in cpp/src/arrow/dbi/hiveserver2 but it's not maintained. Can we remove this? Reasons: 1. I got build errors when I build it on master by -DARROW_HIVESERVER2=ON. See https://github.com/apache/arrow/pull/13292 for a fix of the build errors. We don't receive a

Re: [C++] Can we remove cpp/src/arrow/dbi/hiveserver2?

2022-06-06 Thread Sutou Kouhei
t;> +1 >> >> On Mon, Jun 6, 2022 at 8:58 AM Antoine Pitrou wrote: >> >> > >> > +1 for removing it. >> > >> > >> > On Fri, 03 Jun 2022 08:32:35 +0900 (JST) >> > Sutou Kouhei wrote: >> > > Hi, >> > > >

Re: Apache Arrow development using CLion

2022-06-07 Thread Sutou Kouhei
Hi, I'm not a CLion user but could you share error messages, logs or something from CLion? Thanks, -- kou In "Apache Arrow development using CLion" on Tue, 7 Jun 2022 22:44:48 +0530, Dulvin Witharane wrote: > Hi, > > I was looking to use CLion as the IDE for arrow development. Any guide

Re: Cpp Win32/MSVC build

2022-06-07 Thread Sutou Kouhei
Hi, Could you open a pull request on https://github.com/apache/arrow to review the patch? See also: * https://arrow.apache.org/docs/developers/guide/step_by_step/pr_lifecycle.html#create-pr * https://arrow.apache.org/docs/developers/overview.html#pull-request-and-review Thanks, -- kou

Re: [MATLAB] Integrating a framework for connecting MATLAB and C++ objects using MEX

2022-06-07 Thread Sutou Kouhei
Hi, Can we use the object dispatch layer as a library? Or should we copy (or submodule) the object dispatch layer to apache/arrow? If we can use the object dispatch layer as a library, we can just use it as an external library like GoogleTest. We don't need IP clearance. You can use any Apache Li

Re: [VOTE] Mark C Stream Interface as Stable

2022-06-08 Thread Sutou Kouhei
+1 In "[VOTE] Mark C Stream Interface as Stable" on Wed, 8 Jun 2022 11:15:29 -0700, Will Jones wrote: > Hi, > > Given all feedback to discussion [1] has been positive, I would like to > propose marking the C Stream Interface as stable. > > I have prepared PRs in apache/arrow [2] and apach

Re: [MATLAB] Integrating a framework for connecting MATLAB and C++ objects using MEX

2022-06-10 Thread Sutou Kouhei
to > iterate frequently on the object dispatch layer early on. > > It's quite possible that I am not answering your questions completely, so > please let me know if anything is unclear. My apologies in advance for any > confusion. > > [1] > https://www.mathworks.c

Re: [Go][Release][Discussion] Patch release for Go libraries to address CVE-2022-28948

2022-06-12 Thread Sutou Kouhei
Hi, I'm also not an expert but I think that we need to "release" (vote) a patch version. (I think that just doing "git tag" isn't suitable.) Because we need to "release" to announce users to use "go/v8.0.1" rather than "go/v8.0.0": https://www.apache.org/legal/release-policy.html#publication >

Re: [MATLAB] Integrating a framework for connecting MATLAB and C++ objects using MEX

2022-06-12 Thread Sutou Kouhei
ch and build the source code dynamically. > > Once the object dispatch layer is available on GitHub, I will follow up on > this email thread with a link to the repository so that anyone in the > community can track development progress, as well as contribute to the > framework, if

Re: Custom default C++ memory pool on Linux, and/or interception/auditing of system pool

2022-06-14 Thread Sutou Kouhei
Hi, posix_memalign() in memory_pool.cc of libarrow-dev uses jemalloc's posix_memalign() (je_posix_memalign()). Because it's built with ARROW_JEMALLOC=ON (default) and JEMALLOC_MANGLE https://github.com/apache/arrow/blob/master/cpp/src/arrow/memory_pool.cc#L53 . So we can't use mimalloc with LD_PRE

Re: [C++] Can we remove cpp/src/arrow/dbi/hiveserver2?

2022-06-14 Thread Sutou Kouhei
2022 14:56:34 +0900 (JST), Sutou Kouhei wrote: > Hi, > > Yes, I'll merge the fix and then remove > cpp/src/arrow/dbi/hiveserver2. > > > Thanks, > -- > kou > > In > "Re: [C++] Can we remove cpp/src/arrow/dbi/hiveserver2?" on Mon, 6 Jun 202

Re: Custom default C++ memory pool on Linux, and/or interception/auditing of system pool

2022-06-14 Thread Sutou Kouhei
ning about builtins for those using the interception techniques such as > LD_PRELOAD. > > -John > > On Tue, Jun 14, 2022 at 3:40 PM Sutou Kouhei wrote: > >> Hi, >> >> posix_memalign() in memory_pool.cc of libarrow-dev uses >> jemalloc's posix_memal

Re: Custom default C++ memory pool on Linux, and/or interception/auditing of system pool

2022-06-14 Thread Sutou Kouhei
code.com> "Re: Custom default C++ memory pool on Linux, and/or interception/auditing of system pool" on Wed, 15 Jun 2022 08:38:54 +0900 (JST), Sutou Kouhei wrote: > Hi, > > I think that compiler builtins aren't related. Could you try > only with -DARROW_JEMALLO

Re: [question] Arrow C GLib conda package

2022-06-23 Thread Sutou Kouhei
Hi, No. The Apache Arrow C GLib package doesn't exist on conda-forge. I think that we need to create https://github.com/conda-forge/arrow-c-glib-feedstock or something like https://github.com/conda-forge/arrow-cpp-feedstock for it. Uwe will help you. Thanks, -- kou In "[question] Arrow C

Re: [question] Arrow C GLib conda package

2022-06-24 Thread Sutou Kouhei
at today. > > > On Thu, Jun 23, 2022 at 7:58 PM Sutou Kouhei wrote: > >> Hi, >> >> No. The Apache Arrow C GLib package doesn't exist on >> conda-forge. >> >> I think that we need to create >> https://github.com/conda-forge/arrow-c-glib-

Re: [Nightly builds] Crossbow nightly report page announcement + next steps

2022-06-28 Thread Sutou Kouhei
Hi, Great! Thanks Raul! > a. Stop sending nightly build emails. With the new chat notifications these > should be unnecessary now. We can keep improving both the static page and > the existing chat notifications. Could you enable the Zulip's public access option[1][2] like Rust's Zulip[3]? [1]

Re: [VOTE] Accept donation of Flight SQL JDBC driver

2022-06-30 Thread Sutou Kouhei
+1 > [2]: > https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/arrow-flight-sql-jdbc-driver.xml HTML version: https://incubator.apache.org/ip-clearance/arrow-flight-sql-jdbc-driver.html Could you also add this to https://svn.apache.org/repos/asf/incubator/public/trunk

Re: [question] Arrow C GLib conda package

2022-06-30 Thread Sutou Kouhei
Great! In "Re: [question] Arrow C GLib conda package" on Thu, 30 Jun 2022 19:20:54 -0400, Ivan Ogasawara wrote: > arrow-c-glib is already on conda-forge!! > https://github.com/conda-forge/arrow-c-glib-feedstock > > thanks @kou for the review! > > > On Wed, Jun 29, 2022 at 1:28 PM Ivan O

Can we add out of ASF packages to our APT/Yum repositories?

2022-07-03 Thread Sutou Kouhei
Hi, I'm developing the C API for DataFusion: https://github.com/datafusion-contrib/datafusion-c/ DataFusion itself is developed by ASF but the C API isn't developed by ASF. Because it's developed under https://github.com/datafusion-contrib/ . I want to create .deb/.rpm of the C API for DataFusio

Help drafting Apache Arrow 2022-07 board report

2022-07-06 Thread Sutou Kouhei
Hi, I started a document where we can crowdsource the 2022-07 board report: https://github.com/apache/arrow/pull/13525 If you're a committer, you can push your changes directly. Others can leave comments/suggestions. It's due on Jul 13th. Thanks, -- kou

Re: cpp arrow manage stream with incomplete records

2022-07-07 Thread Sutou Kouhei
Hi, How about using arrow::ipc::StreamDecoder instead of arrow::ipc::StreamReader? class MyListener : public arrow::ipc::Listener { public: arrow::Status OnRecordBatchDecoded(std::shared_ptr record_batch) override { ArrowFilter arrow_filter = ArrowFilter(record_batch);

Re: StreamDecoder zero-copy (?) for pre-framed contiguous Messages

2022-07-07 Thread Sutou Kouhei
Hi, Yes. It's zero-copy. See also the documentation of arrow::ipc::StreamDecoder::next_required_size(): https://arrow.apache.org/docs/cpp/api/ipc.html#_CPPv4NK5arrow3ipc13StreamDecoder18next_required_sizeEv Thanks, -- kou In "StreamDecoder zero-copy (?) for pre-framed contiguous Messages" o

Re: [Go][Release][Discussion] Patch release for Go libraries to address CVE-2022-28948

2022-07-07 Thread Sutou Kouhei
t;> this too. > > Same. This isn't exactly something I can pretend to be very familiar with > particularly as a policy decision. Hopefully others will comment and > respond to this. > > --Matt > > On Sun, Jun 12, 2022 at 10:06 PM Sutou Kouhei wrote: > >> Hi

Re: Help drafting Apache Arrow 2022-07 board report

2022-07-10 Thread Sutou Kouhei
Hi, I'll submit this in 24 hours. If you have any comments, please comment them on the pull request. Thanks, -- kou In <20220706.173359.653992459725473039@clear-code.com> "Help drafting Apache Arrow 2022-07 board report" on Wed, 06 Jul 2022 17:33:59 +0900 (JST),

Re: Help drafting Apache Arrow 2022-07 board report

2022-07-11 Thread Sutou Kouhei
Submitted: https://whimsy.apache.org/board/agenda/2022-07-20/Arrow Thank you all! In <20220711.125944.837133348283645422@clear-code.com> "Re: Help drafting Apache Arrow 2022-07 board report" on Mon, 11 Jul 2022 12:59:44 +0900 (JST), Sutou Kouhei wrote: > Hi, >

Re: [question] arrow-c-glib examples and references

2022-07-12 Thread Sutou Kouhei
Hi, Could you explain what do you want to do? (We have cookbooks for other languages but don't have cookbook for Apache Arrow C GLib yet... https://arrow.apache.org/cookbook/ ) Thanks, -- kou In "[question] arrow-c-glib examples and references" on Tue, 12 Jul 2022 22:25:42 -0400, Ivan O

Re: [question] arrow-c-glib examples and references

2022-07-13 Thread Sutou Kouhei
2022 12:09:50 -0400, Ivan Ogasawara wrote: > On Wed, Jul 13, 2022 at 12:48 AM Sutou Kouhei wrote: > >> Hi, >> >> Could you explain what do you want to do? >> > > sure thing! sorry I forgot to give more details XD > > So basically, I am investigat

Re: [MATLAB] Integrating a framework for connecting MATLAB and C++ objects using MEX

2022-07-13 Thread Sutou Kouhei
opment efforts for the MATLAB interface. > > Thank you again to the community for providing helpful feedback and enabling > us to move forward. > > [1] https://github.com/mathworks/libmexclass/blob/main/LICENSE > [2] https://github.com/mathworks/libmexclass > [3] https://www.mat

Re: [Go][Release][Discussion] Patch release for Go libraries to address CVE-2022-28948

2022-07-14 Thread Sutou Kouhei
to address CVE-2022-28948" on Fri, 08 Jul 2022 11:01:01 +0900 (JST), Sutou Kouhei wrote: > Hi, > > It seems that there are no objections for these patch releases. > > I'll initiate these patch releases. Here is my plan. If > there are any objections/concerns, pleas

[VOTE] Release Apache Arrow 6.0.2 - RC0

2022-07-14 Thread Sutou Kouhei
Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 6.0.2. This is a release consisting of 1 resolved JIRA issues[1]. This is one of releases[2] that focus on a Go related security vulnerability[3]. We don't publish binary artifacts of this release because we

[VOTE] Release Apache Arrow 8.0.1 - RC0

2022-07-14 Thread Sutou Kouhei
Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 8.0.1. This is a release consisting of 1 resolved JIRA issues[1]. This is one of releases[2] that focus on a Go related security vulnerability[3]. We don't publish binary artifacts of this release because we

[VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-14 Thread Sutou Kouhei
Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 7.0.1. This is a release consisting of 1 resolved JIRA issues[1]. This is one of releases[2] that focus on a Go related security vulnerability[3]. We don't publish binary artifacts of this release because we

Re: [VOTE] Release Apache Arrow 6.0.2 - RC0

2022-07-14 Thread Sutou Kouhei
FYI: Here are verification results on GitHub Actions: https://github.com/apache/arrow/pull/13603#issuecomment-1183912949 In <20220715.061031.728260673372395082@clear-code.com> "[VOTE] Release Apache Arrow 6.0.2 - RC0" on Fri, 15 Jul 2022 06:10:31 +0900 (JST), Sutou Kouh

Re: [VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-14 Thread Sutou Kouhei
FYI: Here are verification results on GitHub Actions: https://github.com/apache/arrow/pull/13607#issuecomment-1184118112 In <20220715.061039.1868304737470784647@clear-code.com> "[VOTE] Release Apache Arrow 7.0.1 - RC0" on Fri, 15 Jul 2022 06:10:39 +0900 (JST), Sutou Kouh

Re: [VOTE] Release Apache Arrow 8.0.1 - RC0

2022-07-14 Thread Sutou Kouhei
FYI: Here are verification results on GitHub Actions: https://github.com/apache/arrow/pull/13604#issuecomment-1183937088 In <20220715.061057.1116573445635493266@clear-code.com> "[VOTE] Release Apache Arrow 8.0.1 - RC0" on Fri, 15 Jul 2022 06:10:57 +0900 (JST), Sutou Kouh

Re: [VOTE] Release Apache Arrow 6.0.2 - RC0

2022-07-14 Thread Sutou Kouhei
pache Arrow 6.0.2 - RC0" on Fri, 15 Jul 2022 06:10:31 +0900 (JST), Sutou Kouhei wrote: > Hi, > > I would like to propose the following release candidate > (RC0) of Apache Arrow version 6.0.2. This is a release > consisting of 1 resolved JIRA issues[1]. > > This is

Re: [VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-14 Thread Sutou Kouhei
pache Arrow 7.0.1 - RC0" on Fri, 15 Jul 2022 06:10:39 +0900 (JST), Sutou Kouhei wrote: > Hi, > > I would like to propose the following release candidate > (RC0) of Apache Arrow version 7.0.1. This is a release > consisting of 1 resolved JIRA issues[1]. > > This is

Re: [VOTE] Release Apache Arrow 8.0.1 - RC0

2022-07-14 Thread Sutou Kouhei
pache Arrow 8.0.1 - RC0" on Fri, 15 Jul 2022 06:10:57 +0900 (JST), Sutou Kouhei wrote: > Hi, > > I would like to propose the following release candidate > (RC0) of Apache Arrow version 8.0.1. This is a release > consisting of 1 resolved JIRA issues[1]. > > This is

Re: [VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-15 Thread Sutou Kouhei
t;> wrote: >> >> > +1, verified on ubuntu 22.04 >> > >> > On Fri, Jul 15, 2022 at 2:59 AM Yibo Cai wrote: >> > >> > > +1, verified on arm64 >> > > >> > > -Original Message- >> > > From: Sutou Kouhei

Re: [VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-18 Thread Sutou Kouhei
gt; On Fri, Jul 15, 2022 at 11:58 PM Sutou Kouhei wrote: > >> Hi, >> >> It seems that this is related to >> https://github.com/apache/arrow/pull/12303 . >> Should we backport this too? >> >> Thanks, >> -- >> kou >> >> In &g

[RESULT][VOTE] Release Apache Arrow 6.0.2 - RC0

2022-07-18 Thread Sutou Kouhei
Hi, The vote carries with 4 +1 binding votes and 2 +1 non-binding votes. I'll publish this as 6.0.2. Thanks, -- kou In <20220715.061031.728260673372395082@clear-code.com> "[VOTE] Release Apache Arrow 6.0.2 - RC0" on Fri, 15 Jul 2022 06:10:31 +0900 (JST), Sutou

[RESULT][VOTE] Release Apache Arrow 8.0.1 - RC0

2022-07-18 Thread Sutou Kouhei
Hi, The vote carries with 4 +1 binding votes and 2 +1 non-binding votes. I'll publish this as 8.0.1. Thanks, -- kou In <20220715.061057.1116573445635493266@clear-code.com> "[VOTE] Release Apache Arrow 8.0.1 - RC0" on Fri, 15 Jul 2022 06:10:57 +0900 (JST), Sutou

Re: [VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-18 Thread Sutou Kouhei
go > version 1.16, which as far as I'm aware is the version that is run for our > current CI, then there shouldn't be any issues with the other extraneous > package version bumps. > > In my opinion, it's fine to release as-is. > > --Matt > > On Mon, J

[RESULT][VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-18 Thread Sutou Kouhei
l 2022 06:10:39 +0900 (JST), Sutou Kouhei wrote: > Hi, > > I would like to propose the following release candidate > (RC0) of Apache Arrow version 7.0.1. This is a release > consisting of 1 resolved JIRA issues[1]. > > This is one of releases[2] that focus on a Go rel

Re: [RESULT][VOTE] Release Apache Arrow 6.0.2 - RC0

2022-07-18 Thread Sutou Kouhei
e Arrow 6.0.2 - RC0" on Tue, 19 Jul 2022 09:30:14 +0900 (JST), Sutou Kouhei wrote: > Hi, > > The vote carries with 4 +1 binding votes and 2 +1 > non-binding votes. > > I'll publish this as 6.0.2. > > Thanks, > -- > kou > > In <20220715.0

Re: [RESULT][VOTE] Release Apache Arrow 7.0.1 - RC0

2022-07-18 Thread Sutou Kouhei
e Arrow 7.0.1 - RC0" on Tue, 19 Jul 2022 09:41:04 +0900 (JST), Sutou Kouhei wrote: > Hi, > > The vote carries with 3 +1 binding votes, 1 +1 non-binding > vote, 1 +0 binding vote and 1 +0 binding vote. > > I'll publish this as 7.0.1. > > Thanks, > -- >

Re: [RESULT][VOTE] Release Apache Arrow 8.0.1 - RC0

2022-07-18 Thread Sutou Kouhei
e Arrow 8.0.1 - RC0" on Tue, 19 Jul 2022 09:31:00 +0900 (JST), Sutou Kouhei wrote: > Hi, > > The vote carries with 4 +1 binding votes and 2 +1 > non-binding votes. > > I'll publish this as 8.0.1. > > Thanks, > -- > kou > > In <20220715.06

Re: [Rust] IPC Format / Feather support in Datafusion

2022-07-25 Thread Sutou Kouhei
Hi, https://issues.apache.org/jira/browse/ARROW-17092 may be related. Thanks, -- kou In "Re: [Rust] IPC Format / Feather support in Datafusion" on Mon, 25 Jul 2022 13:39:54 -0700, Aldrin wrote: > It seems unfortunate to me that the feather file format doc page [1] > appears to have been

Re: [DISCUSS] Disable dependabot automated PRs

2022-07-27 Thread Sutou Kouhei
Hi, Why do we ignore PRs from dependabot? Generally, dependabot is useful to avoid security vulnerability. Thanks, -- kou In "[DISCUSS] Disable dependabot automated PRs" on Thu, 21 Jul 2022 15:35:57 +0200, Raul Cumplido Dominguez wrote: > Hi, > > There was a discussion on Zulip dev abo

Re: [RESULT][VOTE] Release Apache Arrow 8.0.1 - RC0

2022-07-27 Thread Sutou Kouhei
t lack of documentation could cause (Go) user confusion, if > they find they are using a version 8.0.1 and are presented with > documentation for 8.0.0. > > [1] https://arrow.apache.org/release/ > [2] https://arrow.apache.org/docs/index.html (see version selector > dro

Re: [VOTE] Release Apache Arrow 9.0.0 - RC1

2022-07-29 Thread Sutou Kouhei
-1 Sorry. I found a problem in Linux packages. I'm fixing this at https://github.com/apache/arrow/pull/13739 . Thanks, -- kou In "[VOTE] Release Apache Arrow 9.0.0 - RC1" on Thu, 28 Jul 2022 16:47:33 +0200, Krisztián Szűcs wrote: > Hi, > > I would like to propose the following release

Re: [VOTE] Release Apache Arrow 9.0.0 - RC2

2022-07-31 Thread Sutou Kouhei
+1 I ran the followings on Debian GNU/Linux sid: * TEST_DEFAULT=0 \ TEST_SOURCE=1 \ LANG=C \ TZ=UTC \ ARROW_CMAKE_OPTIONS="-DBoost_NO_BOOST_CMAKE=ON -DCUDAToolkit_ROOT=/usr" \ dev/release/verify-release-candidate.sh 9.0.0 2 * TEST_DEFAULT=0 \ TEST_APT=1 \

Re: [RESULT][VOTE] Release Apache Arrow 9.0.0 - RC2

2022-08-06 Thread Sutou Kouhei
- [done] Make the released version as “RELEASED” on JIRA - [done] Start the new version on JIRA on the ARROW project - [done] Upload source - [done] Upload binaries - [done] Update website - [done] Update Homebrew packages - [done] Update MSYS2 package - [done] Upload RubyGems - [done] Upload JS pa

Re: [C++] Purpose of C++ bundled dependencies

2022-08-07 Thread Sutou Kouhei
Hi, > (a) To expand its functionality and encourage use by downstream projects I think that this is not an option for us. If we do this, we need to release a security release as soon as possible when any security vulnerability is found in bundle libraries. I think that we can't do it at least f

Re: Proposal: Allow any ASF Jira user to assign ARROW issues

2022-08-10 Thread Sutou Kouhei
+1 In "Proposal: Allow any ASF Jira user to assign ARROW issues" on Wed, 10 Aug 2022 14:32:21 -0600, Todd Farmer wrote: > Hello, > > Community members seeking to address issues in the ASF Jira ARROW project > must both register for ASF Jira and be given the "Contributor" role. > Current p

Re: dealing with tester timeout in a CI job

2022-08-16 Thread Sutou Kouhei
Hi, What language are you talking about? C++? For C++, we have two timeouts: * GitHub Action's timeout * GTest's timeout Could you show the URL of the failed macOS related CI job? Thanks, -- kou In "dealing with tester timeout in a CI job" on Tue, 16 Aug 2022 16:34:24 +, Yaron Gvili

[C++] Can we drop support for Visual Studio 2017?

2022-08-17 Thread Sutou Kouhei
Hi, Can we drop support for Visual Studio 2017? Visual Studio 2017 reached EOL at 2022-04-12: https://docs.microsoft.com/en-us/lifecycle/products/visual-studio-2017 Listing| Start Date | Mainstream End Date | Extended End Date Visual Studio 2017 | Mar 7, 2017 | Apr 12, 2022|

Re: DISCUSS: [C++] Switch to C++17

2022-08-17 Thread Sutou Kouhei
Hi, > Here's a tactical suggestion: for 10.0, we could upgrade all* of our > packaging and CI jobs to build with C++17, but not add code that cannot > compile on C++11 (hence the *, we will need to maintain at least one C++11 > CI job to assure that). Then, assuming there are no adverse consequenc

Re: [RESULT][VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 11.0.0 RC1

2022-08-19 Thread Sutou Kouhei
Hi Andy, Could you remove old DataFusion releases (7.0.0, 7.1.0, 8.0.0, 9.0.0 and 10.0.0) from https://dist.apache.org/repos/dist/release/arrow/ to follow the ASF's release policy? https://www.apache.org/legal/release-policy.html#when-to-archive > downloads.apache.org should contain the latest r

[ANN] DataFusion C/DataFusion GLib/Red DataFusion 10.0.0 released

2022-08-22 Thread Sutou Kouhei
Hi, I've released DataFusion C, DataFusion GLib and Red DataFusion 10.0.0 that are based on Apache Arrow DataFusion 10.0.0. (I'll release DataFusion C, DataFusion GLib and Red DataFusion 11.0.0 that are based on Apache Arrow DataFusion 11.0.0 sometime soon.) DataFusion C: https://datafusion-con

Re: [C++] Can we drop support for Visual Studio 2017?

2022-08-23 Thread Sutou Kouhei
Hi, There is no objection. We drop support for Visual Studio 2017. Thanks, -- kou In <20220817.170509.1487454221214035438@clear-code.com> "[C++] Can we drop support for Visual Studio 2017?" on Wed, 17 Aug 2022 17:05:09 +0900 (JST), Sutou Kouhei wrote: > Hi, >

Re: [VOTE] C++: switch to C++17

2022-08-24 Thread Sutou Kouhei
+1 In <7ab9b8ef-d5ca-313f-4b12-79647f32a...@python.org> "[VOTE] C++: switch to C++17" on Wed, 24 Aug 2022 17:31:52 +0200, Antoine Pitrou wrote: > > Hello, > > I would like to propose that the Arrow C++ implementation switch to > C++17 as its baseline supported version (currently C++11). >

Re: [DISC] Improving Arrow's database support

2022-08-25 Thread Sutou Kouhei
Hi, As a maintainer of Linux packages, I want apache/arrow-adbc to be released before apache/arrow is released so that apache/arrow's .deb/.rpm can depend on apache/arrow-adbc's .deb/.rpm. (If Apache Arrow Dataset uses apache/arrow-adbc, apache/arrow's .deb/.rpm needs to depend on apache/arrow-ad

Re: [DISC] Improving Arrow's database support

2022-08-26 Thread Sutou Kouhei
complete the Dataset > integration in time. So 10.0.0 probably won't ship with a hard dependency. > That said I am hoping to have PyArrow take an optional dependency (so Flight > SQL can finally be available from Python). > > On Fri, Aug 26, 2022, at 01:01, Sutou Kouhei wrote: >

Re: [DISC] Improving Arrow's database support

2022-08-28 Thread Sutou Kouhei
e's a little bit more API cleanup to do [1]. If you have comments on that > or anything else, I'd appreciate them. Otherwise, pull requests would also be > appreciated. > > [1]: https://github.com/apache/arrow-adbc/issues/79 > > On Fri, Aug 26, 2022, at 21:53, Sutou K

Re: [VOTE] Format: Rules and procedures for Canonical extension types

2022-08-29 Thread Sutou Kouhei
+1 with "arrow." prefix because we already use "ARROW:" not "ORG.APACHE.ARROW:" for reserved metadata name prefix. https://arrow.apache.org/docs/format/Columnar.html#custom-application-metadata > The ARROW pattern is a reserved namespace for internal > Arrow use in the custom_metadata fields. For

Re: Usage of the name Feather?

2022-08-29 Thread Sutou Kouhei
+1 for 1. Thanks, -- kou In "Re: Usage of the name Feather?" on Mon, 29 Aug 2022 20:18:37 +0200, Jorge Cardoso Leitão wrote: > I agree. > > I suspect that the most widely used API with "feather" is Pandas' > read_feather. > > > > On Mon, 29 Aug 2022, 19:55 Weston Pace, wrote: > >> I

[ANNOUNCE] New Arrow PMC member: L. C. Hsieh

2022-09-03 Thread Sutou Kouhei
The Project Management Committee (PMC) for Apache Arrow has invited L. C. Hsieh to become a PMC member and we are pleased to announce that L. C. Hsieh has accepted. Congratulations and welcome!

Re: [DISC] Improving Arrow's database support

2022-09-03 Thread Sutou Kouhei
, or use an independent versioning > scheme? (For example, release API standard and components at "1.0.0". Then > further releases of components that do not change the spec would be "1.1", > "1.2", ...; if/when we change the spec, start over with "2.0&qu

[ANNOUNCE] New Arrow PMC member: Weston Pace

2022-09-04 Thread Sutou Kouhei
The Project Management Committee (PMC) for Apache Arrow has invited Weston Pace to become a PMC member and we are pleased to announce that Weston Pace has accepted. Congratulations and welcome!

Re: Alluxio cache read support

2022-09-05 Thread Sutou Kouhei
Hi, Could you try our HDFS support? * https://arrow.apache.org/docs/cpp/dataset.html#reading-from-cloud-storage * https://arrow.apache.org/docs/cpp/api/filesystem.html#_CPPv4N5arrow2fs16HadoopFileSystemE (You're using Apache Arrow C++, right?) Thanks, -- kou In "Alluxio cache read suppor

Re: PyArrow build problem

2022-09-11 Thread Sutou Kouhei
Hi, It seems that /miniconda3/envs/pyarrow-dev/lib/cmake/Arrow/ArrowConfig.cmake isn't used. Could you share a build log with PYARROW_CMAKE_OPTIONS="-DCMAKE_FIND_DEBUG_MODE=ON" environment variable? You may need to export CMAKE_PREFIX_PATH=/miniconda3/envs/pyarrow-dev environment variable but the

Re: PyArrow build problem

2022-09-12 Thread Sutou Kouhei
19:36:51 +, Yaron Gvili wrote: > Hi Kou, > > I'm attaching the cmake log files for the same command with both > PYARROW_CMAKE_OPTIONS and CMAKE_PREFIX_PATH set and exported as requested. > > > Thanks, > Yaron. > ____ > From: Sut

Re: [DISC] Remove Kartothek integration tests from nightlies

2022-09-13 Thread Sutou Kouhei
+1 In "[DISC] Remove Kartothek integration tests from nightlies" on Tue, 13 Sep 2022 10:47:17 +0200, Raul Cumplido Dominguez wrote: > Hi, > > Currently Kartothek [1] nightly builds are flaky [2]. > > The Kartothek project does not seem to be active anymore. The last merged > PR was in De

Re: [C++][Gandiva] Proposal to Add A Parser Frontend for Gandiva

2022-09-17 Thread Sutou Kouhei
Hi, FYI: This proposal was filed at https://issues.apache.org/jira/browse/ARROW-17668 . We have a similar proposal for Acero: https://issues.apache.org/jira/browse/ARROW-17351 There is a discussion about the proposal for Acero on ursalabs.zulipchat.com: https://ursalabs.zulipchat.com/#narrow/st

[ANNOUNCE] New Arrow PMC member: Raphael Taylor-Davies

2022-09-19 Thread Sutou Kouhei
The Project Management Committee (PMC) for Apache Arrow has invited Raphael Taylor-Davies to become a PMC member and we are pleased to announce that Raphael Taylor-Davies has accepted. Congratulations and welcome!

Re: [VOTE] Adopt ADBC database client connectivity specification

2022-09-22 Thread Sutou Kouhei
+1 In "[VOTE] Adopt ADBC database client connectivity specification" on Wed, 21 Sep 2022 11:40:11 -0400, "David Li" wrote: > Hello, > > We have been discussing [1] standard interfaces for Arrow-based database > access and have been working on implementations of the proposed interfaces >

Re: [Discuss] Deprecating Plasma

2022-09-22 Thread Sutou Kouhei
+1 In "[Discuss] Deprecating Plasma" on Thu, 22 Sep 2022 17:38:27 +0200, Antoine Pitrou wrote: > > Hello, > > The Plasma object store (*) hasn't received significant maintenance > since at least 2020. The original authors have stopped contributing to > the Arrow community and instead fork

Help drafting Apache Arrow 2022-10 board report

2022-10-09 Thread Sutou Kouhei
Hi, I started a document where we can crowdsource the 2022-10 board report: https://github.com/apache/arrow/pull/14357 If you're a committer, you can push your changes directly. Others can leave comments/suggestions. It's due on Oct 12nd. (day after next!) Thanks, -- kou

Re: [RESULT][VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 13.0.0 RC1

2022-10-10 Thread Sutou Kouhei
Hi Andy, Could you add "adding a release to https://reporter.apache.org/addrelease.html?arrow " to release process of DataFusion and Ballista? The release information is used to generate a template for a board report. FYI: * Board Report Wizard: https://reporter.apache.org/wizard/?arrow * A board

Re: Help drafting Apache Arrow 2022-10 board report

2022-10-11 Thread Sutou Kouhei
Submitted. Thanks for helping this! -- kou In <20221010.110332.1123679615561983847@clear-code.com> "Help drafting Apache Arrow 2022-10 board report" on Mon, 10 Oct 2022 11:03:32 +0900 (JST), Sutou Kouhei wrote: > Hi, > > I started a document where we ca

[VOTE] Jarrett Revels for Committer

2022-10-16 Thread Sutou Kouhei
I propose to invite Jarrett Revels to be a committer. See discussion here [1]. [ ] +1 : Invite Jarrett Revels to become a committer [ ] +0: ... [ ] -1: I disagree because ... The vote will be open for at least 48 hours. [1] https://lists.apache.org/thread/77y4wz914h3f26f57g9x3kmng814yhg8 Thanks

Re: [VOTE] Jarrett Revels for Committer

2022-10-16 Thread Sutou Kouhei
Sorry. Please ignore this. I sent this to a wrong mailing list... In <20221017.061236.416548789610722329@clear-code.com> "[VOTE] Jarrett Revels for Committer" on Mon, 17 Oct 2022 06:12:36 +0900 (JST), Sutou Kouhei wrote: > I propose to invite Jarrett Revels to

Re: [RELEASE] Preparing for Arrow Release version 10.0.0

2022-10-16 Thread Sutou Kouhei
Hi, I've created a branch for releasing 10.0.0: https://github.com/apache/arrow/tree/maint-10.0.0 maint-10.0.0 will cherry-pick only commits that fixes blockers for 10.0.0 from the master branch. We have 4 blockers for now: https://cwiki.apache.org/confluence/display/ARROW/Arrow+10.0.0+Release 1

Re: Usage of the name Feather?

2022-10-18 Thread Sutou Kouhei
know or care what >> > > interprocess communication is to use them! >> > > >> > > On Mon, Aug 29, 2022 at 6:50 PM Ian Cook >> wrote: >> > > >> > > > +1 We should explicitly discourage further use of “Feather” to refer >> to >> &g

[DISCUSS] Maintenance policy

2022-10-18 Thread Sutou Kouhei
Hi, Can we define our maintenance policy? For example, we maintain the last 3 major releases: * We maintain 7.Y.Z, 8.Y.Z and 9.Y.Z when the latest major release is 9.0.0 * We may release 7.Y.Z, 8.Y.Z or 9.Y.Z when we find a problem such as a security vulnerability in 7.Y.Z, 8.Y.Z or 9.Y.Z *

Re: [RESULT][VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 13.0.0 RC1

2022-10-20 Thread Sutou Kouhei
ps://github.com/apache/arrow-datafusion/pull/3893 > https://github.com/apache/arrow-ballista/pull/401 > > On Tue, Oct 11, 2022 at 6:29 AM Andy Grove wrote: > >> Hi Kou, >> >> Sure. I will look into this and get back to you. >> >> Thanks, >> >> And

Re: [WEBSITE] Blog posts on representing Structured Data with Parquet and Arrow

2022-10-20 Thread Sutou Kouhei
Hi Andrew, I've sent you ( https://twitter.com/andrewlamb ) an invitation to join the @ApacheArrow 's team members. Could you confirm the invitation? You can tweet as @ApacheArrow from https://tweetdeck.twitter.com/ after you accept the invitation. Thanks, -- kou In "Re: [WEBSITE] Blog p

[VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-20 Thread Sutou Kouhei
Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 10.0.0. This is a release consisting of 470 resolved JIRA issues[1]. This release candidate is based on commit: 89f9a0948961f6e94f1ef5e4f310b707d22a3c11 [2] The source release rc0 is hosted at [3]. The bina

Re: [VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-23 Thread Sutou Kouhei
t;TEST_CPP=1 \ >>>TEST_PYTHON=1 \ >>>dev/release/verify-release-candidate.sh 10.0.0 0 >>> >>> TEST_DEFAULT=0 \ >>> TEST_SOURCE=0 \ >>>TEST_BINARY=1 \ >>>dev/release/verify-release-candidate.sh 10.0.0 0 >>&

Re: [VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-23 Thread Sutou Kouhei
unchanged: 13 >> Failed to verify release candidate. See /tmp/arrow-10.0.0.gOoKw for >> details. >> On 10/22/22 22:32, David Li wrote: >>> Still WIP for me. Verified: >>> - C++, Python, Java, binaries on Ubuntu Linux 18.04/AMD64 >>> - C+

Re: [DISCUSS] Move issue tracking to

2022-10-23 Thread Sutou Kouhei
Hi, +1 on migration. > The one thing I would not want to lose, though, is the categorization > facilities we currently have in Jira. Namely: Component, Affects > version, Fix version, Type (bug/improvement/task...), Issue links > (superceded by/relates to/is caused by...), Priority (at least > Mi

Re: [VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-24 Thread Sutou Kouhei
-code.com> "Re: [VOTE] Release Apache Arrow 10.0.0 - RC0" on Mon, 24 Oct 2022 14:53:46 +0900 (JST), Sutou Kouhei wrote: > Hi, > >> /root/apache-arrow-10.0.0/cpp/src/arrow/util/value_parsing_test.cc:805: >> Failure >> Expected equality of these values: >

Re: [VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-24 Thread Sutou Kouhei
row 10.0.0 - RC0" on Mon, 24 Oct 2022 13:31:19 +0200, Neville Dipale wrote: > Is there anything I can do on my side to fix this? > > On Mon, 24 Oct 2022 at 07:25, Sutou Kouhei wrote: > >> Hi, >> >> Neville's PGP key uses EDDSA and gpg on CentOS 7 is

Re: [VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-24 Thread Sutou Kouhei
Actions installs Go from https://dl.google.com/go/ .) We may need to improve our verification script for system Go. (Should we set GOPATH or something?) Thanks, -- kou In <20221021.150638.710084994470067293@clear-code.com> "[VOTE] Release Apache Arrow 10.0.0 - RC0" on Fri, 21

[DISCUSS] Migrating away from Travis-CI

2022-10-24 Thread Sutou Kouhei
Hi, https://cwiki.apache.org/confluence/display/INFRA/Travis+Migrations > On November 2nd, 2020, Travis-CI announced the end of > unlimited support for open source projects. > > Infra is therefore moving our CI offerings away from > Travis-CI in order to keep our builds pipeline > cost-effective

Re: [VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-24 Thread Sutou Kouhei
if there's no GOPATH set. > > I agree that it shouldn't be a blocker, but I'll take a look at the verify > scripts to see what can be changed to improve this. > > --Matt > > On Mon, Oct 24, 2022 at 5:14 PM Sutou Kouhei wrote: > >> +1 >> >> I

  1   2   3   4   5   6   7   8   9   10   >