Re: [VOTE] Migration of parquet-cpp issues to Arrow's issue tracker

2024-06-03 Thread Julien Le Dem
A bit late but just for the record +1 from me On Mon, Jun 3, 2024 at 17:23 Rok Mihevc wrote: > Thanks all for voting. I tallied the votes (assuming simple +1 votes were > meant as +1 Parquet, +1 Arrow) and the vote succeeded with the following > results: > > Parquet: > 3x +1 binding (Gang Wu, An

Re: [DRAFT] Apache Arrow board report October 2018

2018-10-15 Thread Julien Le Dem
What's the plan for the parquet-cpp repo now that ARROW-3075 has been merged? On Thu, Oct 11, 2018 at 9:12 AM Wes McKinney wrote: > OK, I have updated. If others could comment on the .NET thread, we can > start a vote soon there > > ## Description: > > Apache Arrow is a cross-language developme

Re: Parquet to arrow java converter

2018-03-06 Thread Julien Le Dem
I would put in the parquet-mr codebase. I have contributed the schéma conversion code there. I’m happy to provide feedback on PRs in this area. Julien > On Mar 6, 2018, at 12:18, Wes McKinney wrote: > > When it had been discussed in the past, the thinking had been to > implement it in the Par

Re: [VOTE] Release Apache Arrow 0.7.0 - RC0

2017-09-17 Thread Julien Le Dem
+1 (binding) On MacOs: - verified signature - ran Cpp build and tests - ran java build and tests On Thu, Sep 14, 2017 at 9:14 PM, Wes McKinney wrote: > +1 (binding) > > I created a release verification script for Linux: > https://github.com/apache/arrow/pull/1102 > I also made a small fix to the

Re: spark error with reading parquet file created vis pandas/pyarrow

2017-09-08 Thread Julien Le Dem
The int96 deprecation is slowly bubbling up the stack. There are still discussions in spark on how to make the change. So for now even though it's deprecated it is still used in some places. This should get resolved in the near future. Julien > On Sep 8, 2017, at 14:12, Wes McKinney wrote: >

Re: [VOTE] Accept contribution of Plasma Object Store

2017-07-24 Thread Julien Le Dem
+1 On Sun, Jul 23, 2017 at 8:00 AM, Arun K. Subramaniyan wrote: > +1 > > On Sun, Jul 23, 2017 at 1:16 AM Uwe L. Korn wrote: > > > +1 > > > > On Fri, Jul 21, 2017, at 01:37 AM, Julian Hyde wrote: > > > +1 > > > > > > > On Jul 20, 2017, at 3:07 PM, Bryan Cutler wrote: > > > > > > > > +1 sounds g

Re: [VOTE] Release Apache Arrow 0.5.0 - RC2

2017-07-23 Thread Julien Le Dem
+1 (binding) on MacOS: * Verified signature * ran java build, unit tests, packages * build and ran test for C++ 1 note: - missing from the build notes: new jemalloc dependency (I had to brew install jemalloc) On Sun, Jul 23, 2017 at 6:20 AM, Uwe L. Korn wrote: > +1 (binding) > > * Verified sig

Re: Arrow sync tomorrow?

2017-07-18 Thread Julien Le Dem
15 utc / 8am PT tomorrow works for me. (Assuming I did the conversion right) Julien > On Jul 18, 2017, at 10:21, Uwe L. Korn wrote: > > Hello Wes, > > I would have time for an Arrow sync before the Parquet sync (open to any > time there). Sadly, I don't have time after it. > > Uwe > >> On T

Arrow sync starting now

2017-06-21 Thread Julien Le Dem
https://hangouts.google.com/hangouts/_/calendar/anVsaWVuLmxlZGVtQGdtYWlsLmNvbQ.us971oqfjhdj1b1m3esm4a9q5s

Re: Moving Arrow to gitbox.apache.org?

2017-06-17 Thread Julien Le Dem
+1 Julien > On Jun 17, 2017, at 15:08, Wes McKinney wrote: > > None here. I think it's a good idea. > >> On Sat, Jun 17, 2017 at 3:37 PM Uwe L. Korn wrote: >> >> Picking this up again, as we would like to create a secondary repository >> to build Python releases: https://issues.apache.org/ji

[jira] [Created] (ARROW-1102) Make MessageSerializer.serializeMessage() public

2017-06-07 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-1102: Summary: Make MessageSerializer.serializeMessage() public Key: ARROW-1102 URL: https://issues.apache.org/jira/browse/ARROW-1102 Project: Apache Arrow Issue

Re: [VOTE] Release Apache Arrow 0.4.1 - rc0

2017-06-07 Thread Julien Le Dem
+1 I validated the signature and build + ran tests for java and c++ On Tue, Jun 6, 2017 at 7:27 PM, Wes McKinney wrote: > Hello all, > > I'd like to propose the 1st release candidate (rc0) of Apache > Arrow version 0.4.1. This is a bug fix release consisting of 30 > resolved JIRAs [1]. > > The

[jira] [Created] (ARROW-1092) More Decimal and scale flipped follow-up

2017-06-05 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-1092: Summary: More Decimal and scale flipped follow-up Key: ARROW-1092 URL: https://issues.apache.org/jira/browse/ARROW-1092 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-1091) Decimal scale and precision are flipped

2017-06-05 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-1091: Summary: Decimal scale and precision are flipped Key: ARROW-1091 URL: https://issues.apache.org/jira/browse/ARROW-1091 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-1085) [java] Follow up on template cleanup. Missing method for IntervalYear

2017-06-02 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-1085: Summary: [java] Follow up on template cleanup. Missing method for IntervalYear Key: ARROW-1085 URL: https://issues.apache.org/jira/browse/ARROW-1085 Project: Apache

Re: Arrow sync in 15 min

2017-05-31 Thread Julien Le Dem
Next sync: 6/21 9:30am PT on google hangout On Wed, May 31, 2017 at 11:06 AM, Julien Le Dem wrote: > Notes: > > Attendees/agenda building > Wes (TwoSigma): > - Rest API > - Roadmap > - communicate with community > Uwe (Blue Yonder): > - git tag for

Re: Arrow sync in 15 min

2017-05-31 Thread Julien Le Dem
- C++ analytics library for interacting with ARROW memory. Tools for wrapping existing data structure (array of doubles) - arrow for GPU - Arrow ODBC interface: turbodbc - Spark integration improvements: group UDFS etc On Wed, May 31, 2017 at 9:16 AM, Julien Le Dem wrote:

[jira] [Created] (ARROW-1077) Define Arrow "REST API"

2017-05-31 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-1077: Summary: Define Arrow "REST API" Key: ARROW-1077 URL: https://issues.apache.org/jira/browse/ARROW-1077 Project: Apache Arrow Issue Type: N

Arrow sync in 15 min

2017-05-31 Thread Julien Le Dem
The arrow sync is at 9:30 am PT today on google hangout https://hangouts.google.com/hangouts/_/dremio.com/arrow -- Julien

Re: [ANNOUNCE] Apache Arrow 0.4.0 released

2017-05-25 Thread Julien Le Dem
I just published them. They should propagate to mirrors shortly. On Thu, May 25, 2017 at 6:16 AM, Emilio Lahr-Vivaz wrote: > Congrats on the release! Is there a time frame for java artifacts being > available on maven central? > > Thanks, > > Emilio > > > On 05/23/2017 01:06 PM, Wes McKinney wro

[jira] [Created] (ARROW-1069) Add instructions for publishing maven artifacts

2017-05-25 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-1069: Summary: Add instructions for publishing maven artifacts Key: ARROW-1069 URL: https://issues.apache.org/jira/browse/ARROW-1069 Project: Apache Arrow Issue

Re: [VOTE] Release Apache Arrow 0.4.0 - rc1

2017-05-22 Thread Julien Le Dem
+1 (binding) * verified signature * ran java, c++ build and unit tests on macos On Mon, May 22, 2017 at 8:32 AM, Wes McKinney wrote: > Hi folks -- please remember to test the release candidate before the vote > closes later today. Thank you! > > On Sat, May 20, 2017 at 10:22 AM Wes McKinney wro

Re: Moving Arrow to gitbox.apache.org?

2017-05-19 Thread Julien Le Dem
Thank you Justin for the investigation! I'd be very interested in being able to manage PRs (rename/close/...) through the github UI. Which I understand this would make possible. We are already pushing to only one source since github is a read only mirror. I think it would not be a problem to updat

Re: [VOTE] Release Apache Arrow 0.4.0 - rc0

2017-05-17 Thread Julien Le Dem
I validated the signature build and ran tests for - cpp - java +1 On Wed, May 17, 2017 at 1:07 PM, Wes McKinney wrote: > Hello all, > > I'd like to propose the 1st release candidate (rc0) of Apache Arrow version > 0.4.0. It covers a total of 75 resolved JIRAs [1]. Thanks to everyone who > co

[jira] [Created] (ARROW-1049) [java] vector template cleanup

2017-05-17 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-1049: Summary: [java] vector template cleanup Key: ARROW-1049 URL: https://issues.apache.org/jira/browse/ARROW-1049 Project: Apache Arrow Issue Type: Improvement

arrow sync starting now

2017-05-17 Thread Julien Le Dem
https://hangouts.google.com/hangouts/_/dremio.com/arrow -- Julien

Re: Making Arrow 0.3.1 minor release

2017-05-15 Thread Julien Le Dem
SGTM On Sun, May 14, 2017 at 12:36 PM, Wes McKinney wrote: > OK, I've thought a bit more about it and I'm +1 on doing a 0.4.0. There's > enough meaningful new features and improvements since 0.3.0 already (almost > 50 patches) to merit a small announcement blog. I will plan to cut the RC > on Tu

[jira] [Created] (ARROW-977) [java] Add Timezone aware timestamp vectors

2017-05-08 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-977: --- Summary: [java] Add Timezone aware timestamp vectors Key: ARROW-977 URL: https://issues.apache.org/jira/browse/ARROW-977 Project: Apache Arrow Issue Type: New

Re: Branching for Arrow releases

2017-05-05 Thread Julien Le Dem
Alternatively we can rebase master on the release if patch have been merged concurently to the release vote. I think it is fine to rebase commits that have not been released yet. (the release sha however must stay the same) I find usefull to have the release tag in the master history to know byt lo

Re: [VOTE] Release Apache Arrow 0.3.0 - rc1

2017-05-03 Thread Julien Le Dem
+1 (binding) I ran the following: - verified signature - Build and tested C++ on macOS - Build and tested Java on macOS On Wed, May 3, 2017 at 10:54 AM, Gary Wong wrote: > Oh, Got it, Thank you for the clarification. :) > > On Wed, May 3, 2017 at 9:07 AM, Uwe L. Korn wrote: > > > It's rc1 beca

[jira] [Created] (ARROW-936) Fix release README

2017-05-02 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-936: --- Summary: Fix release README Key: ARROW-936 URL: https://issues.apache.org/jira/browse/ARROW-936 Project: Apache Arrow Issue Type: Bug Components

Re: [VOTE] Release Apache Arrow 0.3.0 - rc0

2017-05-01 Thread Julien Le Dem
So I sent this a little fast and used Uwe's email for 0.2.0 as a template. What I actually ran: - java build and unit tests - c++ build and unit tests still my +1 On Mon, May 1, 2017 at 3:35 PM, Julien Le Dem wrote: > Of course I meant: > +1 (binding) > > On Mon, May 1, 2017 a

Re: [VOTE] Release Apache Arrow 0.3.0 - rc0

2017-05-01 Thread Julien Le Dem
Of course I meant: +1 (binding) On Mon, May 1, 2017 at 3:27 PM, Julien Le Dem wrote: > Hello all, > > I'd like to propose the a release candidate (rc0) of Apache Arrow > version 0.3.0. > It covers a total of 265 resolved JIRAs [1] Thanks to everyone who > contributed t

[jira] [Created] (ARROW-930) javadoc generation fails with java 8

2017-05-01 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-930: --- Summary: javadoc generation fails with java 8 Key: ARROW-930 URL: https://issues.apache.org/jira/browse/ARROW-930 Project: Apache Arrow Issue Type

[VOTE] Release Apache Arrow 0.3.0 - rc0

2017-05-01 Thread Julien Le Dem
Hello all, I'd like to propose the a release candidate (rc0) of Apache Arrow version 0.3.0. It covers a total of 265 resolved JIRAs [1] Thanks to everyone who contributed to this release. The source release rc0 is hosted at [2]. This release candidate is based on commit 0341a336e2174c7c8962869686

Re: Serialize/deserialize ArrowRecordBatch to/from bytes?

2017-04-26 Thread Julien Le Dem
Example of writing to and reading from a file: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/file/TestArrowFile.java Similarly, in case you don't want to go through a file: Unloading a vector into buffers and loading from buffers: https://github.com/a

Re: Serialize/deserialize ArrowRecordBatch to/from bytes?

2017-04-25 Thread Julien Le Dem
look at org.apache.arrow.vector.stream.MessageSerializer. There are methods to serialize/deserialize to/from channels. these could be adapted to byte arrays. The apis are usually in terms of bytebuffers On Tue, Apr 25, 2017 at 3:22 PM, Li Jin wrote: > Hello, > > I am trying to serialize/de

[jira] [Created] (ARROW-887) [format] For backward compatibility, new unit fields must have default values matching previous implied unit

2017-04-24 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-887: --- Summary: [format] For backward compatibility, new unit fields must have default values matching previous implied unit Key: ARROW-887 URL: https://issues.apache.org/jira/browse

Re: arrow sync happening now

2017-04-19 Thread Julien Le Dem
to RC next Tuesday - windows build, etc - docs in svn arrow.apache.org documentation - jekyll for release doc like in Calcite - publish javadoc to arrow.apache.org (currently deployed to maven) On Wed, Apr 19, 2017 at 10:02 AM, Julien Le Dem wrote: > on google hangout: >

arrow sync happening now

2017-04-19 Thread Julien Le Dem
on google hangout: https://hangouts.google.com/hangouts/_/dremio.com/arrow -- Julien

[jira] [Created] (ARROW-824) Date and Time Vectors should reflect timezone-less semantics

2017-04-14 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-824: --- Summary: Date and Time Vectors should reflect timezone-less semantics Key: ARROW-824 URL: https://issues.apache.org/jira/browse/ARROW-824 Project: Apache Arrow

Re: Arrow 0.3 release timeline

2017-04-14 Thread Julien Le Dem
I reviewed the currently pending PRs on the java side. I opened 2 PRs for the opened java JIRAs from the list: ARROW-777, ARROW-720 On Fri, Apr 14, 2017 at 12:55 PM, Julien Le Dem wrote: > I'm looking through them > > On Fri, Apr 14, 2017 at 9:26 AM, Wes McKinney wrote: > >

Re: Arrow 0.3 release timeline

2017-04-14 Thread Julien Le Dem
an track what patches are in progress or > > still TODO. > > > > Thanks! > > Wes > > > > On Wed, Apr 5, 2017 at 10:38 AM, Julien Le Dem > wrote: > >> The current 0.3 goal is good for me. > >> > >> On Mon, Apr 3, 2017 at 11:25 AM, Wes

[jira] [Created] (ARROW-775) [Java] add simple constructors to value vectors

2017-04-06 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-775: --- Summary: [Java] add simple constructors to value vectors Key: ARROW-775 URL: https://issues.apache.org/jira/browse/ARROW-775 Project: Apache Arrow Issue Type

Re: Arrow 0.3 release timeline

2017-04-05 Thread Julien Le Dem
The current 0.3 goal is good for me. On Mon, Apr 3, 2017 at 11:25 AM, Wes McKinney wrote: > hi folks, > > We've been making excellent progress toward the 0.3 release -- 123 > patches in since 0.2, which was released a little over 6 weeks ago. > > Here is the JIRA to help track related issues: >

Arrow sync starting now

2017-03-29 Thread Julien Le Dem
https://hangouts.google.com/hangouts/_/dremio.com/arrow -- Julien

[jira] [Created] (ARROW-720) [java] arrow should not have a dependency on slf4j bridges in compile

2017-03-27 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-720: --- Summary: [java] arrow should not have a dependency on slf4j bridges in compile Key: ARROW-720 URL: https://issues.apache.org/jira/browse/ARROW-720 Project: Apache

Re: ACTION NEEDED: JIRA notifications

2017-03-23 Thread Julien Le Dem
Thank you! On Thu, Mar 23, 2017 at 6:52 AM, Wes McKinney wrote: > To reduce e-mail traffic to dev@arrow.apache.org, we've changed the > JIRA notification schema to only send issues CREATION e-mails to this > mailing list. > > All issue creation and comments/updates to JIRAs will be sent to > iss

[jira] [Created] (ARROW-704) Fix bad import caused by conflicting changes

2017-03-23 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-704: --- Summary: Fix bad import caused by conflicting changes Key: ARROW-704 URL: https://issues.apache.org/jira/browse/ARROW-704 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-703) Fix issue where setValueCount(0) doesn’t work in the case that we’ve shipped vectors across the wire

2017-03-22 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-703: --- Summary: Fix issue where setValueCount(0) doesn’t work in the case that we’ve shipped vectors across the wire Key: ARROW-703 URL: https://issues.apache.org/jira/browse/ARROW-703

[jira] [Created] (ARROW-702) Fix BitVector.copyFromSafe to reAllocate instead of returning false

2017-03-22 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-702: --- Summary: Fix BitVector.copyFromSafe to reAllocate instead of returning false Key: ARROW-702 URL: https://issues.apache.org/jira/browse/ARROW-702 Project: Apache Arrow

[jira] [Assigned] (ARROW-347) Add method to pass CallBack when creating a transfer pair

2017-03-22 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned ARROW-347: --- Assignee: Julien Le Dem (was: Steven Phillips) > Add method to pass CallBack when creatin

[jira] [Created] (ARROW-700) Add headroom interface for allocator.

2017-03-22 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-700: --- Summary: Add headroom interface for allocator. Key: ARROW-700 URL: https://issues.apache.org/jira/browse/ARROW-700 Project: Apache Arrow Issue Type

[jira] [Assigned] (ARROW-454) pojo.Field doesn't implement hashCode()

2017-03-22 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned ARROW-454: --- Assignee: Julien Le Dem (was: Deneche A. Hakim) > pojo.Field doesn't implement

Re: Moving JIRA updates from dev@ to issues@ only?

2017-03-22 Thread Julien Le Dem
It looks like this is configurable here: https://issues.apache.org/jira/plugins/servlet/project-config/ARROW/notifications Do we need infra to do it? On Wed, Mar 22, 2017 at 9:16 AM, Julian Hyde wrote: > And will the initial email, indicating the creation of a JIRA case, > continue to be sent to

[jira] [Resolved] (ARROW-677) [java] Fix checkstyle jcl-over-slf4j conflict issue

2017-03-21 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved ARROW-677. - Resolution: Fixed Issue resolved by pull request 412 [https://github.com/apache/arrow/pull/412

[jira] [Created] (ARROW-677) [java] Fix checkstyle jcl-over-slf4j conflict issue

2017-03-21 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-677: --- Summary: [java] Fix checkstyle jcl-over-slf4j conflict issue Key: ARROW-677 URL: https://issues.apache.org/jira/browse/ARROW-677 Project: Apache Arrow Issue

[jira] [Assigned] (ARROW-208) Add checkstyle policy to java project

2017-03-21 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned ARROW-208: --- Assignee: Tsuyoshi Ozawa > Add checkstyle policy to java proj

[jira] [Resolved] (ARROW-208) Add checkstyle policy to java project

2017-03-21 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved ARROW-208. - Resolution: Fixed Issue resolved by pull request 96 [https://github.com/apache/arrow/pull/96

[jira] [Resolved] (ARROW-673) [Java] Support additional Time metadata

2017-03-21 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved ARROW-673. - Resolution: Fixed Issue resolved by pull request 407 [https://github.com/apache/arrow/pull/407

[jira] [Created] (ARROW-676) [java] move from MinorType to FieldType in ValueVectors to carry all the relevant type bits

2017-03-21 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-676: --- Summary: [java] move from MinorType to FieldType in ValueVectors to carry all the relevant type bits Key: ARROW-676 URL: https://issues.apache.org/jira/browse/ARROW-676

[jira] [Assigned] (ARROW-674) [Java] Support additional Timestamp timezone metadata

2017-03-20 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned ARROW-674: --- Assignee: Julien Le Dem > [Java] Support additional Timestamp timezone metad

[jira] [Created] (ARROW-674) [Java] Support additional Timestamp timezone metadata

2017-03-20 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-674: --- Summary: [Java] Support additional Timestamp timezone metadata Key: ARROW-674 URL: https://issues.apache.org/jira/browse/ARROW-674 Project: Apache Arrow Issue

[jira] [Created] (ARROW-673) [Java] Support additional Time metadata

2017-03-20 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-673: --- Summary: [Java] Support additional Time metadata Key: ARROW-673 URL: https://issues.apache.org/jira/browse/ARROW-673 Project: Apache Arrow Issue Type: Bug

[jira] [Resolved] (ARROW-316) Finalize Date type

2017-03-20 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved ARROW-316. - Resolution: Fixed Issue resolved by pull request 390 [https://github.com/apache/arrow/pull/390

Re: Making some decisions about date and time types

2017-03-20 Thread Julien Le Dem
these changes and complete > integration tests for the date and time types > > On Fri, Mar 17, 2017 at 7:26 PM, Julien Le Dem wrote: > >> At some point someone will want MONTH as a time unit (to support SQL’s > > year-to-month interval type) > > There is an interval type he

[jira] [Resolved] (ARROW-637) [Format] Add time zone metadata to Timestamp type

2017-03-17 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved ARROW-637. - Resolution: Fixed Issue resolved by pull request 388 [https://github.com/apache/arrow/pull/388

Re: Making some decisions about date and time types

2017-03-17 Thread Julien Le Dem
> At some point someone will want MONTH as a time unit (to support SQL’s year-to-month interval type) There is an interval type here for that: https://github.com/apache/arrow/blob/39c7274fc36b5f405f1dbfa48067dde52abec5ce/format/Message.fbs#L98 On Fri, Mar 17, 2017 at 1:23 PM, Julian Hyde wrote:

Re: no arrow sync today

2017-03-16 Thread Julien Le Dem
The next Arrow sync will be Wednesday 3/22 at 9am PT on google hangout https://plus.google.com/hangouts/_/dremio.com/arrow (as usual everyone is welcome to attend) On Thu, Mar 16, 2017 at 5:13 PM, Julien Le Dem wrote: > Wednesday before the Parquet sync works. > > On Thu, Mar 16, 2017

Re: no arrow sync today

2017-03-16 Thread Julien Le Dem
. How about next Wednesday, either before or > > after the Parquet sync? > > > > On Thu, Mar 16, 2017 at 10:57 AM, Julien Le Dem > > wrote: > > > This is conflicting with Strata San Jose. > > > I propose we do tomorrow instead. > > > -- > > > Julien > -- Julien

[jira] [Commented] (ARROW-637) [Format] Add time zone metadata to Timestamp type

2017-03-16 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928411#comment-15928411 ] Julien Le Dem commented on ARROW-637: - Sounds good to me with the following t

[jira] [Commented] (ARROW-638) [Format] Add metadata for single and double precision complex numbers

2017-03-16 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928404#comment-15928404 ] Julien Le Dem commented on ARROW-638: - I see several possibilities: - first c

[jira] [Commented] (ARROW-316) Finalize Date type

2017-03-16 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928377#comment-15928377 ] Julien Le Dem commented on ARROW-316: - What representations do we need? - millise

no arrow sync today

2017-03-16 Thread Julien Le Dem
This is conflicting with Strata San Jose. I propose we do tomorrow instead. -- Julien

Arrow based data access

2017-03-15 Thread Julien Le Dem
We’re working on finalizing a few types and writing the integration tests that go with them. At this point we have a solid foundation in the Arrow project. As a next step I’m going to look into adding an Arrow RPC/REST interface dedicated to data retrieval. We had several discussions about this

[jira] [Assigned] (ARROW-633) [Java] Add support for FixedWidthBinary type

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned ARROW-633: --- Assignee: Julien Le Dem > [Java] Add support for FixedWidthBinary t

[jira] [Commented] (ARROW-491) [C++] Add FixedWidthBinary type

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927204#comment-15927204 ] Julien Le Dem commented on ARROW-491: - So, from the layout perspective, there&#x

[jira] [Comment Edited] (ARROW-617) Time type is not specified clearly

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926998#comment-15926998 ] Julien Le Dem edited comment on ARROW-617 at 3/15/17 9:1

[jira] [Commented] (ARROW-617) Time type is not specified clearly

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926998#comment-15926998 ] Julien Le Dem commented on ARROW-617: - [~wesmckinn] that would work but the

[jira] [Commented] (ARROW-617) Time type is not specified clearly

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926601#comment-15926601 ] Julien Le Dem commented on ARROW-617: - The layout in entirely defined by the

[jira] [Comment Edited] (ARROW-617) Time type is not specified clearly

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926547#comment-15926547 ] Julien Le Dem edited comment on ARROW-617 at 3/15/17 4:5

[jira] [Comment Edited] (ARROW-617) Time type is not specified clearly

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926547#comment-15926547 ] Julien Le Dem edited comment on ARROW-617 at 3/15/17 4:5

[jira] [Commented] (ARROW-617) Time type is not specified clearly

2017-03-15 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926547#comment-15926547 ] Julien Le Dem commented on ARROW-617: - ```log2(1000 * 1000 * 3600 *24) = 36.3...``

[jira] [Updated] (ARROW-114) Bring in java-unsafe-tools as utility library for Arrow

2017-03-13 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated ARROW-114: Priority: Minor (was: Major) > Bring in java-unsafe-tools as utility library for Ar

[jira] [Commented] (ARROW-617) Time type is not specified clearly

2017-03-10 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905959#comment-15905959 ] Julien Le Dem commented on ARROW-617: - Currently the java TimeVector supports mi

[jira] [Created] (ARROW-617) Time type is not specified clearly

2017-03-10 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-617: --- Summary: Time type is not specified clearly Key: ARROW-617 URL: https://issues.apache.org/jira/browse/ARROW-617 Project: Apache Arrow Issue Type: Bug

Re: Date/Time fields values in Java

2017-03-10 Thread Julien Le Dem
sion and scale. Thoughts? > > On Fri, Mar 10, 2017 at 6:18 PM, Julien Le Dem wrote: > > It sounds like we need to specify a different bit width depending on the > > unit? > > millisecond time fits in 32 bits but neither do micros nor nanos. > > the java TimeVe

Re: Date/Time fields values in Java

2017-03-10 Thread Julien Le Dem
i, Mar 10, 2017 at 4:47 PM, Bryan Cutler wrote: > > Thanks for the info Julien. I'll open a JIRA for fixing the type layout > > for TIME, and I'll give the documentation a shot. > > > > Regards, > > Bryan > > > > On Thu, Mar 9, 2017 at 9:01 PM, Ju

Re: Date/Time fields values in Java

2017-03-09 Thread Julien Le Dem
Hi Bryan, In the JSON representation we should use the integer representation of the Timestamp. We should not depend on joda for this. DATE is on 8 bytes => 64bits: https://github.com/apache/arrow/blob/6b3ae2aecc8cd31425035a021fa04b9ed3385a8d/format/Message.fbs#L79 https://github.com/apache/arrow/

Re: Arrow sync in 10min

2017-03-09 Thread Julien Le Dem
some of the changes but it's not in a working > state to push at the moment. > > Thanks, > > Emilio > > > On 03/02/2017 02:28 PM, Julien Le Dem wrote: > >> Notes: >> >> Attendees: >> - Julien (Dremio) >> - Wes (TwoSigma) >> - Uwe (B

Re: Arrow sync in 10min

2017-03-02 Thread Julien Le Dem
://issues.apache.org/jira/browse/SPARK-13534 https://github.com/apache/spark/pull/15821 - ready for review On Thu, Mar 2, 2017 at 9:52 AM, Julien Le Dem wrote: > at 10 am PT on google hangout: > https://hangouts.google.com/hangouts/_/dremio.com/arrow > > -- > Julien > -- Julien

Arrow sync in 10min

2017-03-02 Thread Julien Le Dem
at 10 am PT on google hangout: https://hangouts.google.com/hangouts/_/dremio.com/arrow -- Julien

Day of Sync-up

2017-02-24 Thread Julien Le Dem
Currently the Parquet sync-up is scheduled on Thursday 10 am PT every other week. Marcel mentioned that another day (same time) would be more convenient. What works for the usual attendees? -- Julien

[jira] [Commented] (ARROW-581) Transportation

2017-02-24 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883567#comment-15883567 ] Julien Le Dem commented on ARROW-581: - [~mfalhi] Please add a descrip

Re: [ANNOUNCE] Apache Arrow 0.2.0 released

2017-02-21 Thread Julien Le Dem
And java artifacts have been pushed to maven central: http://repo1.maven.org/maven2/org/apache/arrow/arrow-vector/0.2.0/ On Sun, Feb 19, 2017 at 8:46 AM, Wes McKinney wrote: > The Apache Arrow community is pleased to announce the 0.2.0 > release. It includes 192 resolved issues ([1]) since the f

Re: dist access for release

2017-02-21 Thread Julien Le Dem
> > > > "If the Release Manager is not a member of the PMC, they will need to ask > > a PMC member to do the actual release publication.” [2] > > > > Julian > > > > [1] http://www.apache.org/legal/release-policy.html#release-distribution >

dist access for release

2017-02-17 Thread Julien Le Dem
Here is the answer from infra regarding release repo access: https://issues.apache.org/jira/browse/INFRA-13530 "So the 'default' is that PMC members have access to the dist dev/release area of a project. The PMC can request that that setting be lifted to include project committers. (We wont grant

Re: Arrow sync starting now

2017-02-16 Thread Julien Le Dem
Here is the doc on how the website gets updated: https://www.apache.org/dev/project-site.html On Thu, Feb 16, 2017 at 10:59 AM, Julien Le Dem wrote: > notes: > > Attendees > - Khaled (PhD student Waterloo): distributed graph processing. Use arrow > for distributed grap

Re: Arrow sync starting now

2017-02-16 Thread Julien Le Dem
xes. On Thu, Feb 16, 2017 at 10:04 AM, Julien Le Dem wrote: > https://hangouts.google.com/hangouts/_/dremio.com/arrow > > -- > Julien > -- Julien

Arrow sync starting now

2017-02-16 Thread Julien Le Dem
https://hangouts.google.com/hangouts/_/dremio.com/arrow -- Julien

  1   2   3   4   >