[GitHub] mccheah commented on a change in pull request #6: Support customizing the location where data is written in Spark

mccheah commented on a change in pull request #6: Support customizing the location where data is written in Spark URL: https://github.com/apache/incubator-iceberg/pull/6#discussion_r237681875 ## File path: spark/src/test/java/com/netflix/iceberg/spark/source/TestDataFrameWrites.jav

[GitHub] mccheah commented on a change in pull request #7: Allow custom hadoop properties to be loaded in the Spark data source

mccheah commented on a change in pull request #7: Allow custom hadoop properties to be loaded in the Spark data source URL: https://github.com/apache/incubator-iceberg/pull/7#discussion_r237681346 ## File path: spark/src/main/java/com/netflix/iceberg/spark/source/IcebergSource.java

[GitHub] mccheah commented on issue #14: Pluggable file I/O submodule in TableOperations

mccheah commented on issue #14: Pluggable file I/O submodule in TableOperations URL: https://github.com/apache/incubator-iceberg/pull/14#issuecomment-443015201 @rdblue for review. This is an automated message from the Apache G

[GitHub] mccheah commented on issue #16: Custom metadata in data files

mccheah commented on issue #16: Custom metadata in data files URL: https://github.com/apache/incubator-iceberg/issues/16#issuecomment-443012368 We store the information in our internal system as per-file metadata. We want to be able to batch-fetch this information from our system and load

[GitHub] rdblue commented on issue #16: Custom metadata in data files

rdblue commented on issue #16: Custom metadata in data files URL: https://github.com/apache/incubator-iceberg/issues/16#issuecomment-443009203 Where do you guys store this information now? Where would it be stored in Iceberg? Table metadata or file metadata? --

Podling Report Reminder - December 2018

Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 19 December 2018, 10:30 am PDT. The report for your podling will for

[GitHub] mccheah commented on issue #18: Avro files in tests should be generated under the build folder

mccheah commented on issue #18: Avro files in tests should be generated under the build folder URL: https://github.com/apache/incubator-iceberg/issues/18#issuecomment-442996356 I can't reproduce this anymore... I'll re-open if I see it again. Maybe it was fixed inadvertently somehow? ---

[GitHub] mccheah closed issue #18: Avro files in tests should be generated under the build folder

mccheah closed issue #18: Avro files in tests should be generated under the build folder URL: https://github.com/apache/incubator-iceberg/issues/18 This is an automated message from the Apache Git Service. To respond to the

[GitHub] mccheah commented on issue #16: Custom metadata in data files

mccheah commented on issue #16: Custom metadata in data files URL: https://github.com/apache/incubator-iceberg/issues/16#issuecomment-442996074 @rdblue, @rdsr @hiteshs, just wanted to check in to see if this is still an acceptable proposal.

[GitHub] mccheah closed pull request #11: Ignore .avro, .avro.crc, and hive/derby.log.

mccheah closed pull request #11: Ignore .avro, .avro.crc, and hive/derby.log. URL: https://github.com/apache/incubator-iceberg/pull/11 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a f

[GitHub] mccheah commented on issue #11: Ignore .avro, .avro.crc, and hive/derby.log.

mccheah commented on issue #11: Ignore .avro, .avro.crc, and hive/derby.log. URL: https://github.com/apache/incubator-iceberg/pull/11#issuecomment-442926245 Hm, in my recent tests the `.avro` files have gone. In the meantime the `derby.log` file is put in the right place in this patch: htt