For C++, I think it is aimed for a full featured C++ library (not for
puffin implementation only).

On Thu, Dec 12, 2024 at 6:14 AM rdb...@gmail.com <rdb...@gmail.com> wrote:

> I'll update it. Thanks!
>
> (By the way, the Avro default value support was in the Java section)
>
> On Wed, Dec 11, 2024 at 2:00 PM Matt Topol <zotthewiz...@gmail.com> wrote:
>
>> For the Go release, can we please point out that it supports reading the
>> data too, not just metadata?
>>
>> It produces a stream of Arrow record batches.
>>
>> On Wed, Dec 11, 2024, 4:22 PM Walaa Eldin Moustafa <wa.moust...@gmail.com>
>> wrote:
>>
>>> Hi Ryan,
>>>
>>> For Table Format V3, we could point out that the default value support
>>> for Avro has been merged and support for other formats is ongoing.
>>>
>>> Thanks,
>>> Walaa.
>>>
>>>
>>> On Wed, Dec 11, 2024 at 12:51 PM rdb...@gmail.com <rdb...@gmail.com>
>>> wrote:
>>>
>>>> Hi everyone,
>>>>
>>>> It’s time to report to the board again. Great to see all the progress
>>>> here, and awesome to have our first go release this quarter!
>>>>
>>>> My draft is below. Please reply if there’s anything you’d like to add
>>>> or change. Thanks!
>>>>
>>>> Ryan
>>>> Description:
>>>>
>>>> Apache Iceberg is a table format for huge analytic datasets that is
>>>> designed
>>>> for high performance and ease of use.
>>>> Project Status:
>>>>
>>>> Current project status: Ongoing
>>>> Issues for the board: None
>>>> Membership Data:
>>>>
>>>> Apache Iceberg was founded 2020-05-19 (5 years ago)
>>>> There are currently 32 committers and 21 PMC members in this project.
>>>> The Committer-to-PMC ratio is roughly 4:3.
>>>>
>>>> Community changes, past quarter:
>>>>
>>>>    - No new PMC members. Last addition was Amogh Jahagirdar on
>>>>    2024-08-12.
>>>>    - Matthew Topol was added as committer on 2024-12-09
>>>>    - Scott Donnelly was added as committer on 2024-12-10
>>>>
>>>> Project Activity:
>>>>
>>>> Releases
>>>>
>>>>    - 1.7.1 was released on 2024-12-06.
>>>>    - 1.7.0 was released on 2024-11-08.
>>>>    - PyIceberg 0.8.1 was released on 2024-12-06.
>>>>    - PyIceberg 0.8.0 was released on 2024-11-18.
>>>>    - Go 0.1.0 was released on 2024-11-18.
>>>>
>>>> Table format (v3)
>>>>
>>>>    - Added deletion vectors and synchronous maintenance to improve
>>>>    row-level ops
>>>>    - Added row lineage fields and requirements for fine-grained row
>>>>    tracking
>>>>    - Proposal for geography and geometry types is close to consensus
>>>>    - Update to add Parquet’s variant type is approved, waiting on
>>>>    Parquet upstream
>>>>    - Finalized new type promotion rules
>>>>
>>>> Puffin format
>>>>
>>>>    - Added deletion vector blob type to support DVs in tables
>>>>
>>>> REST catalog spec
>>>>
>>>>    - Added storage credentials passing
>>>>    - Added credential refresh
>>>>    - Created a docker image for catalog testing
>>>>    - Discussing proposal for partial metadata commits
>>>>    - Discussed partial metadata loading
>>>>
>>>> Views
>>>>
>>>>    - Discussions about materialized view metadata are ongoing
>>>>
>>>> Java
>>>>
>>>>    - Released new Kafka Connect sink
>>>>    - Added default values implementation for Avro
>>>>    - Added nanosecond timestamps
>>>>    - Added v3 DV support in core, ongoing work in Spark
>>>>    - Flink: Made FLIP-27 source the default
>>>>    - Spark: Removed Spark 3.3 support
>>>>    - Hive: Removing Hive 2.x and 3.x (Iceberg support is in Hive for
>>>>    4.x and on)
>>>>    - Pig: Removed the iceberg-pig module that is no longer used
>>>>
>>>> PyIceberg
>>>>
>>>>    - Support: Added Python 3.12, dropped Python 3.8
>>>>
>>>> Rust
>>>>
>>>>    - Support for default values and type promotion in reads
>>>>    - Added TableMetadataBuilder
>>>>    - Implemented table requirements
>>>>
>>>> Go
>>>>
>>>>    - Produced the first go release!
>>>>    - Supports scan planning and reading metadata
>>>>    - Supports loading and listing tables with the Glue catalog
>>>>    - Supports local and S3 storage
>>>>
>>>> C++
>>>>
>>>>    - Added a C++ repository for a Puffin implementation
>>>>
>>>> Community Health:
>>>>
>>>> The PMC has published guidelines for contributors that want to know
>>>> more about
>>>> how they can become committers on the Iceberg site. This guide should
>>>> help
>>>> contributors understand how Iceberg and other ASF communities decide
>>>> and add
>>>> committers, and should set expectations clearly. This was the most
>>>> important
>>>> follow up from discussions on the dev list earlier this year, where it
>>>> became
>>>> clear that contributors did not understand the requirements or process.
>>>>
>>>> The community has started planning a second Iceberg Summit, intended to
>>>> be held
>>>> in Spring of 2025. The proposal details are being finalized (such as
>>>> the members
>>>> of the selection committee) and will be submitted for approval in the
>>>> next few
>>>> weeks.
>>>>
>>>> The community added two new committers this quarter and had a slight
>>>> increase in
>>>> the number of contributors.
>>>>
>>>> There were also a number of commercial announcements from companies
>>>> adding or
>>>> expanding support for Iceberg.
>>>>
>>>

Reply via email to