I'll update it. Thanks!

(By the way, the Avro default value support was in the Java section)

On Wed, Dec 11, 2024 at 2:00 PM Matt Topol <zotthewiz...@gmail.com> wrote:

> For the Go release, can we please point out that it supports reading the
> data too, not just metadata?
>
> It produces a stream of Arrow record batches.
>
> On Wed, Dec 11, 2024, 4:22 PM Walaa Eldin Moustafa <wa.moust...@gmail.com>
> wrote:
>
>> Hi Ryan,
>>
>> For Table Format V3, we could point out that the default value support
>> for Avro has been merged and support for other formats is ongoing.
>>
>> Thanks,
>> Walaa.
>>
>>
>> On Wed, Dec 11, 2024 at 12:51 PM rdb...@gmail.com <rdb...@gmail.com>
>> wrote:
>>
>>> Hi everyone,
>>>
>>> It’s time to report to the board again. Great to see all the progress
>>> here, and awesome to have our first go release this quarter!
>>>
>>> My draft is below. Please reply if there’s anything you’d like to add or
>>> change. Thanks!
>>>
>>> Ryan
>>> Description:
>>>
>>> Apache Iceberg is a table format for huge analytic datasets that is
>>> designed
>>> for high performance and ease of use.
>>> Project Status:
>>>
>>> Current project status: Ongoing
>>> Issues for the board: None
>>> Membership Data:
>>>
>>> Apache Iceberg was founded 2020-05-19 (5 years ago)
>>> There are currently 32 committers and 21 PMC members in this project.
>>> The Committer-to-PMC ratio is roughly 4:3.
>>>
>>> Community changes, past quarter:
>>>
>>>    - No new PMC members. Last addition was Amogh Jahagirdar on
>>>    2024-08-12.
>>>    - Matthew Topol was added as committer on 2024-12-09
>>>    - Scott Donnelly was added as committer on 2024-12-10
>>>
>>> Project Activity:
>>>
>>> Releases
>>>
>>>    - 1.7.1 was released on 2024-12-06.
>>>    - 1.7.0 was released on 2024-11-08.
>>>    - PyIceberg 0.8.1 was released on 2024-12-06.
>>>    - PyIceberg 0.8.0 was released on 2024-11-18.
>>>    - Go 0.1.0 was released on 2024-11-18.
>>>
>>> Table format (v3)
>>>
>>>    - Added deletion vectors and synchronous maintenance to improve
>>>    row-level ops
>>>    - Added row lineage fields and requirements for fine-grained row
>>>    tracking
>>>    - Proposal for geography and geometry types is close to consensus
>>>    - Update to add Parquet’s variant type is approved, waiting on
>>>    Parquet upstream
>>>    - Finalized new type promotion rules
>>>
>>> Puffin format
>>>
>>>    - Added deletion vector blob type to support DVs in tables
>>>
>>> REST catalog spec
>>>
>>>    - Added storage credentials passing
>>>    - Added credential refresh
>>>    - Created a docker image for catalog testing
>>>    - Discussing proposal for partial metadata commits
>>>    - Discussed partial metadata loading
>>>
>>> Views
>>>
>>>    - Discussions about materialized view metadata are ongoing
>>>
>>> Java
>>>
>>>    - Released new Kafka Connect sink
>>>    - Added default values implementation for Avro
>>>    - Added nanosecond timestamps
>>>    - Added v3 DV support in core, ongoing work in Spark
>>>    - Flink: Made FLIP-27 source the default
>>>    - Spark: Removed Spark 3.3 support
>>>    - Hive: Removing Hive 2.x and 3.x (Iceberg support is in Hive for
>>>    4.x and on)
>>>    - Pig: Removed the iceberg-pig module that is no longer used
>>>
>>> PyIceberg
>>>
>>>    - Support: Added Python 3.12, dropped Python 3.8
>>>
>>> Rust
>>>
>>>    - Support for default values and type promotion in reads
>>>    - Added TableMetadataBuilder
>>>    - Implemented table requirements
>>>
>>> Go
>>>
>>>    - Produced the first go release!
>>>    - Supports scan planning and reading metadata
>>>    - Supports loading and listing tables with the Glue catalog
>>>    - Supports local and S3 storage
>>>
>>> C++
>>>
>>>    - Added a C++ repository for a Puffin implementation
>>>
>>> Community Health:
>>>
>>> The PMC has published guidelines for contributors that want to know more
>>> about
>>> how they can become committers on the Iceberg site. This guide should
>>> help
>>> contributors understand how Iceberg and other ASF communities decide and
>>> add
>>> committers, and should set expectations clearly. This was the most
>>> important
>>> follow up from discussions on the dev list earlier this year, where it
>>> became
>>> clear that contributors did not understand the requirements or process.
>>>
>>> The community has started planning a second Iceberg Summit, intended to
>>> be held
>>> in Spring of 2025. The proposal details are being finalized (such as the
>>> members
>>> of the selection committee) and will be submitted for approval in the
>>> next few
>>> weeks.
>>>
>>> The community added two new committers this quarter and had a slight
>>> increase in
>>> the number of contributors.
>>>
>>> There were also a number of commercial announcements from companies
>>> adding or
>>> expanding support for Iceberg.
>>>
>>

Reply via email to