[ANNOUNCE] Apache Iceberg release 0.13.0

2022-02-07 Thread Jack Ye
Hi everyone, I'm pleased to announce the release of Apache Iceberg 0.13.0! Apache Iceberg is an open table format for huge analytic datasets. Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible table e

Re: New Iceberg Site Released!

2022-02-07 Thread Sam Redai
A redirect for https://iceberg.apache.org/spark-configuration already exists but there was an odd behavior in the previous theme that would add a "#" character in the url. Unfortunately that's not honored by the redirections but I'm looking into a way to do that. Agreed that it would be great to ke

Re: New Iceberg Site Released!

2022-02-07 Thread Jeff Zhang
Another suggestion is that it is better to have redirection for the old iceberg links which are spread out in the previous iceberg email list and slack channel. E.g. the following link doesn't work on the new website https://iceberg.apache.org/#spark-configuration/#write-options It is better to r

Re: New Iceberg Site Released!

2022-02-07 Thread Sam Redai
Thanks for noticing this Jeff! I've opened a PR with a fix. :) -Sam On Mon, Feb 7, 2022 at 6:37 PM Jeff Zhang wrote: > Great news, the new site is awesome. > I found one minor issue: the snapshot image on the spec page is missing. > > https://iceberg.apache.org/spec/ > > > On Tue, Feb 8, 2022 a

Re: New Iceberg Site Released!

2022-02-07 Thread Jeff Zhang
Great news, the new site is awesome. I found one minor issue: the snapshot image on the spec page is missing. https://iceberg.apache.org/spec/ On Tue, Feb 8, 2022 at 10:12 AM Sam Redai wrote: > Hey everyone, > > The new Iceberg documentation site has been officially released. A big > thanks to

New Iceberg Site Released!

2022-02-07 Thread Sam Redai
Hey everyone, The new Iceberg documentation site has been officially released. A big thanks to everyone who contributed and/or helped guide the design. This is particularly exciting since we'll now have versioned docs going forward. Jack Ye as the 0.13.0 release manager is going through the steps

Re: New Versioned Iceberg Documentation Site

2022-02-07 Thread Peter Vary
Nice site Sam! Thanks for the good work! Shall we include Hive in the main page? Thanks, Peter On Mon, 7 Feb 2022 at 08:58, Eduard Tudenhoefner wrote: > I agree that design docs and such are currently difficult to find. I just > wanted to point out that some are linked in > https://github.com/

Re: Time-sliced incremental scan

2022-02-07 Thread Peidian Li
*Second, there’s the more immediate question: what does a query for VERSIONS BETWEEN SYSTEM TIME 2 AND 4 actually mean?* *My initial answer is that I would return the equivalent of diffing the two versions, (SELECT * FROM t AS OF TIMESTAMP 2) start_state and (SELECT * FROM t AS OF TIMESTAMP 4) end