Re: Temporal join on rolling aggregate

2024-02-25 Thread Ron liu
+1, But I think this should be a more general requirement, that is, support for declaring watermarks in query, which can be declared for any type of source, such as table, view. Similar to databricks provided [1], this needs a FLIP. [1] https://docs.databricks.com/en/sql/language-manual/sql-ref-sy

Re: Schema Evolution & Json Schemas

2024-02-25 Thread Andrew Otto
> the following code generator Oh, and FWIW we avoid code generation and POJOs, and instead rely on Flink's Row or RowData abstractions. On Sun, Feb 25, 2024 at 10:35 AM Andrew Otto wrote: > Hi! > > I'm not sure if this totally is relevant for you, but we use JSONSchema > and JSON with Flin

Re: Schema Evolution & Json Schemas

2024-02-25 Thread Andrew Otto
Hi! I'm not sure if this totally is relevant for you, but we use JSONSchema and JSON with Flink at the Wikimedia Foundation. We explicitly disallow the use of additionalProperties , unless it is t