Hi, Yubin

Thank you for initiating this discussion! +1 for the proposal.






Best,
Yuepeng Pan









At 2024-03-14 18:57:35, "Ferenc Csaky" <ferenc.cs...@pm.me.INVALID> wrote:
>Hi Yubin,
>
>Thank you for initiating this discussion! +1 for the proposal.
>
>I also think it makes sense to group the missing catalog related
>SQL syntaxes under this FLIP.
>
>Looking forward to these features!
>
>Best,
>Ferenc
>
>
>
>
>On Thursday, March 14th, 2024 at 08:31, Jane Chan <qingyue....@gmail.com> 
>wrote:
>
>> 
>> 
>> Hi Yubin,
>> 
>> Thanks for leading the discussion. I'm +1 for the FLIP.
>> 
>> As Jark said, it's a good opportunity to enhance the syntax for Catalog
>> from a more comprehensive perspective. So, I suggest expanding the scope of
>> this FLIP by focusing on the mechanism instead of one use case to enhance
>> the overall functionality. WDYT?
>> 
>> Best,
>> Jane
>> 
>> On Thu, Mar 14, 2024 at 11:38 AM Hang Ruan ruanhang1...@gmail.com wrote:
>> 
>> > Hi, Yubin.
>> > 
>> > Thanks for the FLIP. +1 for it.
>> > 
>> > Best,
>> > Hang
>> > 
>> > Yubin Li lyb5...@gmail.com 于2024年3月14日周四 10:15写道:
>> > 
>> > > Hi Jingsong, Feng, and Jeyhun
>> > > 
>> > > Thanks for your support and feedback!
>> > > 
>> > > > However, could we add a new method `getCatalogDescriptor()` to
>> > > > CatalogManager instead of directly exposing CatalogStore?
>> > > 
>> > > Good point, Besides the audit tracking issue, The proposed feature
>> > > only requires `getCatalogDescriptor()` function. Exposing components
>> > > with excessive functionality will bring unnecessary risks, I have made
>> > > modifications in the FLIP doc [1]. Thank Feng :)
>> > > 
>> > > > Showing the SQL parser implementation in the FLIP for the SQL syntax
>> > > > might be a bit confusing. Also, the formal definition is missing for
>> > > > this SQL clause.
>> > > 
>> > > Thank Jeyhun for pointing it out :) I have updated the doc [1] .
>> > > 
>> > > [1]
>> > 
>> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=296290756
>> > 
>> > > Best,
>> > > Yubin
>> > > 
>> > > On Thu, Mar 14, 2024 at 2:18 AM Jeyhun Karimov je.kari...@gmail.com
>> > > wrote:
>> > > 
>> > > > Hi Yubin,
>> > > > 
>> > > > Thanks for the proposal. +1 for it.
>> > > > I have one comment:
>> > > > 
>> > > > I would like to see the SQL syntax for the proposed statement. Showing
>> > > > the
>> > > > SQL parser implementation in the FLIP
>> > > > for the SQL syntax might be a bit confusing. Also, the formal
>> > > > definition
>> > > > is
>> > > > missing for this SQL clause.
>> > > > Maybe something like [1] might be useful. WDYT?
>> > > > 
>> > > > Regards,
>> > > > Jeyhun
>> > > > 
>> > > > [1]
>> > 
>> > https://github.com/apache/flink/blob/0da60ca1a4754f858cf7c52dd4f0c97ae0e1b0cb/docs/content/docs/dev/table/sql/show.md?plain=1#L620-L632
>> > 
>> > > > On Wed, Mar 13, 2024 at 3:28 PM Feng Jin jinfeng1...@gmail.com
>> > > > wrote:
>> > > > 
>> > > > > Hi Yubin
>> > > > > 
>> > > > > Thank you for initiating this FLIP.
>> > > > > 
>> > > > > I have just one minor question:
>> > > > > 
>> > > > > I noticed that we added a new function `getCatalogStore` to expose
>> > > > > CatalogStore, and it seems fine.
>> > > > > However, could we add a new method `getCatalogDescriptor()` to
>> > > > > CatalogManager instead of directly exposing CatalogStore?
>> > > > > By only providing the `getCatalogDescriptor()` interface, it may be
>> > > > > easier
>> > > > > for us to implement audit tracking in CatalogManager in the future.
>> > > > > WDYT ?
>> > > > > Although we have only collected some modified events at the
>> > > > > moment.[1]
>> > > > > 
>> > > > > [1].
>> > 
>> > https://cwiki.apache.org/confluence/display/FLINK/FLIP-294%3A+Support+Customized+Catalog+Modification+Listener
>> > 
>> > > > > Best,
>> > > > > Feng
>> > > > > 
>> > > > > On Wed, Mar 13, 2024 at 5:31 PM Jingsong Li jingsongl...@gmail.com
>> > > > > wrote:
>> > > > > 
>> > > > > > +1 for this.
>> > > > > > 
>> > > > > > We are missing a series of catalog related syntaxes.
>> > > > > > Especially after the introduction of catalog store. [1]
>> > > > > > 
>> > > > > > [1]
>> > 
>> > https://cwiki.apache.org/confluence/display/FLINK/FLIP-295%3A+Support+lazy+initialization+of+catalogs+and+persistence+of+catalog+configurations
>> > 
>> > > > > > Best,
>> > > > > > Jingsong
>> > > > > > 
>> > > > > > On Wed, Mar 13, 2024 at 5:09 PM Yubin Li lyb5...@gmail.com
>> > > > > > wrote:
>> > > > > > 
>> > > > > > > Hi devs,
>> > > > > > > 
>> > > > > > > I'd like to start a discussion about FLIP-436: Introduce "SHOW
>> > > > > > > CREATE
>> > > > > > > CATALOG" Syntax [1].
>> > > > > > > 
>> > > > > > > At present, the `SHOW CREATE TABLE` statement provides strong
>> > > > > > > support
>> > > > > > > for
>> > > > > > > users to easily
>> > > > > > > reuse created tables. However, despite the increasing importance
>> > > > > > > of the
>> > > > > > > `Catalog` in user's
>> > > > > > > business, there is no similar statement for users to use.
>> > > > > > > 
>> > > > > > > According to the online discussion in FLINK-24939 [2] with Jark
>> > > > > > > Wu
>> > > > > > > and
>> > > > > > > Feng
>> > > > > > > Jin, since `CatalogStore`
>> > > > > > > has been introduced in FLIP-295 [3], we could use this component
>> > > > > > > to
>> > > > > > > implement such a long-awaited
>> > > > > > > feature, Please refer to the document [1] for implementation
>> > > > > > > details.
>> > > > > > > 
>> > > > > > > examples as follows:
>> > > > > > > 
>> > > > > > > Flink SQL> create catalog cat2 WITH ('type'='generic_in_memory',
>> > > > > > > 
>> > > > > > > > 'default-database'='db');
>> > > > > > > > [INFO] Execute statement succeeded.
>> > > > > > > > Flink SQL> show create catalog cat2;
>> > 
>> > +----------------------------------------------------------------------------------------+
>> > 
>> > > > > > > > | result |
>> > 
>> > +----------------------------------------------------------------------------------------+
>> > 
>> > > > > > > > | CREATE CATALOG `cat2` WITH (
>> > > > > > > > 'default-database' = 'db',
>> > > > > > > > 'type' = 'generic_in_memory'
>> > > > > > > > )
>> > > > > > > > |
>> > 
>> > +----------------------------------------------------------------------------------------+
>> > 
>> > > > > > > > 1 row in set
>> > > > > > > 
>> > > > > > > Looking forward to hearing from you, thanks!
>> > > > > > > 
>> > > > > > > Best regards,
>> > > > > > > Yubin
>> > > > > > > 
>> > > > > > > [1]
>> > 
>> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=296290756
>> > 
>> > > > > > > [2] https://issues.apache.org/jira/browse/FLINK-24939
>> > > > > > > [3]
>> > 
>> > https://cwiki.apache.org/confluence/display/FLINK/FLIP-295%3A+Support+lazy+initialization+of+catalogs+and+persistence+of+catalog+configurations

Reply via email to