Re: [DISCUSS] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

2023-03-02 Thread Jingsong Li
the JDBC interfaces listed in the FLIP, I think they looks good > > already. Besides `java.sql.Driver`, have you considered also adding support > > for `javax.sql.DataSource` interface? > > > > Jingsong Li 于2023年3月1日周三 17:53写道: > > > > > Thanks Shammon for

Re: [DISCUSS] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

2023-03-06 Thread Jingsong Li
Wow, we have 300 FLIPs... Thanks Lincoln, Have you considered returning an Optional? Empty array looks a little weird to me. Best, Jingsong On Tue, Mar 7, 2023 at 10:32 AM Aitozi wrote: > > Hi Lincoln, > Thank you for sharing this FLIP. Overall, it looks good to me. I have > one question:

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

2023-03-12 Thread Jingsong Li
Congratulations, Yuxia! On Mon, Mar 13, 2023 at 11:49 AM Juntao Hu wrote: > > Congratulations, Yuxia! > > Best, > Juntao > > > Wencong Liu 于2023年3月13日周一 11:33写道: > > > Congratulations, Yuxia! > > > > Best, > > Wencong Liu > > > > > > At 2023-03-13 11:20:21, "Qingsheng Ren" wrote: > > >Congratul

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

2023-03-13 Thread Jingsong Li
+1 (binding) Not block voting. But comment about `Public Interface` in the FLIP: these classes may not be `Public interface`? I think they are just internal implementations. Best, Jingsong On Mon, Mar 13, 2023 at 2:10 PM Benchao Li wrote: > > +1 (binding) > > Shammon FY 于2023年3月13日周一 13:47写道:

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

2023-03-14 Thread Jingsong Li
+1 binding On Tue, Mar 14, 2023 at 10:54 AM Samrat Deb wrote: > > +1 (non binding) > Thanks for driving it . > > Bests, > Samrat > > On Tue, 14 Mar 2023 at 7:41 AM, Jark Wu wrote: > > > +1 (binding) > > > > Best, > > Jark > > > > > 2023年3月13日 23:25,Aitozi 写道: > > > > > > +1 (non-binding) > > >

Re: [VOTE] FLIP-296: Extend watermark-related features for SQL

2023-03-20 Thread Jingsong Li
+1 binding Jark Wu 于2023年3月20日 周一21:19写道: > +1 (binding) > > Best, > Jark > > > 2023年3月15日 17:42,Yun Tang 写道: > > > > +1 (binding) > > > > Thanks Kui for driving this work. > > > > > > Best > > Yun Tang > > > > From: Kui Yuan > > Sent: Wednesday, March 15, 2023

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread Jingsong Li
Congratulations! I believe Paimon will work with Flink to build the best streaming data warehouse. Best, Jingsong On Tue, Mar 28, 2023 at 8:27 AM Shammon FY wrote: > > Congratulations! > > > Best, > Shammon FY > > On Mon, Mar 27, 2023 at 11:37 PM Samrat Deb wrote: > > > congratulations > > > >

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-06 Thread Jingsong Li
+1 for voting. Best, Jingsong On Thu, Apr 6, 2023 at 4:52 PM yuxia wrote: > > Hi everyone. > > If there are no other questions or concerns for the FLIP[1], I'd like to > start the vote next Monday (4.10). > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-302%3A+Support+TRUNCATE+

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-07 Thread Jingsong Li
Hi Yun, It looks like this doc needs permission to read? [1] [1] https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit# Best, Jingsong On Fri, Apr 7, 2023 at 4:34 PM Piotr Nowojski wrote: > > Hi, > > +1 To what Yun Tang wrote. We don't seem to have access to the

[DISCUSS] Release Paimon 0.4

2023-04-12 Thread Jingsong Li
Hi everyone, I'm going to check out the 0.4 branch out next Monday, and won't merge major refactoring-related PRs into master branch until next Monday. Blockers: - Entire Database Sync CC @Caizhi Weng - CDC Ingestion mysql DATETIME(6) cast error [1] - MySqlSyncTableAction should support case igno

Re: [DISCUSS] Release Paimon 0.4

2023-04-12 Thread Jingsong Li
Oh sorry to Flink devs, This email should be sent to paimon dev, please ignore it. Best, Jingsong On Thu, Apr 13, 2023 at 10:56 AM Jingsong Li wrote: > > Hi everyone, > > I'm going to check out the 0.4 branch out next Monday, and won't merge > major refactoring-relat

Re: Re: [VOTE] FLIP-302: Support TRUNCATE TABLE statement in batch mode

2023-04-17 Thread Jingsong Li
+1 On Tue, Apr 18, 2023 at 9:39 AM Aitozi wrote: > > +1 > > Best, > Aitozi > > ron 于2023年4月18日周二 09:18写道: > > > > +1 > > > > > > > -原始邮件- > > > 发件人: "Lincoln Lee" > > > 发送时间: 2023-04-18 09:08:08 (星期二) > > > 收件人: dev@flink.apache.org > > > 抄送: > > > 主题: Re: [VOTE] FLIP-302: Support TRUNC

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-21 Thread Jingsong Li
Congratulations! Well deserved! On Wed, Feb 21, 2024 at 4:36 PM Yuepeng Pan wrote: > > Congratulations~ :) > > Best, > Yuepeng Pan > > > > > > > > > > > 在 2024-02-21 09:52:17,"Hongshun Wang" 写道: > >Congratulations, Jiabao :) > >Congratulations Jiabao! > > > >Best, > >Hongshun > >Best regards, >

Re: [ANNOUNCE] Flink 1.19 Cross-team testing completed & sync summary on 02/27/2024

2024-02-27 Thread Jingsong Li
Thanks Lincoln and all contributors! Best, Jingsong On Wed, Feb 28, 2024 at 12:15 PM Xintong Song wrote: > > Matthias has already said it on the release sync, but I still want to say > it again. It's amazing how smooth the release testing goes for this > release. Great thanks to the release mana

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Jingsong Li
+1 for setting up On Tue, Mar 5, 2024 at 5:39 PM Jing Ge wrote: > > +1 and thanks for the proposal! > > Best regards, > Jing > > On Tue, Mar 5, 2024 at 10:26 AM tison wrote: > > > I like this idea, so +1 for setting up. > > > > For anyone who have the access, this is a related thread about > > p

Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax

2024-03-13 Thread Jingsong Li
+1 for this. We are missing a series of catalog related syntaxes. Especially after the introduction of catalog store. [1] [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-295%3A+Support+lazy+initialization+of+catalogs+and+persistence+of+catalog+configurations Best, Jingsong On Wed, M

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Jingsong Li
Congratulations! On Mon, Mar 18, 2024 at 4:30 PM Rui Fan <1996fan...@gmail.com> wrote: > > Congratulations, thanks for the great work! > > Best, > Rui > > On Mon, Mar 18, 2024 at 4:26 PM Lincoln Lee wrote: >> >> The Apache Flink community is very happy to announce the release of Apache >> Flink

Re: [DISCUSS] Flink Website Menu Adjustment

2024-03-25 Thread Jingsong Li
+1 for the proposal On Mon, Mar 25, 2024 at 10:01 PM Ferenc Csaky wrote: > > Suggested changes makes sense, +1 for the proposed menus and order. > > Best, > Ferenc > > > > > On Monday, March 25th, 2024 at 14:50, Gyula Fóra wrote: > > > > > > > +1 for the proposal > > > > Gyula > > > > On Mon, Ma

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-14 Thread Jingsong Li
Congratulations On Mon, Apr 15, 2024 at 9:32 AM Yanquan Lv wrote: > > Congratulations, Jing! > > Jark Wu 于2024年4月12日周五 16:03写道: > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce that Jing Ge has > > joined the Flink PMC! > > > > Jing has been contributing to Apache Flin

Re: Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-14 Thread Jingsong Li
Congratulations On Mon, Apr 15, 2024 at 9:32 AM Xuyang wrote: > > Congratulations, Lincoln. > > > -- > > Best! > Xuyang > > > > > > 在 2024-04-14 21:49:53,"Benchao Li" 写道: > >Congratulations, Lincoln. Well deserved! > > > >Leonard Xu 于2024年4月14日周日 21:19写道: > >> > >> Congratulations, Linc

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-18 Thread Jingsong Li
+1 On Thu, Apr 18, 2024 at 11:09 AM Yun Tang wrote: > > +1 (binding) > > Best, > Yun Tang > > From: Jark Wu > Sent: Thursday, April 18, 2024 9:54 > To: dev@flink.apache.org > Subject: Re: [VOTE] FLIP-435: Introduce a New Materialized Table for > Simplifying Dat

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #1

2024-05-07 Thread Jingsong Li
-1 Thanks Qingsheng for preparing this RC. If you bundle third-party dependencies (non Flink dependencies) in your published jar, you need to write them in the NOTICE file. I recommend adding a test using flink-ci-tools to verify if the NOTICE file is correct. Of course, you cannot rely too much

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-16 Thread Jingsong Li
+1 (binding) - Verified signature and checksum hash - Verified that no binaries exist in the source archive - Build source code successful - Reviewed the release web PR - Check tag and branch exist Best, Jingsong On Thu, May 16, 2024 at 4:25 PM Jark Wu wrote: > > +1 (binding) > > - checked sign

Re: Re: [ANNOUNCE] Apache Flink CDC 3.1.0 released

2024-05-19 Thread Jingsong Li
CC to the Paimon community. Best, Jingsong On Mon, May 20, 2024 at 9:55 AM Jingsong Li wrote: > > Amazing, congrats! > > Best, > Jingsong > > On Sat, May 18, 2024 at 3:10 PM 大卫415 <2446566...@qq.com.invalid> wrote: > > > > 退订 > > > > > >

Re: Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-11 Thread Jingsong Li
Hi all, +1 to this FLIP, very thanks all for your proposal. isDeterministic looks good to me too. We can consider stating the following points: 1. How to enable custom data distribution? Is it a dynamic hint? Can you provide an SQL example. 2. What impact will it have when the mainstream is ch

Re: [ANNOUNCE] New PMC member: Yuan Mei

2022-03-20 Thread Jingsong Li
Congrats Yuan! Well deserved! Best, Jingsong On Thu, Mar 17, 2022 at 8:37 PM Terry Wang wrote: > > Congratulations Yuan! > > On Tue, Mar 15, 2022 at 5:55 PM Jark Wu wrote: > > > Congrats Yuan! Well deserved! > > > > Best, > > Jark > > > > On Tue, 15 Mar 2022 at 17:42, Qingsheng Ren wrote: > >

Re: [NOTICE] Migration to GitHub Actions

2022-04-04 Thread Jingsong Li
+1 Thanks Chesnay for your effort. Github Actions is really convenient! Jing Ge 于2022年4月5日 周二00:01写道: > Thanks Chesnay for your effort! Really looking forward to it! > > On Mon, Apr 4, 2022 at 3:41 PM Martijn Visser > wrote: > > > This is a massive improvement over the existing situation, thank

[ANNOUNCE] Flink Table Store release-0.1 branch cut

2022-04-04 Thread Jingsong Li
Hi Flink devs! The release-0.1[1] branch has been forked from master and version numbers have been upgraded accordingly. We have written and posted the necessary documentation to the web. [2] The documentation has a quick start and general usage instructions. We are continuing to advance functi

Re: [DISCUSS] FLIP-220: Temporal State

2022-04-12 Thread Jingsong Li
Hi David, Thanks for driving. I understand that state storage itself supports byte ordering, have we considered exposing Binary**State? This way the upper layers can be implemented on demand, Temporal is just one of them. Best, Jingsong On Tue, Apr 12, 2022 at 3:01 PM Aitozi wrote: > > Hi Davi

Re: [DISCUSS] Roadmap update for 1.15

2022-04-13 Thread Jingsong Li
Hi Joe, Thanks for driving. Looks very good~ As a part of Apache Flink,Flink Table Store [1][2] is a new feature on Flink Table. It is now in Beta status. Now Flink Table Store is waiting for the release of Flink 1.15 as it depends on Flink 1.15, so it is ready to release the first version after

Re: [DISCUSS] Roadmap update for 1.15

2022-04-13 Thread Jingsong Li
apache/flink-web/pull/527/files#diff-51abe96bc493857fdfba599c6b70e3a6c09200cf29e130d15b599fef538e32dfR87-R89 > > > On 13.04.2022, at 09:19, Jingsong Li wrote: > > > > Hi Joe, > > > > Thanks for driving. Looks very good~ > > > > As a part of Apache Flink,Flink Table Store

Re: [ANNOUNCE] New scalafmt formatter has been merged

2022-04-13 Thread Jingsong Li
Thanks for your work, Francesco Best, Jingsong On Wed, Apr 13, 2022 at 6:37 PM Guowei Ma wrote: > > Hi, Francesco > Thanks for your work! > Best, > Guowei > > > On Wed, Apr 13, 2022 at 5:35 PM Dian Fu wrote: > > > Thanks a lot for this great work Francesco! > > > > Regards, > > Dian > > > > On

Re: Re: Re: Re: Re: 回复:Re:[DISCUSS] FLIP-214 Support Advanced Function DDL

2022-04-14 Thread Jingsong Li
I agree with Martijn. At least, HDFS S3 OSS should be supported. Best, Jingsong On Thu, Apr 14, 2022 at 4:46 PM Martijn Visser wrote: > > Hi Ron, > > The FLIP mentions that the priority will be set to support HDFS as a > resource provider. I'm concerned that we end up with a partially > impleme

Re: Discussion about enhancing the partitioned table syntax

2022-04-15 Thread Jingsong Li
Thanks for taking this. There is a FLIP [1] to define some partition DMLs. If you have added DMLs, we need to vote again. (Create a new FLIP) [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support Best, Jingsong On Fri, Apr 15, 2022 at 3:20 PM Martijn

Re: [DISCUSS] Docker images for SNAPSHOT

2022-04-21 Thread Jingsong Li
+1 to public Flink Docker image for snapshot. Best, Jingsong On Fri, Apr 22, 2022 at 2:23 AM Alexander Fedulov wrote: > > Hi everyone, > > in the scope of work on externalizing connectors [1] it became evident that > we need to add the process of releasing SNAPSHOT (nightly) Docker images > for

Re: [DISCUSS] Maintain a Calcite repository for Flink to accelerate the development for Flink SQL features

2022-04-22 Thread Jingsong Li
Thanks Godfrey for driving this. Sounds good to me. I have a few questions: ## Do we have the plan to upgrade calcite to 1.31? It looks like only one major upgrade later will solve the current problem. ## Is Cherry-pick costly? If the conflict is large, this may require too much effort in thi

[DISCUSS] More public interfaces for internal data structures

2022-04-25 Thread Jingsong Li
Hi everyone, The source sink for the Table/SQL has now been completely switched to a new API (DynamicTableFactory), which requires connector developers to prioritize the use of internal data structures. For example, SourceProvider and SinkProvider. There are complex connectors that have many requ

Re: [DISCUSS] Planning Flink 1.16

2022-04-27 Thread Jingsong Li
Thanks Konstantin and Chesnay for starting the discussion. And thanks Konstantin, Chesnay, Godfrey, Martijn for volunteering. The 1.16 release at the end of July means that there are currently only 3 months to fully commit to 1.16 development, and I'm a little concerned that this is too short a ti

Re: [VOTE] FLIP-216: Introduce pluggable dialect and plan for migrating Hive dialect

2022-04-27 Thread Jingsong Li
+1 (Binding) A very good step to move forward. Best. Jingsong On Wed, Apr 27, 2022 at 9:33 PM yuxia wrote: > > Hi, everyone > > Thanks all for attention to FLIP-216: Introduce pluggable dialect and plan > for migrating Hive dialect [1] and participation in the discussion in the > mail thread

[VOTE] Apache Flink Table Store 0.1.0, release candidate #1

2022-04-27 Thread Jingsong Li
Hi everyone, Please review and vote on the release candidate #1 for the version 0.1.0 of Apache Flink Table Store, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Release Overview** As an overview, the release consists of the follo

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #1

2022-04-28 Thread Jingsong Li
.flink.table.planner.plan.utils.SortUtil$ > > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:418) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) > > at java.lang.ClassLoader.loadClass(ClassLoader.

Re: [DISCUSS] Planning Flink 1.16

2022-04-28 Thread Jingsong Li
t; months before to the desired release date? > > Cheers, > > Konstantin > > [1] https://cwiki.apache.org/confluence/display/FLINK/Time-based+releases > > Am Do., 28. Apr. 2022 um 05:20 Uhr schrieb Jingsong Li < > jingsongl...@gmail.com>: > > > Thanks Konsta

Re: [DISCUSS] Keep the Community Member Information Up-to-Date

2022-04-28 Thread Jingsong Li
One value is that this page has avatars. :-) Best, Jingsong On Thu, Apr 28, 2022 at 8:27 PM Chesnay Schepler wrote: > > Personally I'm tempted to just link to > https://projects.apache.org/committee.html?flink, if at all. > > I'm not sure overall whether this listing really provides value in the

[VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-04-28 Thread Jingsong Li
Hi everyone, Please review and vote on the release candidate #2 for the version 0.1.0 of Apache Flink Table Store, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Release Overview** As an overview, the release consists of the follo

[DISCUSS] FLIP-226: Introduce Schema Evolution on Table Store

2022-04-29 Thread Jingsong Li
Hi devs, I want to start a discussion about Schema Evolution on the Flink Table Store. [1] In FLINK-21634, We plan to support many schema changes in Flink SQL. But for the current Table Store, it may result in wrong data, unclear evolutions. In general, the user has these operations for schema:

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-05-04 Thread Jingsong Li
.org/repos/dist/dev/flink/flink-table-store-0.1.0-rc2/ > [3] https://repository.apache.org/content/repositories/orgapacheflink-1502/ > > On Fri, Apr 29, 2022 at 10:24 AM Jingsong Li wrote: > > > Hi everyone, > > > > Please review and vote on the release candidate #2 for the version 0.1.0

Re: [ANNOUNCE] Apache Flink 1.15.0 released

2022-05-05 Thread Jingsong Li
Cheers! Congratulations! Thank you very much! And thank all who contributed to this release. Best, Jingsong On Thu, May 5, 2022 at 3:57 PM Xintong Song wrote: > > Congratulations~! > > Thank the release managers, and thank all who contributed to this release. > > Thank you~ > > Xintong Song > >

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-05-05 Thread Jingsong Li
0 | buy | 2022-05-04 | > > | 101 | 201 | purchase | 2022-05-04 | > > +-+-+--++ > > 2 rows in set > > On Thu, May 5, 2022 at 2:39 PM Nicholas Jiang > wrote: > > > Hi everyone, > > > > +1 for the release (non-binding). > &

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

2022-05-05 Thread Jingsong Li
Thanks Shengkai for driving. And all for your discussion. > The reason why we introduce the gateway with pluggable endpoints is that many > users has their preferences. For example, the HiveServer2 users prefer to use > the gateway with HiveServer2-style API, which has numerous tools. However,

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

2022-05-05 Thread Jingsong Li
Congratulations, Yang! Best, Jingsong On Fri, May 6, 2022 at 10:04 AM yuxia wrote: > > Congratulations, Yang! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Zhu Zhu" > 收件人: "dev" > 抄送: "Yang Wang" > 发送时间: 星期四, 2022年 5 月 05日 下午 10:36:19 > 主题: Re: [ANNOUNCE] New Flink PMC member: Yang W

Re: [DISCUSS] FLIP-220: Temporal State

2022-05-06 Thread Jingsong Li
+1 to generic interface for sorted state and Binary***State. Very happy to be able to go one step further and thank you for your discussion. Best, Jingsong On Fri, May 6, 2022 at 8:37 PM Nico Kruber wrote: > > While working a bit more on this, David A and I noticed a couple of things > that wer

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-06 Thread Jingsong Li
Most of the open source communities I know have set up their slack channels, such as Apache Iceberg [1], Apache Druid [2], etc. So I think slack can be worth trying. David is right, there are some cases that need to communicate back and forth, slack communication will be more effective. But back

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

2022-05-07 Thread Jingsong Li
Hi Shengkai, thanks for your reply. > REST API is the user interface. The REST API transforms the request to the invocation of the SQLGatewayService that is the one doing the work. We split the Gateway into the SQLGatewayService and Endpoint(REST API) and its benefit is that all the Endpoints shar

Re: Log File of Flink Unit Test

2022-05-08 Thread Jingsong Li
You can try to modify resources/log4j2-test.properties. `rootLogger.level = OFF` => `rootLogger.level = INFO` Best, Jingsong On Sun, May 8, 2022 at 7:29 PM Prabhu Joseph wrote: > > Hi, I am trying to understand a Flink Unit Test case and so was checking > the logs of it on my local machine. But

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-05-08 Thread Jingsong Li
things that are not blockers but might worth noting: > > > 1. Running the verification requires docker installation. It happens > > that I > > > do not have that installed on my new laptop. > > > 2. In the quick start, after dropping the word_count table, the Flink job > > &g

Re: Re: [DISCUSS] FLIP-229: Introduces Join Hint for Flink SQL Batch Job

2022-05-08 Thread Jingsong Li
Thanks Xuyang for driving. zoucao also mentioned alias. Can you explain in the FLIP why alias is not supported? What are the difficulties and maybe we can try to overcome them. Or how do we need to report errors if we don't support it. Best, Jingsong On Mon, May 9, 2022 at 10:53 AM Xuyang wrot

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-05-08 Thread Jingsong Li
Mon, May 9, 2022 at 12:22 PM Jark Wu wrote: > > Thank Jingsong for the explanation. > > +1(binding) from my side. > > Best, > Jark > > On Mon, 9 May 2022 at 11:37, Jingsong Li wrote: > > > Hi Jark, > > > > > I have checked the LICENSE and NOTICE

[RESULT] [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-05-09 Thread Jingsong Li
Hi everyone, I am pleased to announce that we have unanimously approved this release candidate: There are 8 approving votes, 4 of which are binding: - Caizhi Weng (non-binding) - Konstantin Knauf (binding) - Jane Chan (non-binding) - Nicholas Jiang (non-binding) - Zheng Hu (non-binding) - Becket

Re: [DISCUSS] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-09 Thread Jingsong Li
ort schema evolution, which is a very useful feature for data > > storages, but also make it easier for table store to integrate with other > > systems. > > > > For example timestamp type in Hive does not support precision. With this > > extra schema information howev

Re: [DISCUSS] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-11 Thread Jingsong Li
Hi all, If there are no more comments, I'm going to start a vote. Best, Jingsong On Tue, May 10, 2022 at 10:37 AM Jingsong Li wrote: > Hi Jark, > > Thanks for your feedback. > > > 1) Does table-store support evolve schemas multiple times during a > checkpoint? > &

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-11 Thread Jingsong Li
>>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>>> > On Sat, May 7, 2022 at 12:22 PM Xintong Song < >>>&g

[VOTE] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-12 Thread Jingsong Li
Hi, everyone Thanks all for your attention to FLIP-226: Introduce Schema Evolution on Table Store [1] and participation in the discussion in the mail thread [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1] htt

Re: [DISCUSS] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-12 Thread Jingsong Li
the explanation. I don't have other concerns. > > Best, > Jark > > On Thu, 12 May 2022 at 09:53, Jingsong Li wrote: > > > Hi all, > > > > If there are no more comments, I'm going to start a vote. > > > > Best, > > Jingsong > > >

Re: [DISCUSS] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-05-13 Thread Jingsong Li
Thank Godfrey for driving. Looks very good~ This will undoubtedly greatly enhance the various batch mode connectors. I left some comments: ## FileBasedStatisticsReportableDecodingFormat One concern I have is that we read the footer for each file, and this may be a bit costly in some cases. Is i

Re: [DISCUSS] FLIP-232: Add Retry Support For Async I/O In DataStream API

2022-05-15 Thread Jingsong Li
Thank Lincoln for the proposal. ## Motivation: > asyncInvoke and callback functions are executed synchronously by the main thread, which is not suitable adding long time blocking operations, and introducing additional thread will bring extra complexity for users According to the documentation of

Re: [DISCUSS] FLIP-232: Add Retry Support For Async I/O In DataStream API

2022-05-15 Thread Jingsong Li
in runtime. > > > If I understand correctly, the retry queue will be put into ListState, > this > state is OperatorState? As far as I know, OperatorState does not have the > ability to store a lot of data. > So after we need to retry more data, we should need to block the main &

Re: [VOTE] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-16 Thread Jingsong Li
+1 (binding) Best, Jingsong On Mon, May 16, 2022 at 2:15 PM Jark Wu wrote: > +1 (binding) > > Best, > Jark > > On Mon, 16 May 2022 at 13:50, Jing Zhang wrote: > > > +1 > > Thanks @ Jingsong for driving this topic. > > > > Best, > > Ji

[RESULT][VOTE] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-16 Thread Jingsong Li
Hi dev, FLIP-226 [1] Has been accepted. There [2] were 3 binding votes in favor. None against. Votes are in the order of arrival: - Binding: Jing Zhang - Binding: Jark Wu - Binding: Jingsong Lee [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-226%3A+Introduce+Schema+Evolution+on+Table

Re: [DISCUSS] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-05-16 Thread Jingsong Li
> down program to collect the statistics. This could avoid collecting > statistics multiple times. > > > Best, > Godfrey > > Jingsong Li 于2022年5月13日周五 22:44写道: > > > > Thank Godfrey for driving. > > > > Looks very good~ This will undoubtedly greatly enha

Re: [VOTE] Creating an Apache Flink slack workspace

2022-05-17 Thread Jingsong Li
Thank Xintong for driving this work. +1 Best, Jingsong On Tue, May 17, 2022 at 4:49 PM Martijn Visser wrote: > +1 (binding) > > On Tue, 17 May 2022 at 10:38, Yu Li wrote: > > > +1 (binding) > > > > Thanks Xintong for driving this! > > > > Best Regards, > > Yu > > > > > > On Tue, 17 May 2022 a

Re: [VOTE] FLIP-229: Introduces Join Hint for Flink SQL Batch Job

2022-05-17 Thread Jingsong Li
+1 Thanks for driving. Best, Jingsong On Wed, May 18, 2022 at 1:33 PM godfrey he wrote: > Thanks Xuyang for driving this, +1(binding) > > Best, > Godfrey > > Xuyang 于2022年5月17日周二 10:21写道: > > > > Hi, everyone. > > Thanks for your feedback for FLIP-229: Introduces Join Hint for Flink > SQL Batc

Re: [VOTE] FLIP-91: Support SQL Gateway

2022-05-22 Thread Jingsong Li
+1 Best, Jingsong On Sat, May 21, 2022 at 12:23 AM Shqiprim Bunjaku wrote: > +1 (non-binding) > > Best, > Shqiprim Bunjaku > > On Fri, May 20, 2022 at 5:56 PM Yufei Zhang wrote: > > > +1 (non-binding) > > > > Best, > > Yufei Zhang > > > > On Fri, May 20, 2022 at 11:24 AM Paul Lam wrote: > > >

Re: flinksql关联hive维表java.lang.UnsupportedOperationException错误

2022-05-25 Thread Jingsong Li
如果flink-table-legacy包没用到,把它删掉即可修复你的问题 Best, Jingsong On Thu, May 26, 2022 at 2:16 PM hdxg1101300...@163.com < hdxg1101300...@163.com> wrote: > 你好: > 我在使用flink1.12.4版本和hive1.1.0版本时遇到下面的错误: > > > 场景时使用hive的catalog管理元数据,用flinksql把Kafka的数据注册成输入表,关联hive维表做数据拉宽;提交任务到yarn时遇到如下错误; >sql如下: >

Re: Performance benchmarking for flink.

2022-05-25 Thread Jingsong Li
You can take a look to https://github.com/nexmark/nexmark Best, Jingsong On Thu, May 26, 2022 at 2:04 PM Sriram Ganesh wrote: > Hi Everyone, > > I am looking for industry-standard performance benchmarking for flink for > both stateless and stateful data processing for streaming. > > I came acro

Re: Re: flinksql关联hive维表java.lang.UnsupportedOperationException错误

2022-05-25 Thread Jingsong Li
是我也没找到他在那,是一个独立的模块吗? > > -- > hdxg1101300...@163.com > > > *发件人:* Jingsong Li > *发送时间:* 2022-05-26 14:20 > *收件人:* dev > *主题:* Re: flinksql关联hive维表java.lang.UnsupportedOperationException错误 > 如果flink-table-legacy包没用到,把它删掉即可修复你的问题 > > Best, > Jingsong

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-05-26 Thread Jingsong Li
Thanks Qingsheng and all for your discussion. Very sorry to jump in so late. Maybe I missed something? My first impression when I saw the cache interface was, why don't we provide an interface similar to guava cache [1], on top of guava cache, caffeine also makes extensions for asynchronous calls

Re: [DISCUSS] FLIP-234: Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems

2022-05-26 Thread Jingsong Li
Thanks Lincoln for your proposal. Take a look at `strategy: fixed-delay delay: duration, e.g., 10s max-attempts: integer, e.g., 3`. Are these options only for async? It looks like normal lookups work too? One thing is: most of the lookup functions seem to be synchronous now? There are not so man

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-05-27 Thread Jingsong Li
27, 2022 at 11:10 AM Jingsong Li wrote: > Thanks Qingsheng and all for your discussion. > > Very sorry to jump in so late. > > Maybe I missed something? > My first impression when I saw the cache interface was, why don't we > provide an interface similar to guava cac

Re: [VOTE] FLIP-232: Add Retry Support For Async I/O In DataStream API

2022-05-30 Thread Jingsong Li
+1 (binding) Thanks for driving. Best, Jingsong On Tue, May 31, 2022 at 11:05 AM Gen Luo wrote: > +1 (non-binding) > > On Mon, May 30, 2022 at 3:50 PM Jark Wu wrote: > > > +1 (binding) > > > > Best, > > Jark > > > > On Mon, 30 May 2022 at 15:40, Lincoln Lee > wrote: > > > > > Dear Flink deve

Re: [DISCUSS] FLIP-232: Add Retry Support For Async I/O In DataStream API

2022-05-30 Thread Jingsong Li
ave a special > > > case > > > > > when > > > > > > > >> > > > recovering: if the remaining timeout is exhausted for > > the > > > > > > > >> > recalculation, > > > &

Re: [DISCUSS] FLIP-232: Add Retry Support For Async I/O In DataStream API

2022-05-30 Thread Jingsong Li
Lincoln Thanks! Looks very good. Best, Jingsong On Tue, May 31, 2022 at 12:09 PM Lincoln Lee wrote: > Thanks Jingsong for the reminder! There is indeed some cleanup work to be > done, I'll update the doc today. > > Best, > Lincoln Lee > > > Jingsong Li 于2022年5月31

Re: [DISCUSS] FLIP-234: Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems

2022-05-31 Thread Jingsong Li
; > > > Best, > > > Lincoln Lee > > > > > > > > > Jark Wu 于2022年5月27日周五 21:04写道: > > > > > > > Hi Lincoln, > > > > > > > > Delayed Dim Join is a frequently requested feature, it's exciting to > > se

Re: [DISCUSS] FLIP-223: Support HiveServer2 Endpoint

2022-06-01 Thread Jingsong Li
Hi Shengkai, Thanks for driving. I have a few comments: ## Unsupported features I've read the FLIP and it's not quite clear what the specific unsupported items are? - For example, security related, is it not supported. - For example, is there a loss of precision for types - For example, the Fet

Re: [DISCUSS] FLIP-234: Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems

2022-06-01 Thread Jingsong Li
FLIP[2]. > > WDYT? > > [1]: https://lists.apache.org/thread/v76g8v1o9sjdho9kbzlgjyv38l2oynox > [2]: > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-234%3A+Support+Retryable+Lookup+Join+To+Solve+Delayed+Updates+Issue+In+External+Systems?src=contextnavpagetreemode >

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-06-01 Thread Jingsong Li
artial caching will be used in this case, if I am > not > > > mistaken, which might have an impact on the block cache used by HBase, > > e.g. > > > LruBlockCache. > > > Another question is that, since HBase provides a sophisticated cache > > > solution, does

Re: [DISCUSS] suggest using granularityNumber in ColumnStats

2022-06-02 Thread Jingsong Li
Hi, +1 for NDV (number of distinct values) is a widely used terminology in table statistics. I've also seen the one called `distinctCount`. This name can be found in databases like oracle too. [1] So it is not good to change a completely different name. [1] https://docs.oracle.com/database/121

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

2022-06-02 Thread Jingsong Li
Thanks Xingtong, Jark, Martijn and Robert for making this possible! Best, Jingsong On Thu, Jun 2, 2022 at 5:32 PM Jark Wu wrote: > Thank Xingtong for making this possible! > > Cheers, > Jark Wu > > On Thu, 2 Jun 2022 at 15:31, Xintong Song wrote: > > > Hi everyone, > > > > I'm very happy to a

[DISCUSS] Api Since Version Annotation

2022-06-06 Thread Jingsong Li
Hi everyone, I'm a bit curious why we don't use the api since annotation. I found this annotation very useful when I am using other dependencies, it tells me very directly the version of the API and which API I used would break the compatibility of which version. For example, String in JDK. ```

Re: [DISCUSS] Releasing 1.15.1

2022-06-08 Thread Jingsong Li
+1 Thanks David for volunteering to manage the release. Best, Jingsong On Wed, Jun 8, 2022 at 6:21 PM Jark Wu wrote: > > Hi David, thank you for driving the release. > > +1 for the 1.15.1 release. The release-1.15 branch > already contains many bug fixes and some SQL > issues are quite critical

Re: [VOTE] FLIP-234: Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems

2022-06-08 Thread Jingsong Li
+1 (binding) Best, Jingsong On Tue, Jun 7, 2022 at 5:21 PM Jark Wu wrote: > > +1 (binding) > > Best, > Jark > > On Tue, 7 Jun 2022 at 12:17, Lincoln Lee wrote: > > > Dear Flink developers, > > > > Thanks for all your feedback for FLIP-234: Support Retryable Lookup Join To > > Solve Delayed Upda

Re: [VOTE] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-06-08 Thread Jingsong Li
+1 (binding) Best, Jingsong On Tue, Jun 7, 2022 at 5:20 PM Jark Wu wrote: > > +1 (binding) > > Best, > Jark > > On Tue, 7 Jun 2022 at 13:44, Jing Ge wrote: > > > Hi Godfrey, > > > > +1 (non-binding) > > > > Best regards, > > Jing > > > > > > On Tue, Jun 7, 2022 at 4:42 AM godfrey he wrote: > >

Re: [VOTE] FLIP-223: Support HiveServer2 Endpoint

2022-06-09 Thread Jingsong Li
+1 Thanks for driving. Best, Jingsong On Thu, Jun 9, 2022 at 2:17 PM Nicholas Jiang wrote: > > +1 (not-binding) > > Best, > Nicholas Jiang > > On 2022/06/07 05:31:21 Shengkai Fang wrote: > > Hi, everyone. > > > > Thanks for all feedback for FLIP-223: Support HiveServer2 Endpoint[1] on > > the d

Re: [DISCUSS] Deprecate Java 8 support

2021-11-22 Thread Jingsong Li
Hi Chesnay, Thanks for bringing this for discussion. We should dig deeper into the current Java version of Flink users. At least make sure Java 8 is not a mainstream version. Receiving this signal, the user may be unhappy because his application may be all on Java 8. Upgrading is a big job, afte

Re: [DISCUSS] FLIP-188: Introduce Built-in Dynamic Table Storage

2021-11-24 Thread Jingsong Li
Hi Stephan, Thanks for your reply. Data never expires automatically. If there is a need for data retention, the user can choose one of the following options: - In the SQL for querying the managed table, users filter the data by themselves - Define the time partition, and users can delete the exp

Re: [VOTE] FLIP-188 Introduce Built-in Dynamic Table Storage

2021-11-30 Thread Jingsong Li
of the discussion, also +1 from my side for this FLIP > > > > On Sat, Nov 13, 2021 at 12:23 PM Jingsong Li wrote: > > > >> Thanks Stephan and Timo, I have a rough look at your replies. They are > >> all valuable opinions. I will take time to discuss, explain and

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Jingsong Li
Amazing! Thanks Yingjie and all contributors for your great work. Best, Jingsong On Wed, Dec 1, 2021 at 10:52 AM Yun Tang wrote: > > Great news! > Thanks for all the guys who contributed in this project. > > Best > Yun Tang > > On 2021/11/30 16:30:52 Till Rohrmann wrote: > > Great news, Yingjie

Re: [ANNOUNCE] New Apache Flink Committer - Ingo Bürk

2021-12-02 Thread Jingsong Li
Congrats Ingo, well deserved! On Fri, Dec 3, 2021 at 10:10 AM Yangze Guo wrote: > > Congratulations, Ingo! > > Best, > Yangze Guo > > On Fri, Dec 3, 2021 at 3:35 AM Konstantin Knauf wrote: > > > > Congratulations, Ingo! > > > > On Thu, Dec 2, 2021 at 7:13 PM Johannes Moser wrote: > > > > > What

Re: Re: [ANNOUNCE] New Apache Flink Committer - Matthias Pohl

2021-12-02 Thread Jingsong Li
Congratulations, Matthias! On Fri, Dec 3, 2021 at 2:13 PM Yuepeng Pan wrote: > > Congratulations Matthias! > > Best,Yuepeng Pan. > 在 2021-12-03 13:47:20,"Yun Gao" 写道: > >Congratulations Matthias! > > > >Best, > >Yun > > > > > >-- >

Re: [VOTE] FLIP-188 Introduce Built-in Dynamic Table Storage

2021-12-02 Thread Jingsong Li
. > > > > Best, > > Jark > > > > On Tue, 30 Nov 2021 at 17:27, Kurt Young wrote: > > > > > +1 from my side. > > > > > > Best, > > > Kurt > > > > > > > > > On Tue, Nov 30, 2021 at 5:12 PM Jingsong Li &g

Re: [DISCUSS] Releasing Flink 1.14.1

2021-12-07 Thread Jingsong Li
Hi Martijn, We just created a cherry-pick pull-request for https://issues.apache.org/jira/browse/FLINK-20370 We could finish it as soon as possible. Best, Jingsong On Fri, Dec 3, 2021 at 10:25 PM Fabian Paul wrote: > > I just opened a PR for > https://issues.apache.org/jira/browse/FLINK-25126 I

<    1   2   3   4   5   6   7   >