Re: [DISCUSS] Releasing Flink 1.6.4

2019-02-13 Thread jing
+1 -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Re: [jira] [Created] (FLINK-13987) add new logs api, see more log files and can see logs by pages

2019-09-06 Thread lining jing
Hi folks, I have updated the description, this is the new : As the job running, the log files are becoming large. Current log api often blocks or don't work. It's unfriendly for user. As application runs on jvm, sometime user need see log of gc. Above all, i list new api: - list taskmanage

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-24 Thread Jing Ge
Congrats! Leonard! Best regards, Jing On Mon, Apr 24, 2023 at 5:53 AM Matthias Pohl wrote: > Congrats, Leonard :) > > On Mon, Apr 24, 2023, 05:17 Yangze Guo wrote: > > > Congratulations, Leonard! > > > > Best, > > Yangze Guo > > > > On

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-24 Thread Jing Ge
Congrats! Qingsheng! Best regards, Jing On Mon, Apr 24, 2023 at 9:35 AM Zakelly Lan wrote: > Congratulations, Qingsheng! > > Best regards, > Zakelly > > On Mon, Apr 24, 2023 at 11:52 AM Matthias Pohl > wrote: > > > > Congratulations, Qingsheng! :) > >

Re: [DISCUSS FLINKSQL PARALLELISM]

2023-04-24 Thread Jing Ge
process for Flink SQL job fine-grained tuning. Best regards, Jing On Wed, Apr 19, 2023 at 8:44 AM Yun Tang wrote: > I noticed that Yuxia had replied that "sink.paralleilsm" could help in > some cases. > > I think a better way is to integrate it with streamGraph or exte

Re: Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-24 Thread Jing Ge
Hi Mang, Thanks for clarifying it. I am trying to understand your thoughts. Do you actually mean the boundedness[1] instead of the execution modes[2]? I.e. the atomic CTAS will be only supported for bounded data. Best regards, Jing [1] https://flink.apache.org/what-is-flink/flink

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

2023-04-24 Thread Jing Ge
Thanks Chesnay for working on this. Would you like to share more info about the JDK bug? Best regards, Jing On Mon, Apr 24, 2023 at 11:39 AM Chesnay Schepler wrote: > As it turns out Kryo isn't a blocker; we ran into a JDK bug. > > On 31/03/2023 08:57, Chesnay Schepler wrot

Re: [SUMMARY] Flink 1.18 Release Sync 04/18/2023

2023-04-24 Thread Jing Ge
Hi Qingsheng, Thanks for sharing the summary! Best regards, Jing On Mon, Apr 24, 2023 at 1:50 PM Qingsheng Ren wrote: > Hi devs, > > I'd like to share some highlights in the 1.18 release sync on 04/18/2023 > (Sorry for the late summary!): > > - Feature list: @contr

Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-24 Thread Jing Ge
+1(binding) Best regards, Jing On Tue, Apr 25, 2023 at 5:17 AM Rui Fan <1996fan...@gmail.com> wrote: > +1 (binding) > > Best, > Rui Fan > > On Tue, Apr 25, 2023 at 10:06 AM Biao Geng wrote: > > > +1 (non-binding) > > Best, > > Biao Geng

Re: [DISCUSS] Planning Flink 2.0

2023-04-25 Thread Jing Ge
to bring Flink to the next level. +1 for your proposal. Best regards, Jing On Tue, Apr 25, 2023 at 3:55 PM Chesnay Schepler wrote: > This is definitely a good discussion so have. > > Some thoughts: > > One aspect that wasn't mentioned is what this release means going

Re: [DISCUSS] Preventing Mockito usage for the new code with Checkstyle

2023-04-25 Thread Jing Ge
This is a great idea, thanks for bringing this up. +1 Also +1 for Junit4. If I am not mistaken, it could only be done after the Junit5 migration is done. @Chesnay thanks for the hint. Do we have any doc about it? If not, it might deserve one. WDYT? Best regards, Jing On Wed, Apr 26, 2023 at 5

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-27 Thread Jing Ge
catalog has been removed from the CatalogStore by another instance. Did I miss something? Best regards, Jing On Thu, Apr 13, 2023 at 4:40 PM Feng Jin wrote: > Hi Jing,Shammon > Thanks for your reply. > > @Jing > > > How about persistCatalog()? > I think this is a good funct

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

2023-04-27 Thread Jing Ge
? Best regards, Jing On Thu, Apr 27, 2023 at 8:18 AM Tamir Sagi wrote: > More details about the JDK bug here > https://bugs.openjdk.org/browse/JDK-8277529 > > Related Jira ticket > https://issues.apache.org/jira/browse/FLINK-24998 > > -- > *From:* J

Re: [DISCUSS] Planning Flink 2.0

2023-04-28 Thread Jing Ge
deprecated APIs and even modules, upgrade APIs without thinking more about backwards compatibilities, etc. This is kind of a buy-one-get-one benefit. In order to "get-one"(History), we should, first of all, "buy-one"(Future). Best regards, Jing On Fri, Apr 28, 2023 at 9:57 AM

Re: Re: Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-28 Thread Jing Ge
streaming and batch mode) and let unbounded data use the non-atomic CTAS? In this way, we could avoid the selector argument code smell. Best regards, Jing On Tue, Apr 25, 2023 at 10:04 AM Mang Zhang wrote: > Hi Jing, > Yes, the atomic CTAS will be only supported for bounded data, but the >

Re: [DISCUSS] EncodingFormat and DecondingFormat provide copy API

2023-04-28 Thread Jing Ge
Hi Tanjialiang, Like we discussed in another thread, please feel free to create a FLIP and start further discussion. In case you need any access right to the wiki page, please let me know, thanks. Best regards, Jing On Sun, Apr 23, 2023 at 4:23 AM tanjialiang wrote: > Hi, devs. > Do

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-30 Thread Jing Ge
aken, with the current FLIP design, CatalogManager could work without Optional CatalogStore being configured. That is the reason why I mentioned in the last email that the example code wrt the Optional CatalogStore is not correct. Best regards, Jing On Thu, Apr 27, 2023 at 3:55 PM Feng Jin wrote:

Re: [DISCUSS] Preventing Mockito usage for the new code with Checkstyle

2023-04-30 Thread Jing Ge
been migrated to junit5. Best regards, Jing On Wed, Apr 26, 2023 at 9:02 AM Panagiotis Garefalakis wrote: > Thanks for bringing this up! +1 for the proposal > > @Jing Ge -- we don't necessarily need to completely migrate to Junit5 (even > though it would be ideal). > We

Re: [DISCUSS] Preventing Mockito usage for the new code with Checkstyle

2023-05-02 Thread Jing Ge
Hi Panagiotis, afaiu, those modules left are big and complex modules that still need a lot of effort to migrate to junit5. Overall, agree with you to enable suppressions. Best regards, Jing On Mon, May 1, 2023 at 7:57 AM Panagiotis Garefalakis wrote: > Hey Jing, > > That's basi

[SUMMARY] Flink 1.18 Release Sync 05/02/2023

2023-05-02 Thread Jing Ge
-stability' label and still have no assignee. Some of them are old. We will focus on issues that have updates in the past 30 days. Best regards, Qingsheng, Sergey, Konstantin, and Jing [1] https://cwiki.apache.org/confluence/display/FLINK/1.18+Release [2] https://issues.apache.org/jira/browse

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-06 Thread Jing Ge
Hi Feng, Thanks for improving the FLIP. It looks good to me. We could still reconsider in the future how to provide more common built-in cache functionality in CatalogManager so that not every CatalogSotre implementation has to take care of it. Best regards, Jing On Thu, May 4, 2023 at 1:47 PM

Re: [VOTE] Release flink-connector-rabbitmq v3.0.1, release candidate #1

2023-05-06 Thread Jing Ge
+1 - built the source - verified signature - verified hash - contains no compiled binaries - checked tag - web PR looks good Best regards, Jing On Fri, May 5, 2023 at 9:14 AM Khanh Vu wrote: > Sorry, the above report is supposed for flink-connector-gpc-pubsub-3.

Re: flink documents Korean translation suggestions

2023-05-07 Thread Jing Ge
and keep contributing translated (old and new) content. Best regards, Jing On Sat, May 6, 2023 at 10:34 AM Tan Kim wrote: > Hello, I'm Kim Tan, a software engineer from South Korea. > I would like to contribute to the translation of flink documents into > Korean, but it seems tha

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Jing Ge
Hi Zakelly, I saw you sent at least 4 same emails for voting FLIP-306. I guess this one should be the last one and the right one for us to vote right? BTW, based on the sending time, 72 hours means to open the discussion until May 12th. Best regards, Jing On Tue, May 9, 2023 at 8:24 PM Zakelly

Re: [NOTICE] Flink master branch now uses Maven 3.8.6

2023-05-13 Thread Jing Ge
Great news! We can finally get rid of additional setup to use maven 3.8. Thanks @Chesnay for your effort! Best regards, Jing On Sat, May 13, 2023 at 5:12 AM David Anderson wrote: > Chesnay, thank you for all your hard work on this! > > David > > On Fri, May 12, 2023 at 4:03 PM C

Re: [DISCUSS] Release Flink 1.17.1

2023-05-15 Thread Jing Ge
+1 for releasing 1.17.1 Best Regards, Jing On Thu, May 11, 2023 at 10:03 AM Martijn Visser wrote: > +1, thanks for volunteering! > > On Thu, May 11, 2023 at 9:23 AM Xintong Song > wrote: > > > +1 > > > > I'll help with the steps that require PMC pri

Re: [DISCUSS] FLIP-229: Prometheus Sink Connector

2023-05-18 Thread Jing Ge
es it make sense to build the Prometheus Source too? Short-term stored metrics could be consumed by the Prometheus Source and, depending on requirements, might perform some processing like aggregation. Best regards, Jing On Wed, May 17, 2023 at 6:13 PM Danny Cranmer wrote: > Thanks for the FLIP

Re: [DISCUSS] Release Flink 1.17.1

2023-05-18 Thread Jing Ge
Hi Weijie, just wondering how the process is going. Will the RC1 be released today? Thanks for driving this! Best regards, Jing On Wed, May 17, 2023 at 5:02 AM weijie guo wrote: > Hi Kevin, > > If everything goes smoothly, I will release the RC1 version of 1.17.1 this > Thursd

Re: Call for help on the Web UI (In-Place Rescaling)

2023-05-19 Thread Jing Ge
task, please count it in while designing the new UX/UI. Thanks! Best regards, Jing On Fri, May 19, 2023 at 1:07 PM Kartoglu, Emre wrote: > Hi David, > > This looks awesome. I am no expert on UI/UX, but still have opinions 😊 > > I normally use the Overview tab for monitoring Fl

Re: [DISCUSS] Release Flink 1.17.1

2023-05-19 Thread Jing Ge
Hi Weijie, Thanks for your effort and sharing the status! Best regards, Jing On Fri, May 19, 2023 at 11:50 AM weijie guo wrote: > Hi Jing, > > Thank you for your attention! > > I have cut off the code for release-1.17.1-rc1 and started deploying it to > the apache repositor

Re: [VOTE] Release 1.16.2, release candidate #1

2023-05-20 Thread Jing Ge
+1(non-binding) - reviewed Jira release notes - built from source - apache repos contain all necessary files - verified signatures - verified hashes - verified tag - reviewed PR Best regards, Jing On Sat, May 20, 2023 at 11:51 AM Yun Tang wrote: > +1 (non-binding) > > >

Re: Maven plugin to detect issues early on

2023-05-21 Thread Jing Ge
we could understand how the plugin will help us. Afaik, FLIP is recommended for improvement ideas that will change public APIs. I am not sure if a new maven plugin belongs to it. Best regards, Jing On Tue, May 16, 2023 at 11:29 AM Kartoglu, Emre wrote: > Hello all, > > Myself and 2 c

Re: [VOTE] Release 1.17.1, release candidate #1

2023-05-22 Thread Jing Ge
+1(non-binding) - Verified signatures - Verified hashes - Verified tag - repos contain all necessary files - built from source - reviewed the PR Best regards, Jing On Mon, May 22, 2023 at 1:32 PM Yun Tang wrote: > +1 (non-binding) > > > * Verified signatures. > *

Re: Maven plugin to detect issues early on

2023-05-22 Thread Jing Ge
. Best regards, Jing On Mon, May 22, 2023 at 11:24 AM Kartoglu, Emre wrote: > Hi Jing, > > The proposed plugin would be used by Flink application developers, when > they are writing their Flink job. It would trigger during > compilation/packaging and would look for known incompa

Re: Maven plugin to detect issues early on

2023-05-22 Thread Jing Ge
cc user ML to get more attention, since the plugin will be used by Flink application developers. Best regards, Jing On Mon, May 22, 2023 at 3:32 PM Jing Ge wrote: > Hi Emre, > > Thanks for clarifying it. Afaiac, it is a quite interesting proposal, > especially for Flink job develo

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-05-23 Thread Jing Ge
s out to be unexpected results in real business scenarios. Best regards, Jing [1] https://github.com/apache/flink/blob/fadde2a378aac4293676944dd513291919a481e3/flink-core/src/main/java/org/apache/flink/api/connector/source/Source.java#L41 On Tue, May 23, 2023 at 5:53 PM Dong Lin wrote: >

Re: [RESULT][VOTE] Release 1.16.2, release candidate #1

2023-05-24 Thread Jing Ge
Thanks Weijie for your effort! Looking forward to it! Best regards, Jing On Wed, May 24, 2023 at 11:08 AM weijie guo wrote: > I'm happy to announce that we have unanimously approved this release. > > > > There are 8 approving votes, 3 of which are binding: > > &g

Re: Zero-Downtime Deployments with Flink Operator

2023-05-24 Thread Jing Ge
r any different thoughts that could help me know what I didn't know. Best regards, Jing [1] https://www.ververica.com/blog/generic-log-based-incremental-checkpoint On Wed, May 24, 2023 at 7:39 PM Gyula Fóra wrote: > Hey Kevin! > > I am not aware of anyone currently working on thi

Re: [RESULT] [VOTE] Release 1.17.1, release candidate #1

2023-05-25 Thread Jing Ge
Hi Weijie, Thanks again for driving it. I was wondering if you are able to share the estimated date when the 1.16.2 and 1.17.1 releases will be officially announced after the voting is closed? Thanks! Best regards, Jing On Thu, May 25, 2023 at 9:46 AM weijie guo wrote: > I'm happy to

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-05-25 Thread Jing Ge
this case, let's turn off the dynamic adjustment, reduce the checkpoint frequency, have better throughput, and save unnecessary source consumption. Did I miss anything here? Best regards, Jing [1] https://github.com/apache/flink/blob/6b6df3db466d6a030d5a38ec786ac3297cb41c38/flink-connectors/

Re: [RESULT] [VOTE] Release 1.17.1, release candidate #1

2023-05-25 Thread Jing Ge
Hi Weijie, Thank you so much for sharing it! Best regards, Jing On Fri, May 26, 2023 at 8:00 AM weijie guo wrote: > Hi Jing, > > The release process for 1.16.2 and 1.17.1 is nearing its end, but I am > waiting for Docker Hub to approval the update of manifest and publish the &g

Re: [ANNOUNCE] Apache Flink 1.17.1 released

2023-05-26 Thread Jing Ge
Hi Weijie, That is earlier than I expected! Thank you so much for your effort! Best regards, Jing On Fri, May 26, 2023 at 4:44 PM Martijn Visser wrote: > Same here as with Flink 1.16.2, thank you Weijie and those who helped with > testing! > > On Fri, May 26, 2023 at 1:08 P

Re: [ANNOUNCE] Apache Flink 1.16.2 released

2023-05-26 Thread Jing Ge
Hi Weijie, Thanks again for your effort. I was wondering if there were any obstacles you had to overcome while releasing 1.16.2 and 1.17.1 that could lead us to any improvement wrt the release process and management? Best regards, Jing On Fri, May 26, 2023 at 4:41 PM Martijn Visser wrote

Re: Questions on checkpointing mechanism for FLIP-27 Source API

2023-05-26 Thread Jing Ge
poch after the checkpoint in this case. Best regards, Jing [1] https://github.com/apache/flink/blob/678370b18e1b6c4a23e5ce08f8efd05675a0cc17/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/SourceOperator.java#L284 [2] https://github.com/apache/

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-26 Thread Jing Ge
]? Thanks! [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals Best regards, Jing On Wed, May 24, 2023 at 1:07 PM Aitozi wrote: > May I ask for some feedback :D > > Thanks, > Aitozi > > Aitozi 于2023年5月23日周二 19:14写道: > > > > Just catch an

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-28 Thread Jing Ge
st regards, Jing [1] https://github.com/apache/flink/blob/678370b18e1b6c4a23e5ce08f8efd05675a0cc17/flink-table/flink-table-common/src/main/java/org/apache/flink/table/connector/source/LookupTableSource.java#L64 [2] https://github.com/apache/flink/blob/678370b18e1b6c4a23e5ce08f8efd05675a0cc17/flink-t

Re: [VOTE] Release flink-connector-jdbc v3.1.1, release candidate #1

2023-05-28 Thread Jing Ge
+1 (non-binding) - checked sign - checked hash - checked repos - checked tag - compiled from source - check the web PR Best regards, Jing On Sun, May 28, 2023 at 4:00 PM Benchao Li wrote: > Thanks Martijn, > > - checked signature/checksum [OK] > - downloaded src, compiled fro

Re: Kryo Upgrade: Request FLIP page create access

2023-05-28 Thread Jing Ge
Hi Qingsheng, Could you grant Kurt rights for creating a new FLIP page? Thanks! @Kurt Thanks for reaching out. Please pay attention to the FLIP number you will pick up and keep "Next FLIP number" on [1] up to date. Thanks! Best regards, Jing [1] https://cwiki.apache.org/confluen

Re: [ANNOUNCE] Apache Flink 1.16.2 released

2023-05-29 Thread Jing Ge
regards, Jing On Mon, May 29, 2023 at 6:27 AM weijie guo wrote: > Hi Jing, > > Thank you for caring about the releasing process. It has to be said that > the entire process went smoothly. We have very comprehensive > documentation[1] to guide my work, thanks to the contribut

Re: Kryo Upgrade: Request FLIP page create access

2023-05-29 Thread Jing Ge
Thanks Qingsheng for taking care of this! Best regards, Jing On Mon, May 29, 2023 at 4:24 AM Qingsheng Ren wrote: > Hi Kurt, > > The permission has been granted. Feel free to reach out if you have any > questions. > > Looking forward to your FLIP! > > Best, > Qingshe

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-29 Thread Jing Ge
for further improvement. Best regards, Jing On Mon, May 29, 2023 at 5:31 AM Feng Jin wrote: > Hi all, I would like to update you on the latest progress of the FLIP. > > > Last week, Leonard Xu, HangRuan, Jing Ge, Shammon FY, ShengKai Fang and I > had an offline discussion regard

Re: [SUMMARY] Flink 1.18 Release Sync 05/30/2023

2023-05-30 Thread Jing Ge
major to tasks related to those connectors. Best regards, Jing On Tue, May 30, 2023 at 11:48 AM Qingsheng Ren wrote: > Hi devs and users, > > I'd like to share some highlights from the release sync of 1.18 on May 30. > > 1. @developers please update the progress of your feat

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-05-30 Thread Jing Ge
he one and only one mechanism, I think, we should reconsider it again and carefully :-) Best regards, Jing On Mon, May 29, 2023 at 5:23 PM Piotr Nowojski wrote: > Hi > > @Jing > > > Your proposal to dynamically adjust the checkpoint intervals is elegant! > It > > make

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-31 Thread Jing Ge
extension like timestamp range, etc. I haven't read all the source code yet and I'm not sure if it is possible. But a design like this will keep the Catalog API lean and the API/DSL will be self described and easier to use. Best regards, Jing On Wed, May 31, 2023 at 12:08 PM Krzysztof C

Re: [VOTE] Release flink-connector-pulsar 3.0.1, release candidate #1

2023-05-31 Thread Jing Ge
+1(non-binding) - verified sign - verified hash - checked repos - checked tag. NIT: the tag link should be: https://github.com/apache/flink-connector-pulsar/releases/tag/v3.0.1-rc1 - reviewed PR. NIT: left a comment. Best regards, Jing On Wed, May 31, 2023 at 11:16 PM Neng Lu wrote: >

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-01 Thread Jing Ge
us understand the motivation. After all, lateral join and temporal lookup join[1] are quite different. Best regards, Jing [1] https://github.com/apache/flink/blob/d90a72da2fd601ca4e2a46700e91ec5b348de2ad/flink-table/flink-table-common/src/main/java/org/apache/flink/table/functions

Re: [DISCUSS] Update Flink Roadmap

2023-06-01 Thread Jing Ge
Hi Jark, Thanks for driving it! For point 2, since we are developing 1.18 now, does it make sense to update the roadmap this time while we are releasing 1.18? This discussion thread will be focusing on the Flink 2.0 roadmap, as you mentioned previously. WDYT? Best regards, Jing On Thu, Jun 1

Re: [DISCUSS] Update Flink Roadmap

2023-06-01 Thread Jing Ge
Hi Jark, Fair enough. Let's do it like you suggested. Thanks! Best regards, Jing On Thu, Jun 1, 2023 at 6:00 PM Jark Wu wrote: > Hi Jing, > > This thread is for discussing the roadmap for versions 1.18, 2.0, and even > more. > One of the outcomes of this discussion will b

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-02 Thread Jing Ge
limited information to understand the motivation. Best regards, Jing On Fri, Jun 2, 2023 at 3:48 AM Aitozi wrote: > Hi Jing, > I have updated the proposed changes to the FLIP. IMO, lookup has its > clear > async call requirement is due to its IO heavy operator. In our usage, sql

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-02 Thread Jing Ge
views. Just out of curiosity, speaking of JDBC mode, according to the FLIP, it should be doable to directly use the jdbc connector with Redshift, if I am not mistaken. Will the Redshift connector provide additional features beyond the mediator/wrapper of the jdbc connector? Best regards, Jing On Thu

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-05 Thread Jing Ge
Hi Samrat, Thanks for the feedback. I would suggest adding that information into the FLIP. +1 Looking forward to your PR :-) Best regards, Jing On Sat, Jun 3, 2023 at 9:19 PM Samrat Deb wrote: > Hi Jing Ge, > > >>> Do you already have any prototype? I'd like to

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-06-05 Thread Jing Ge
, CatalogModificationContext) ? 2. Since onEvent(CatalogModificationEvent) could be used, do we really need CatalogModificationContext? API design example as reference: [1] Best regards, Jing [1] http://www.java2s.com/example/java-src/pkg/java/awt/event/actionlistener-add27.html On Tue, Jun 6, 2023 at 7:43 AM

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-06-06 Thread Jing Ge
Hi Shammon, Thanks for the clarification. Just out of curiosity, if the context is not part of the event, why should it be the input parameter of each onEvent call? Best regards, Jing On Tue, Jun 6, 2023 at 11:58 AM Leonard Xu wrote: > Thanks Shammon for the timely update, the updated F

Re: [DISCUSS] FLIP-246: Multi Cluster Kafka Source

2023-06-06 Thread Jing Ge
ut it previously, would you like to create an extra section in your FLIP to explicitly describe scenarios when exactly-one is supported and when it is not? Best regards, Jing On Mon, Jun 5, 2023 at 11:41 PM Mason Chen wrote: > Hi all, > > I'm working on FLIP-246 again, for the Multi C

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread Jing Ge
community tries to limit (i.e. get rid of) scala code as much as possible. I was wondering if it is possible for you to implement the FLIP with scala free code? Best regards, Jing [1] https://flink.apache.org/2022/02/22/scala-free-in-one-fifteen/ On Wed, Jun 7, 2023 at 5:33 PM Aitozi wrote

Re: [VOTE] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread Jing Ge
+1 Best Regards, Jing On Wed, Jun 7, 2023 at 10:52 AM weijie guo wrote: > +1 (binding) > > Best regards, > > Weijie > > > Jingsong Li 于2023年6月7日周三 15:59写道: > > > +1 > > > > On Wed, Jun 7, 2023 at 3:03 PM Benchao Li wrote: > > > >

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-06-08 Thread Jing Ge
adding the CatalogModificationContext into the Event and make the onEvent() method cleaner with only one input parameter CatalogModificationEvent, because the interface CatalogModificationListener is the most often used interface for users. Just my two cents. Best regards, Jing [1] http

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-08 Thread Jing Ge
discussion. I will start a new thread to address it. Best regards, Jing On Thu, Jun 8, 2023 at 5:20 AM liu ron wrote: > Hi, Ging > > Thanks for your valuable input about scala free. > > Firstly, reply to your question, using java to implement codegen is > possible, but we need to

Call for Presentations: Flink Forward Seattle 2023

2023-06-08 Thread Jing Ge
ward to receiving your submission and welcoming you as a speaker at the Flink Forward Conference. Thank you for your time and consideration. Best regards, -- Jing Ge | Head of Engineering j...@ververica.com <https://www.ververica.com/> Follow us @VervericaData -- Join Flink Forw

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-08 Thread Jing Ge
I am wrong. Best regards, Jing On Thu, Jun 8, 2023 at 7:22 AM Aitozi wrote: > Hi Mason, > Thanks for your input. I think if we support the user defined async > table function, > user will be able to use it to hold a batch data then handle it at one time > in the

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-09 Thread Jing Ge
/191ec6ca3943d7119f14837efe112e074d815c47/flink-table/flink-table-common/src/main/java/org/apache/flink/table/functions/TableFunction.java#L196 Best regards, Jing On Fri, Jun 9, 2023 at 5:18 AM Aitozi wrote: > Hi Jing > Thanks for your good questions. I have updated the example to the FLIP. > > > O

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-09 Thread Jing Ge
Hi Aitozi, The keyRow used in this case contains all keys[1]. Best regards, Jing [1] https://github.com/apache/flink/blob/191ec6ca3943d7119f14837efe112e074d815c47/flink-table/flink-table-common/src/main/java/org/apache/flink/table/functions/LookupFunction.java#L49 On Fri, Jun 9, 2023 at 3

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-09 Thread Jing Ge
Hi Samrat, The FLIP looks good, thanks! Best regards, Jing On Tue, Jun 6, 2023 at 8:16 PM Samrat Deb wrote: > Hi Jing, > > > I would suggest adding that information into the > FLIP. > > Updated now, please review the new version of flip whenever time. > > >

Re: [VOTE] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-12 Thread Jing Ge
+1(binding) Thanks! Best regards, Jing On Mon, Jun 12, 2023 at 12:01 PM yuxia wrote: > +1 (binding) > Thanks Mang driving it. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "zhangmang1" > 收件人: "dev" > 发送时间: 星期一, 2023年 6 月 12日 下午 5:31:1

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Jing Ge
ing issue for this FLIP. Best regards, Jing On Sat, Jun 10, 2023 at 4:11 AM Aitozi wrote: > Hi Jing, > I means the join key is not necessary to be the primary key or unique > index of the database. > In this situation, we may queried out multi rows for one join key. I t

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Jing Ge
Hi Aitozi, Thanks for taking care of that part. I have no other concern. Best regards, Jing On Mon, Jun 12, 2023 at 5:38 PM Aitozi wrote: > BTW, If there are no other more blocking issue / comments, I would like to > start a VOTE in another thread this wednesday 6.14 > > Than

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-13 Thread Jing Ge
to the old implementation. Both options have their own pros and cons. Best regards, Jing [1] https://lists.apache.org/thread/m3o48c2d8j9g5t9s89hqs6qvr924s71o On Mon, Jun 12, 2023 at 6:31 PM Stefan Richter wrote: > Hi, > > Thanks a lot for bringing up this topic and for the initial pro

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-13 Thread Jing Ge
ion of these annotations' design concept. i.e especially cleaning up for @PublicEvolving APIs since they are customer-facing. Regular cleaning up with all other @Experimental and @Internal APIs would be even better, if there might be some APIs marked as @deprecated. Best regards, Jing On Tue,

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-13 Thread Jing Ge
/functions centrally and out-of-the-box, i.e. DRY. Is that correct? Best regards, Jing On Thu, Jun 8, 2023 at 10:32 AM Jark Wu wrote: > Thank you for the proposal, yuxia! The FLIP looks good to me. > > Best, > Jark > > > 2023年6月8日 11:39,yuxia 写道: > > > > Hi,

Re: Re: [VOTE] FLIP-311: Support Call Stored Procedure

2023-06-13 Thread Jing Ge
+1(binding) Best Regards, Jing On Tue, Jun 13, 2023 at 9:03 AM Mang Zhang wrote: > +1 (no-binding) > > > > > -- > > Best regards, > Mang Zhang > > > > > > 在 2023-06-13 13:19:31,"Lincoln Lee" 写道: > >+1 (binding) > > &g

Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener

2023-06-14 Thread Jing Ge
+1 (binding) Best Regards, Jing On Wed, Jun 14, 2023 at 4:07 PM Benchao Li wrote: > +1 (binding) > > Shammon FY 于2023年6月14日周三 19:52写道: > > > Hi all: > > > > Thanks for all the feedback for FLIP-294: Support Customized Catalog > > Modification Listener [1].

Re: [VOTE] FLIP-295: Support lazy initialization of catalogs and persistence of catalog configurations

2023-06-14 Thread Jing Ge
+1 (binding) Best Regards, Jing On Wed, Jun 14, 2023 at 3:28 PM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui Fan > > On Wed, Jun 14, 2023 at 16:24 Hang Ruan wrote: > > > +1 (non-binding) > > > > Thanks for Feng driving it. >

Re: [VOTE] FLIP-246: Dynamic Kafka Source (originally Multi Cluster Kafka Source)

2023-06-16 Thread Jing Ge
+1 (binding) Best regards, Jing On Thu, Jun 15, 2023 at 7:55 PM Mason Chen wrote: > Hi all, > > Thank you to everyone for the feedback on FLIP-246 [1]. Based on the > discussion thread [2], we have come to a consensus on the design and are > ready to take a vote to contribut

Re: [VOTE] FLIP-287: Extend Sink#InitContext to expose TypeSerializer, ObjectReuse and JobID

2023-06-16 Thread Jing Ge
+1(binding) Best Regards, Jing On Fri, Jun 16, 2023 at 10:10 AM Lijie Wang wrote: > +1 (binding) > > Thanks for driving it, Joao. > > Best, > Lijie > > Joao Boto 于2023年6月16日周五 15:53写道: > > > Hi all, > > > > Thank you to everyone for the feedbac

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-17 Thread Jing Ge
bility. If the migration period described in this FLIP is only the minimum time, I think we still have the house cleaning issue unsolved. Minimum means deprecated APIs can not be removed before the migration period expires. The issue I was aware of is when/how to remove APIs after the mi

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-17 Thread Jing Ge
s will be defined in @Retired to support the deprecation process management. Further extension is possible, since the annotation is built by us. Best regards, Jing On Fri, Jun 16, 2023 at 10:31 AM Becket Qin wrote: > Hi Xintong, > > Thanks for the explanation. Please see the replies

Re: [NOTICE] Experimental Java 17 support now available on master

2023-06-18 Thread Jing Ge
is no vote thread of FLIP 317 on ML. Would you like to follow the standard process[2] defined by the Flink community? Thanks! Best regards, Jing [1] https://github.com/apache/flink/pull/22660 [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals On Sun, Jun 18, 2023

Re: [VOTE] FLIP-308: Support Time Travel

2023-06-19 Thread Jing Ge
+1(binding) On Mon, Jun 19, 2023 at 1:57 PM Benchao Li wrote: > +1 (binding) > > Lincoln Lee 于2023年6月19日周一 19:40写道: > > > +1 (binding) > > > > Best, > > Lincoln Lee > > > > > > yuxia 于2023年6月19日周一 19:30写道: > > > > > +1 (binding) > > > Thanks Feng driving it. > > > > > > Best regards, > > > Yux

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-19 Thread Jing Ge
Thanks for your reply. Nice feature! Best regards, Jing On Wed, Jun 14, 2023 at 3:11 AM yuxia wrote: > Yes, you're right. > > Best regards, > Yuxia > > ----- 原始邮件 - > 发件人: "Jing Ge" > 收件人: "dev" > 发送时间: 星期三, 2023年 6 月 14日 上午 4:46:

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-19 Thread Jing Ge
lter-ratio less than 0.99 will always allow injecting the runtime filter. Does it make sense to reconsider the formula of ratio calculation to help users easily control the filter injection? Best regards, Jing On Mon, Jun 19, 2023 at 4:42 PM Lijie Wang wrote: > Hi Stefan, > > >> b

[DISCUSS] Graduate the FileSink to @PublicEvolving

2023-06-20 Thread Jing Ge
a graduation discussion too. To keep this discussion lean and efficient, let's focus on FlieSink in this thread. There will be another discussion thread for the FileSource. I was wondering if anyone might have any concerns. Looking forward to hearing from you. Best regards, Jing [1]

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-20 Thread Jing Ge
5, it will be mapped to e.g. 0.95 (or e.g. 0.85, the real number needs more calculation) for the current formula described in the FLIP. But I am not sure it is a feasible solution. It deserves more discussion. Maybe some real performance tests could give us some hints. Best regards, Jing On Tue, J

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-20 Thread Jing Ge
nt opinions that will help me understand the issue better. Thanks! Best regards, Jing On Tue, Jun 20, 2023 at 4:50 PM Stefan Richter wrote: > Hi Xintong, > > Thanks for the summary, most of the points that you agreed upon also make > sense to me. > > > 2. Dropping d

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-21 Thread Jing Ge
Hi Ron, Thanks for sharing your thoughts! It makes sense. It would be helpful if these references of Hive, Polardb, etc. could be added into the FLIP. Best regards, Jing On Tue, Jun 20, 2023 at 5:41 PM liu ron wrote: > Hi, Jing > > The default value for this ratio is a reference

Re: [DISCUSS] Graduate the FileSink to @PublicEvolving

2023-06-22 Thread Jing Ge
, I'd like to have more opinions. All opinions together will help the community build a mature API graduation process. Best regards, Jing On Tue, Jun 20, 2023 at 12:48 PM Galen Warren wrote: > Is this issue still unresolved? > > https://issues.apache.org/jira/plugins/servlet/mobi

Re: [VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-23 Thread Jing Ge
+1(binding) Best Regards, Jing On Fri, Jun 23, 2023 at 5:50 PM Lijie Wang wrote: > Hi all, > > Thanks for all the feedback about the FLIP-324: Introduce Runtime Filter > for Flink Batch Jobs[1]. This FLIP was discussed in [2]. > > I'd like to start a vote for it. The v

Re: [DISCUSS] Graduate the FileSink to @PublicEvolving

2023-06-26 Thread Jing Ge
hread. Best regards, Jing [1] https://lists.apache.org/thread/vmhzv8fcw2b33pqxp43486owrxbkd5x9 On Sun, Jun 25, 2023 at 3:48 AM yuxia wrote: > Thanks Jing for briging this to dicuss. > I agree it's not a blocker for graduting the FileSink to @PublicEvolving > since the Sink which i

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-26 Thread Jing Ge
ation periods of API deprecation process"? Best regards, Jing [1] https://lists.apache.org/thread/wxoo7py5pqqlz37l4w8jrq6qdvsdq5wc On Sun, Jun 25, 2023 at 2:01 PM Jark Wu wrote: > I agree with Jingsong and Becket. > > Look at the legacy SourceFunction (a small part of Dat

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-26 Thread Jing Ge
to add one section to describe(better with script/code example) how to use it in these two scenarios from users' perspective? NIT: the pictures have transparent background when readers click on it. It would be great if you can replace them with pictures with white background. Best regards,

Re: [DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-27 Thread Jing Ge
ion" instead of "options"? It sounds like there are more options that need to be set. Best regards, jing On Tue, Jun 27, 2023 at 8:37 AM yuxia wrote: > Hi, all. > Thanks for the feedback. > > If there are no other questions or concerns for the FLIP[1], I'd l

  1   2   3   4   5   6   7   8   9   10   >