Re: [DISCUSS] FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2023-12-14 Thread Aitozi
Thanks, Aitozi. Timo Walther 于2023年12月14日周四 17:29写道: > Hi Alan, > > thanks for proposing this FLIP. It's a great addition to Flink and has > been requested multiple times. It will be in particular interesting for > accessing REST endpoints and other remote services. &

Re: SQL return type change from 1.17 to 1.18

2023-12-07 Thread Aitozi
Hi Peter, Timo Sorry for this breaking change, I didn't notice that was a breaking change. I'm +1 to revert the FLINK-33523 Regards, aitozi Timo Walther 于2023年12月7日周四 20:41写道: > Hi Peter, > > thanks for reaching out to the Flink community. This is indeed a serious > i

[jira] [Created] (FLINK-32711) Type mismatch when proctime function used as parameter

2023-07-28 Thread Aitozi (Jira)
Aitozi created FLINK-32711: -- Summary: Type mismatch when proctime function used as parameter Key: FLINK-32711 URL: https://issues.apache.org/jira/browse/FLINK-32711 Project: Flink Issue Type

[jira] [Created] (FLINK-32659) DB connection may leak if exception is thrown in JdbcOutputFormat#close

2023-07-24 Thread Aitozi (Jira)
Aitozi created FLINK-32659: -- Summary: DB connection may leak if exception is thrown in JdbcOutputFormat#close Key: FLINK-32659 URL: https://issues.apache.org/jira/browse/FLINK-32659 Project: Flink

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-07-06 Thread Aitozi
Hi guys, Since there are no further comments, Kindly ping for the vote thread [1] :D Thanks, Aitozi. [1]: https://lists.apache.org/thread/7g5n2vshosom2dj9bp7x4n01okrnx4xx Aitozi 于2023年6月26日周一 10:31写道: > Hi Lincoln, > Thanks for your confirmation. I have updated the consensus

Re: Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-07-06 Thread Aitozi
Hi Awake, Thanks for your good point, updated Best, Aitozi. 宇航 李 于2023年7月5日周三 11:29写道: > Hi Aitozi, > > I think it is necessary to add the following description in FLIP to > express the difference between user-defined asynchronous table function and > AsyncTableFunction: &

Re: [VOTE] FLIP-313: Add support of User Defined AsyncTableFunction

2023-06-25 Thread Aitozi
hread/7vk1799ryvrz4lsm5254q64ctm89mx2l [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-313%3A+Add+support+of+User+Defined+AsyncTableFunction Best regards, Aitozi Aitozi 于2023年6月14日周三 09:47写道: > Hi all, > Thanks for all the feedback about FLIP-313: Add support of User > Defined AsyncTableFunctio

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-25 Thread Aitozi
Hi Lincoln, Thanks for your confirmation. I have updated the consensus to the FLIP doc. If there are no other comments, I'd like to restart the vote process in [1] today. https://lists.apache.org/thread/7g5n2vshosom2dj9bp7x4n01okrnx4xx Thanks, Aitozi. Lincoln Lee 于2023年6月21日周三 22

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-18 Thread Aitozi
'lateral join' are not the same as in the current joins page[1], so maybe it would be better if we unified them into 'join table function' Yes, we should unified to the 'join table function', updated. Best, Aitozi Lincoln Lee 于2023年6月15日周四 09:15写道: > Hi Aitozi,

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-15 Thread Aitozi
a-size >the runtime filter can be pushed down along the probe side, as close to data sources as possible What's the representation of the runtime filter node in planner ? Is it a Filternode Best, Aitozi. Benchao Li 于2023年6月15日周四 14:30写道: > Hi Lijie, > > Regarding the shuffle

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-14 Thread Aitozi
an external io operation, it's better to add the `close` method to actively release resources as a good example for users Make sense to me, will update the FLIP Best, Aitozi. Lincoln Lee 于2023年6月14日周三 14:24写道: > Hi Aitozi, > > Sorry for the lately reply here! Supports async u

[VOTE] FLIP-313: Add support of User Defined AsyncTableFunction

2023-06-13 Thread Aitozi
objection or an insufficient number of votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-313%3A+Add+support+of+User+Defined+AsyncTableFunction [2] https://lists.apache.org/thread/7vk1799ryvrz4lsm5254q64ctm89mx2l Best regards, Aitozi

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Aitozi
Get your meaning now, thanks :) Best, Aitozi. Feng Jin 于2023年6月13日周二 11:16写道: > Hi Aitozi, > > Sorry for the confusing description. > > What I meant was that if we need to remind users about tire safety issues, > we should introduce the new UDTF interface instead of execut

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Aitozi
Hi Feng, Thanks for your question. We do not provide a way to switch the UDTF between sync and async way, So there should be no thread safety problem here. Best, Aitozi Feng Jin 于2023年6月13日周二 10:31写道: > Hi Aitozi, We do need to remind users about thread safety issues. Thank you > fo

[jira] [Created] (FLINK-32320) Same correlate can not be reused due to the different correlationId

2023-06-12 Thread Aitozi (Jira)
Aitozi created FLINK-32320: -- Summary: Same correlate can not be reused due to the different correlationId Key: FLINK-32320 URL: https://issues.apache.org/jira/browse/FLINK-32320 Project: Flink

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Aitozi
BTW, If there are no other more blocking issue / comments, I would like to start a VOTE in another thread this wednesday 6.14 Thanks, Aitozi. Aitozi 于2023年6月12日周一 23:34写道: > Hi, Jing, > Thanks for your explanation. I get your point now. > > For the performance part, I think

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Aitozi
total memory consumption. Thanks, Aitozi. Jing Ge 于2023年6月12日周一 20:28写道: > Hi Aitozi, > > Which key will be used for lookup is not an issue, only one row will be > required for each key in order to enrich it. True, it depends on the > implementation whether multiple rows or sin

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-09 Thread Aitozi
join will not affect the semantic of the async udtf. We use the Async TableFunction here and the table function can collect multiple rows. Thanks, Atiozi. Jing Ge 于2023年6月10日周六 00:15写道: > Hi Aitozi, > > The keyRow used in this case contains all keys[1]. > > Best regards, >

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-09 Thread Aitozi
[1]: https://github.com/apache/flink/blob/191ec6ca3943d7119f14837efe112e074d815c47/flink-table/flink-table-common/src/main/java/org/apache/flink/table/functions/LookupFunction.java#L52 Thanks, Aitozi. Jing Ge 于2023年6月9日周五 17:05写道: > Hi Aitozi, > > Thanks for the feedback. Looking f

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-08 Thread Aitozi
user. But for the asynchronously version, usually means the main process is running in a dedicated thread pool. So if we run the originally UDTFs in asynchronously way, it may bring thread-safe problem. @Jing Ge Also add the "Performance" section in FLIP. Thanks, Aitozi. Feng Jin

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-08 Thread Aitozi
these option, I updated the FLIP about this you can refer to the section of "ConfigOption" and "Rejected Alternatives" In the end, for the performance evaluation, I'd like to do some tests and will update it to the FLIP doc Thanks, Aitozi. Jing Ge 于2023年6月9日周五 07:23写道:

Re: [VOTE] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread Aitozi
+1 Looking forward to this feature. Best, Aitozi. Jing Ge 于2023年6月8日周四 04:44写道: > +1 > > Best Regards, > Jing > > On Wed, Jun 7, 2023 at 10:52 AM weijie guo > wrote: > > > +1 (binding) > > > > Best regards, > > > > Weijie >

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread Aitozi
free. Since the code base of the table module is too big, > > instead of porting to Java, all scala code has been hidden. Furthermore, > > there are ongoing efforts to remove Scala code from Flink. As you can > see, > > the community tries to limit (i.e. get rid of) scala code as

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-07 Thread Aitozi
. Thanks, Atiozi. Mason Chen 于2023年6月8日周四 12:40写道: > Hi Aitozi, > > I think it makes sense to make it easier for SQL users to make RPCs. Do you > think your proposal can extend to the ability to batch data for the RPC? > This is also another common strategy to increase throughput.

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread Aitozi
Hi Ron: Sorry for the late reply after the voting process. I just want to ask > Traverse the ExecNode DAG and create a FusionExecNode for physical operators that can be fused together. which kind of operators can be fused together ? are the operators in an operator chain? Is this optimization

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-05 Thread Aitozi
-udtf.buffer-capacity` `table.exec.async-udtf.timeout` Best, Aitozi. Aitozi 于2023年6月5日周一 12:20写道: > Hi Jing, > > > what is the difference between the RPC call or query you mentioned > and the lookup in a very > general way > > I think the RPC call or query service

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-04 Thread Aitozi
async udtf. In the end, We can also see the user defined async table function is an enhancement of the current lateral table join which only supports sync lateral join now. Best, Aitozi. Jing Ge 于2023年6月2日周五 19:37写道: > Hi Aitozi, > > Thanks for the update. Just out of curiosity,

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-01 Thread Aitozi
erage the async function to improve the throughput. Thanks, Aitozi. Jing Ge 于2023年6月1日周四 22:55写道: > Hi Aitozi, > > Sorry for the late reply. Would you like to update the proposed changes > with more details into the FLIP too? > I got your point. It looks like a rational idea. Howev

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-30 Thread Aitozi
Hi Jing, What do you think about it? Can we move forward this feature? Thanks, Aitozi. Aitozi 于2023年5月29日周一 09:56写道: > Hi Jing, > > "Do you mean to support the AyncTableFunction beyond the > LookupTableSource?" > Yes, I mean to support the AyncTableFunction bey

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-28 Thread Aitozi
In CorrelatedCodeGenerator, we will know the TableFunction's Kind of `FunctionKind.Table` or `FunctionKind.ASYNC_TABLE` For `FunctionKind.ASYNC_TABLE` we can generate a AsyncWaitOperator to execute the async table function. Thanks, Aitozi. Jing Ge 于2023年5月29日周一 03:22写道: > Hi Ait

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-27 Thread Aitozi
fs/ [2]: https://lists.apache.org/thread/qljwd40v5ntz6733cwcdr8s4z97b343b Thanks. Aitozi. Jing Ge 于2023年5月27日周六 06:40写道: > Hi Aitozi, > > Thanks for your proposal. I am not quite sure if I understood your thoughts > correctly. You described a special case implementation of the > Async

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-24 Thread Aitozi
May I ask for some feedback :D Thanks, Aitozi Aitozi 于2023年5月23日周二 19:14写道: > > Just catch an user case report from Giannis Polyzos for this usage: > > https://lists.apache.org/thread/qljwd40v5ntz6733cwcdr8s4z97b343b > > Aitozi 于2023年5月23日周二 17:45写道: > > > > Hi

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-23 Thread Aitozi
Just catch an user case report from Giannis Polyzos for this usage: https://lists.apache.org/thread/qljwd40v5ntz6733cwcdr8s4z97b343b Aitozi 于2023年5月23日周二 17:45写道: > > Hi guys, > I want to bring up a discussion about adding support of User > Defined AsyncTableFunction in Flink.

[DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-23 Thread Aitozi
D+Add+support+of+User+Defined+AsyncTableFunction Thanks, Aitozi.

Re: Re: [VOTE] FLIP-302: Support TRUNCATE TABLE statement in batch mode

2023-04-17 Thread Aitozi
+1 Best, Aitozi ron 于2023年4月18日周二 09:18写道: > > +1 > > > > -原始邮件- > > 发件人: "Lincoln Lee" > > 发送时间: 2023-04-18 09:08:08 (星期二) > > 收件人: dev@flink.apache.org > > 抄送: > > 主题: Re: [VOTE] FLIP-302: Support TRUNCATE TABLE statement in

Re: [DISCUSS] EncodingFormat and DecondingFormat provide copy API

2023-04-14 Thread Aitozi
d. Anyway, it's unclear for the implementer to know which stage will the `apply` happen, So +1 for introducing the copy for EncodingFormat and DecodingFormat to align the supporting of deep copy semantic this time. Best, Aitozi. tanjialiang 于2023年4月13日周四 10:05写道: > > Hi, devs. >

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-13 Thread Aitozi
Well, thanks xia for your clarification. Agree with your point, I have no other concerns. Best, Aitozi. yuxia 于2023年4月13日周四 16:17写道: > > Hi, Aitozi. > Thanks for your inputs. I understand your concern. Althogh the external > connector can update the metadata in method `execu

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-12 Thread Aitozi
hould be cleared Best, Aitozi. liu ron 于2023年4月13日周四 11:28写道: > > Hi, xia > > Thanks for your explanation, for the first question, given the current > status, I think we can provide the generic interface in the future if we > need it. For the second question, it makes sense to

Re: [DISCUSS] Add support for Apache Arrow format

2023-04-12 Thread Aitozi
and GPUs. The Arrow memory format also supports > > zero-copy reads for lightning-fast data access without serialization > > overhead. it will bring a lot. > >And we may do some surveys, what other engines support like > > spark/hive/presto and so on, how that support

[jira] [Created] (FLINK-31790) Filesystem batch sink should also respect to the PartitionCommitPolicy

2023-04-12 Thread Aitozi (Jira)
Aitozi created FLINK-31790: -- Summary: Filesystem batch sink should also respect to the PartitionCommitPolicy Key: FLINK-31790 URL: https://issues.apache.org/jira/browse/FLINK-31790 Project: Flink

[jira] [Created] (FLINK-31787) Add the explicit ROW constructor to the system function doc

2023-04-12 Thread Aitozi (Jira)
Aitozi created FLINK-31787: -- Summary: Add the explicit ROW constructor to the system function doc Key: FLINK-31787 URL: https://issues.apache.org/jira/browse/FLINK-31787 Project: Flink Issue Type

[jira] [Created] (FLINK-31774) Add document for delete and update statement

2023-04-11 Thread Aitozi (Jira)
Aitozi created FLINK-31774: -- Summary: Add document for delete and update statement Key: FLINK-31774 URL: https://issues.apache.org/jira/browse/FLINK-31774 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31755) ROW function can not work with RewriteIntersectAllRule

2023-04-07 Thread Aitozi (Jira)
Aitozi created FLINK-31755: -- Summary: ROW function can not work with RewriteIntersectAllRule Key: FLINK-31755 URL: https://issues.apache.org/jira/browse/FLINK-31755 Project: Flink Issue Type: Bug

Re: [DISCUSS] Add support for Apache Arrow format

2023-04-02 Thread Aitozi
obuf. It will not impact the internal data structure representation in Flink. For proof of concept, please refer to: https://github.com/Aitozi/flink/commits/arrow-format. @Martijn > I'm wondering if there's really much benefit for the Flink project to add another file format, over pr

[DISCUSS] Add support for Apache Arrow format

2023-03-29 Thread Aitozi
amework closely. So, I'd like to introduce the flink-arrow formats module to support the arrow format naturally. Looking forward to some suggestions. Best, Aitozi [1]: https://apache-flink.slack.com/archives/C03GV7L3G2C/p1677915016551629 [2]: https://apache-flink.slack.com/

[jira] [Created] (FLINK-31497) Drop the deprecated CatalogViewImpl

2023-03-17 Thread Aitozi (Jira)
Aitozi created FLINK-31497: -- Summary: Drop the deprecated CatalogViewImpl Key: FLINK-31497 URL: https://issues.apache.org/jira/browse/FLINK-31497 Project: Flink Issue Type: Technical Debt

[DISCUSSI] Improve Multi-Query optimization in Flink

2023-03-15 Thread Aitozi
solution. as described in [4] Looking forward to your inputs. Best, Aitozi. [1]: https://issues.apache.org/jira/projects/FLINK/issues/FLINK-29088 [2]: https://issues.apache.org/jira/projects/FLINK/issues/FLINK-31205 [3]: Efficient and Extensible Algorithms for Multi Query Optimization https:

[jira] [Created] (FLINK-31426) Upgrade the deprecated UniqueConstraint to the new one

2023-03-13 Thread Aitozi (Jira)
Aitozi created FLINK-31426: -- Summary: Upgrade the deprecated UniqueConstraint to the new one Key: FLINK-31426 URL: https://issues.apache.org/jira/browse/FLINK-31426 Project: Flink Issue Type

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

2023-03-13 Thread Aitozi
+1 (non-binding) Best, Aitozi Jing Ge 于2023年3月13日周一 22:10写道: > +1 (binding) > > Best Regards, > Jing > > On Mon, Mar 13, 2023 at 1:57 PM Hang Ruan wrote: > > > +1 (non-binding) > > > > Best, > > Hang > > > > yuxia 于2023年3月13日周一 20:

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

2023-03-12 Thread Aitozi
Congratulations, Yuxia Best, Aitozi Yuxin Tan 于2023年3月13日周一 10:36写道: > Congratulations, Yuxia! > > Best, > Yuxin > > > Jark Wu 于2023年3月13日周一 10:26写道: > > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Yuxia Luo as a

[jira] [Created] (FLINK-31390) Optimize the FlinkChangelogModeInferenceProgram by avoiding unnecessary traversals.

2023-03-09 Thread Aitozi (Jira)
Aitozi created FLINK-31390: -- Summary: Optimize the FlinkChangelogModeInferenceProgram by avoiding unnecessary traversals. Key: FLINK-31390 URL: https://issues.apache.org/jira/browse/FLINK-31390 Project

[jira] [Created] (FLINK-31362) Add document about how to use C-style escape strings

2023-03-07 Thread Aitozi (Jira)
Aitozi created FLINK-31362: -- Summary: Add document about how to use C-style escape strings Key: FLINK-31362 URL: https://issues.apache.org/jira/browse/FLINK-31362 Project: Flink Issue Type

Re: [DISCUSS] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

2023-03-06 Thread Aitozi
> we can initiate corresponding support issues for specific connectors to follow up on support after finalizing the API changes Make sense to me! Best, Aitozi. Lincoln Lee 于2023年3月7日周二 15:05写道: > Thanks Jingsong & Hang, > > Using Optional as the return value is a good ide

Re: [DISCUSS] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

2023-03-06 Thread Aitozi
Hi Lincoln, Thank you for sharing this FLIP. Overall, it looks good to me. I have one question: with the introduction of this interface, will any existing Flink connectors need to be updated in order to take advantage of its capabilities? For example, HBase. yuxia 于2023年3月7日周二 10:01写道: > Tha

Re: [DISCUSS] String literal behavior in Flink

2023-03-06 Thread Aitozi
Hi, Jark FYI, this feature has already been supported in Calcite 1.33.0 [1]. Therefore, I believe we can use it directly after upgrading the Calcite version. Best, Aitozi. [1]: https://issues.apache.org/jira/browse/CALCITE-5305 Aitozi 于2023年3月6日周一 16:48写道: > Thanks, will give it a

Re: [DISCUSS] String literal behavior in Flink

2023-03-06 Thread Aitozi
Thanks, will give it a try Best, Aitozi. Jark Wu 于2023年3月6日周一 15:11写道: > Hi Aitozi, > > I would suggest trying to contribute it to the upstream project Calcite > first. > > Best, > Jark > > > 2023年3月6日 11:51,Aitozi 写道: > > > > Hi Jark, > > >

Re: [DISCUSS] String literal behavior in Flink

2023-03-05 Thread Aitozi
accommodate this new syntax. I am unsure whether we should initially incorporate this alteration in Calcite or if we can directly supersede the StringLiteral behavior within the Flink project. Nevertheless, I believe supporting this change is achievable. Thanks, Aitozi. Jark Wu 于2023年3月6日周一 1

[DISCUSS] String literal behavior in Flink

2023-03-04 Thread Aitozi
y use SELECT SPLIT_INDEX(col, '\n', 0); for the query. I know this is not standard behavior in ANSI SQL. I'm opening this thread for some opinions from the community guys. [1]: https://dev.mysql.com/doc/refman/8.0/en/string-literals.html#character-escape-sequences Thanks, Aitozi

[jira] [Created] (FLINK-31296) Add JoinConditionEqualityTransferRule to stream optimizer

2023-03-01 Thread Aitozi (Jira)
Aitozi created FLINK-31296: -- Summary: Add JoinConditionEqualityTransferRule to stream optimizer Key: FLINK-31296 URL: https://issues.apache.org/jira/browse/FLINK-31296 Project: Flink Issue Type

[jira] [Created] (FLINK-31260) PushLocalHashAggIntoScanRule should also work with union RelNode

2023-02-28 Thread Aitozi (Jira)
Aitozi created FLINK-31260: -- Summary: PushLocalHashAggIntoScanRule should also work with union RelNode Key: FLINK-31260 URL: https://issues.apache.org/jira/browse/FLINK-31260 Project: Flink Issue

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-23 Thread Aitozi
e read/write operations in the Catalog, the TableEnvironment#getCatalog will expose all of them to the user side. So I learned to add a new api in TableEnvironment to reduce reliance on the current TableEnvironment#getCatalog. Thanks, Aitozi Ran Tao 于2023年2月23日周四 23:44写道: > Hi, JingSong, Jing.

[jira] [Created] (FLINK-31205) do optimize for multi sink in a single relNode tree

2023-02-23 Thread Aitozi (Jira)
Aitozi created FLINK-31205: -- Summary: do optimize for multi sink in a single relNode tree Key: FLINK-31205 URL: https://issues.apache.org/jira/browse/FLINK-31205 Project: Flink Issue Type

[jira] [Created] (FLINK-30570) RexNodeExtractor#isSupportedPartitionPredicate generates unexpected partition predicates

2023-01-05 Thread Aitozi (Jira)
Aitozi created FLINK-30570: -- Summary: RexNodeExtractor#isSupportedPartitionPredicate generates unexpected partition predicates Key: FLINK-30570 URL: https://issues.apache.org/jira/browse/FLINK-30570 Project

[jira] [Created] (FLINK-30551) Add open method to PartitionCommitPolicy

2023-01-03 Thread Aitozi (Jira)
Aitozi created FLINK-30551: -- Summary: Add open method to PartitionCommitPolicy Key: FLINK-30551 URL: https://issues.apache.org/jira/browse/FLINK-30551 Project: Flink Issue Type: Improvement

[Discuss] Discuss about the interface of Catalog

2022-12-17 Thread Aitozi
rectly. For the getTable, I have no strong preference but I think it can also work with ResolvedCatalogBaseTable to return the ResolvedCatalogBaseTable. Since the current implementation is already able to do that. Thanks, Aitozi

[jira] [Created] (FLINK-30242) Push localHashAggregate pass the union node

2022-11-29 Thread Aitozi (Jira)
Aitozi created FLINK-30242: -- Summary: Push localHashAggregate pass the union node Key: FLINK-30242 URL: https://issues.apache.org/jira/browse/FLINK-30242 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-30198) Support AdaptiveBatchScheduler to set per-task size for reducer task

2022-11-24 Thread Aitozi (Jira)
Aitozi created FLINK-30198: -- Summary: Support AdaptiveBatchScheduler to set per-task size for reducer task Key: FLINK-30198 URL: https://issues.apache.org/jira/browse/FLINK-30198 Project: Flink

[jira] [Created] (FLINK-30019) Remove the unused HiveTableFileInputFormat in hive connector

2022-11-14 Thread Aitozi (Jira)
Aitozi created FLINK-30019: -- Summary: Remove the unused HiveTableFileInputFormat in hive connector Key: FLINK-30019 URL: https://issues.apache.org/jira/browse/FLINK-30019 Project: Flink Issue Type

[jira] [Created] (FLINK-29980) Wrap the HiveSource's bulkFormat to handle the partition keys

2022-11-10 Thread Aitozi (Jira)
Aitozi created FLINK-29980: -- Summary: Wrap the HiveSource's bulkFormat to handle the partition keys Key: FLINK-29980 URL: https://issues.apache.org/jira/browse/FLINK-29980 Project: Flink

[jira] [Created] (FLINK-29800) Continuous failover will leak the inprogress output file

2022-10-30 Thread Aitozi (Jira)
Aitozi created FLINK-29800: -- Summary: Continuous failover will leak the inprogress output file Key: FLINK-29800 URL: https://issues.apache.org/jira/browse/FLINK-29800 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29795) The source.file.stream.io-fetch-size can not be set by with properties

2022-10-29 Thread Aitozi (Jira)
Aitozi created FLINK-29795: -- Summary: The source.file.stream.io-fetch-size can not be set by with properties Key: FLINK-29795 URL: https://issues.apache.org/jira/browse/FLINK-29795 Project: Flink

[jira] [Created] (FLINK-29748) Expose the optimize phase in the connector context

2022-10-24 Thread Aitozi (Jira)
Aitozi created FLINK-29748: -- Summary: Expose the optimize phase in the connector context Key: FLINK-29748 URL: https://issues.apache.org/jira/browse/FLINK-29748 Project: Flink Issue Type

[jira] [Created] (FLINK-29557) The SinkOperator's OutputFormat function is not recognized

2022-10-09 Thread Aitozi (Jira)
Aitozi created FLINK-29557: -- Summary: The SinkOperator's OutputFormat function is not recognized Key: FLINK-29557 URL: https://issues.apache.org/jira/browse/FLINK-29557 Project: Flink Issue

[jira] [Created] (FLINK-29308) NoResourceAvailableException fails the batch job

2022-09-14 Thread Aitozi (Jira)
Aitozi created FLINK-29308: -- Summary: NoResourceAvailableException fails the batch job Key: FLINK-29308 URL: https://issues.apache.org/jira/browse/FLINK-29308 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29200) Provide the way to delay the pod deletion for debugging purpose

2022-09-05 Thread Aitozi (Jira)
Aitozi created FLINK-29200: -- Summary: Provide the way to delay the pod deletion for debugging purpose Key: FLINK-29200 URL: https://issues.apache.org/jira/browse/FLINK-29200 Project: Flink Issue

[jira] [Created] (FLINK-29088) Project push down cause the source reuse can not work

2022-08-23 Thread Aitozi (Jira)
Aitozi created FLINK-29088: -- Summary: Project push down cause the source reuse can not work Key: FLINK-29088 URL: https://issues.apache.org/jira/browse/FLINK-29088 Project: Flink Issue Type

[jira] [Created] (FLINK-29085) Add the name for test as hint for BuiltInFunctionTestBase

2022-08-23 Thread Aitozi (Jira)
Aitozi created FLINK-29085: -- Summary: Add the name for test as hint for BuiltInFunctionTestBase Key: FLINK-29085 URL: https://issues.apache.org/jira/browse/FLINK-29085 Project: Flink Issue Type

[jira] [Created] (FLINK-29066) Reconsider the runtime property of the BuiltInFunctionDefinition

2022-08-22 Thread Aitozi (Jira)
Aitozi created FLINK-29066: -- Summary: Reconsider the runtime property of the BuiltInFunctionDefinition Key: FLINK-29066 URL: https://issues.apache.org/jira/browse/FLINK-29066 Project: Flink Issue

[jira] [Created] (FLINK-29061) Cleanup dead code in StringCallGen

2022-08-22 Thread Aitozi (Jira)
Aitozi created FLINK-29061: -- Summary: Cleanup dead code in StringCallGen Key: FLINK-29061 URL: https://issues.apache.org/jira/browse/FLINK-29061 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

2022-08-19 Thread Aitozi
Congrats Lijie! Best regards, Aitozi Jing Ge 于2022年8月19日周五 06:02写道: > Congrats Lijie! > > Best regards, > Jing > > On Thu, Aug 18, 2022 at 8:40 AM Terry Wang wrote: > > > Congratulations, Lijie! > > > > On Thu, Aug 18, 2022 at 11:31 AM Leonard Xu

Re: [ANNOUNCE] New Apache Flink Committer - Junhan Yang

2022-08-19 Thread Aitozi
Congratulations, Junhan! Best, Aitozi Guowei Ma 于2022年8月19日周五 13:18写道: > Congratulations, Junhan! > Best, > Guowei > > > On Fri, Aug 19, 2022 at 6:01 AM Jing Ge wrote: > > > Congrats Junhan! > > > > Best regards, > > Jing > >

[jira] [Created] (FLINK-28838) Avoid to notify the elementQueue consumer when the fetch result is empty

2022-08-05 Thread Aitozi (Jira)
Aitozi created FLINK-28838: -- Summary: Avoid to notify the elementQueue consumer when the fetch result is empty Key: FLINK-28838 URL: https://issues.apache.org/jira/browse/FLINK-28838 Project: Flink

[jira] [Created] (FLINK-28822) Avoid create VectorizedColumnBatch for each read in ArrowReader

2022-08-04 Thread Aitozi (Jira)
Aitozi created FLINK-28822: -- Summary: Avoid create VectorizedColumnBatch for each read in ArrowReader Key: FLINK-28822 URL: https://issues.apache.org/jira/browse/FLINK-28822 Project: Flink Issue

[jira] [Created] (FLINK-28816) Include some metrics for the pod created in operator

2022-08-04 Thread Aitozi (Jira)
Aitozi created FLINK-28816: -- Summary: Include some metrics for the pod created in operator Key: FLINK-28816 URL: https://issues.apache.org/jira/browse/FLINK-28816 Project: Flink Issue Type

[jira] [Created] (FLINK-28751) Poor performance of the built in json_value function

2022-07-30 Thread Aitozi (Jira)
Aitozi created FLINK-28751: -- Summary: Poor performance of the built in json_value function Key: FLINK-28751 URL: https://issues.apache.org/jira/browse/FLINK-28751 Project: Flink Issue Type

[jira] [Created] (FLINK-28531) Shutdown cluster after history server archive finished

2022-07-12 Thread Aitozi (Jira)
Aitozi created FLINK-28531: -- Summary: Shutdown cluster after history server archive finished Key: FLINK-28531 URL: https://issues.apache.org/jira/browse/FLINK-28531 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28478) Session Cluster will lost if it failed between status recorded and deploy

2022-07-09 Thread Aitozi (Jira)
Aitozi created FLINK-28478: -- Summary: Session Cluster will lost if it failed between status recorded and deploy Key: FLINK-28478 URL: https://issues.apache.org/jira/browse/FLINK-28478 Project: Flink

[jira] [Created] (FLINK-28477) Support to scan the history server dir with max depth

2022-07-09 Thread Aitozi (Jira)
Aitozi created FLINK-28477: -- Summary: Support to scan the history server dir with max depth Key: FLINK-28477 URL: https://issues.apache.org/jira/browse/FLINK-28477 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-16 Thread Aitozi
Thanks Junhan for driving this. It a great improvement for the batch jobs. I'm looking forward to this feature in our internal use case. +1 for it. One more question: Are each attempts of the TaskManager or JobManager pods (if failure occurs) all be shown in the ui ? Best, Aitozi. Yang Wa

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Aitozi
Congrats, Jingsong! Best, Aitozi Zhuoluo Yang 于2022年6月16日周四 09:26写道: > Many congratulations to teacher Lee! > > Thanks, > Zhuoluo > > > Dian Fu 于2022年6月16日周四 08:54写道: > > > Congratulations, Jingsong! > > > > Regards, > > Dian >

[jira] [Created] (FLINK-28008) Can not get secondary resource from after operator restart

2022-06-10 Thread Aitozi (Jira)
Aitozi created FLINK-28008: -- Summary: Can not get secondary resource from after operator restart Key: FLINK-28008 URL: https://issues.apache.org/jira/browse/FLINK-28008 Project: Flink Issue Type

[jira] [Created] (FLINK-27979) Support to upgrade session cluster in a more fine grained way

2022-06-09 Thread Aitozi (Jira)
Aitozi created FLINK-27979: -- Summary: Support to upgrade session cluster in a more fine grained way Key: FLINK-27979 URL: https://issues.apache.org/jira/browse/FLINK-27979 Project: Flink Issue

[jira] [Created] (FLINK-27961) The EventUtils generate event name should take the resource's uid into account

2022-06-08 Thread Aitozi (Jira)
Aitozi created FLINK-27961: -- Summary: The EventUtils generate event name should take the resource's uid into account Key: FLINK-27961 URL: https://issues.apache.org/jira/browse/FLINK-27961 Project:

[jira] [Created] (FLINK-27960) Make the apt-get updating optional

2022-06-08 Thread Aitozi (Jira)
Aitozi created FLINK-27960: -- Summary: Make the apt-get updating optional Key: FLINK-27960 URL: https://issues.apache.org/jira/browse/FLINK-27960 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27930) Format the timestamp in status to make it explicit

2022-06-07 Thread Aitozi (Jira)
Aitozi created FLINK-27930: -- Summary: Format the timestamp in status to make it explicit Key: FLINK-27930 URL: https://issues.apache.org/jira/browse/FLINK-27930 Project: Flink Issue Type

[jira] [Created] (FLINK-27925) Avoid to create watcher without the resourceVersion

2022-06-06 Thread Aitozi (Jira)
Aitozi created FLINK-27925: -- Summary: Avoid to create watcher without the resourceVersion Key: FLINK-27925 URL: https://issues.apache.org/jira/browse/FLINK-27925 Project: Flink Issue Type

[jira] [Created] (FLINK-27921) Introduce the checkResourceRequirementsWithDelay in DeclarativeSlotManager

2022-06-06 Thread Aitozi (Jira)
Aitozi created FLINK-27921: -- Summary: Introduce the checkResourceRequirementsWithDelay in DeclarativeSlotManager Key: FLINK-27921 URL: https://issues.apache.org/jira/browse/FLINK-27921 Project: Flink

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.0.0 released

2022-06-05 Thread Aitozi
Thanks Yang and Nice to see it happen. Best, Aitozi. Yang Wang 于2022年6月5日周日 16:14写道: > The Apache Flink community is very happy to announce the release of Apache > Flink Kubernetes Operator 1.0.0. > > The Flink Kubernetes Operator allows users to manage their Apache Flink > a

Re: [VOTE] FLIP-235: Hybrid Shuffle Mode

2022-05-28 Thread Aitozi
+1 (non-binding) Best, Aitozi Yangze Guo 于2022年5月27日周五 11:17写道: > +1 > > Best, > Yangze Guo > > On Thu, May 26, 2022 at 4:42 PM Xintong Song > wrote: > > > > +1 > > > > Best, > > > > Xintong > > > > > > >

[jira] [Created] (FLINK-27737) Clean the outdated comments and unfencedMainExecutor

2022-05-22 Thread Aitozi (Jira)
Aitozi created FLINK-27737: -- Summary: Clean the outdated comments and unfencedMainExecutor Key: FLINK-27737 URL: https://issues.apache.org/jira/browse/FLINK-27737 Project: Flink Issue Type

  1   2   3   >