Re: CHI: Automatic Stale PR Cleanup

2024-12-17 Thread Jim Hughes
Hi Tom, I like the idea of starting with X=1 year and Y=3 months. That plus having CHI review recent PRs would be helpful. Your suggestion of having a bot which "lints" naming conventions could be useful. Maybe there could be a CHI-bot to automate what you and others are doing manually. :) I wo

Re: [VOTE] FLIP-489: Add missing dropTable/dropView methods to TableEnvironment

2024-12-12 Thread Jim Hughes
Hi Sergey, +1 (non-binding) Cheers, Jim On Thu, Dec 12, 2024 at 2:51 PM Sergey Nuyanzin wrote: > Hi everyone, > > I'd like to start a vote on FLIP-489: Add missing dropTable/dropView > methods > to TableEnvironment [1] which has been discussed in this thread [2]. > > The vote will be open for

Re: [DISCUSS] Content older than one year will be deleted the Flink Slack starting January 28th, 2025

2024-12-10 Thread Jim Hughes
Hi Robert, Have you asked ASF Infra? >From a very quick look, it appears that the ASF Slack instance has old messages. Infra may suggest that we use their instance. (Which doesn't solve the history problem.) Maybe Infra would know how they were able to get things set up? Cheers, Jim On Tue,

Re: [DISCUSS] FLIP-489: Add missing dropTable/dropView methods to TableEnvironment

2024-12-06 Thread Jim Hughes
Hi Sergey, Nice! Seems straightforward... While reading it was surprised that the create functions like `createTable` return void. The suggestion to return boolean like the other drop methods seems good. Cheers, Jim On Fri, Dec 6, 2024 at 5:53 PM Sergey Nuyanzin wrote: > Hi all! > > I woul

Re: Community Health Initiative (CHI) workgroup wiki content

2024-12-03 Thread Jim Hughes
Hi David, Thanks for organizing! Two points of order: When I put up PRs, I am usually already working with a committer or putting up some kind of draft. If you saw an assigned reviewer (or the PR marked as a draft), would that help you step over the PR and focus on other ones? (Or said differen

[jira] [Created] (FLINK-36802) Add CompiledPlan annotations to BatchExecSortMergeJoin

2024-11-26 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36802: -- Summary: Add CompiledPlan annotations to BatchExecSortMergeJoin Key: FLINK-36802 URL: https://issues.apache.org/jira/browse/FLINK-36802 Project: Flink Issue

Re: FW: RE: Flink technical debt.

2024-11-19 Thread Jim Hughes
ExZDM4OGYtZjZiNi00OTAwLTg1ZGEtMzk5ZWZiZDA1YjYw%40thread.v2/0?context=%7b%22Tid%22%3a%22fcf67057-50c9-4ad4-98f3-ffca64add9e9%22%2c%22Oid%22%3a%229c4a6a85-e4f2-44e8-a2f2-b00cdc128be3%22%7d > > > > > Meeting ID: 242 656 143 640 > > Passcode: QmdKiq > > __

[jira] [Created] (FLINK-36732) Add CompiledPlan annotations to BatchExecPythonOverAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36732: -- Summary: Add CompiledPlan annotations to BatchExecPythonOverAggregate Key: FLINK-36732 URL: https://issues.apache.org/jira/browse/FLINK-36732 Project: Flink

[jira] [Created] (FLINK-36731) Add CompiledPlan annotations to BatchExecPythonGroupWindowAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36731: -- Summary: Add CompiledPlan annotations to BatchExecPythonGroupWindowAggregate Key: FLINK-36731 URL: https://issues.apache.org/jira/browse/FLINK-36731 Project: Flink

[jira] [Created] (FLINK-36729) Add CompiledPlan annotations to BatchExecPythonCorrelate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36729: -- Summary: Add CompiledPlan annotations to BatchExecPythonCorrelate Key: FLINK-36729 URL: https://issues.apache.org/jira/browse/FLINK-36729 Project: Flink Issue

[jira] [Created] (FLINK-36730) Add CompiledPlan annotations to BatchExecPythonGroupAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36730: -- Summary: Add CompiledPlan annotations to BatchExecPythonGroupAggregate Key: FLINK-36730 URL: https://issues.apache.org/jira/browse/FLINK-36730 Project: Flink

[jira] [Created] (FLINK-36728) Add CompiledPlan annotations to BatchExecPythonCalc

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36728: -- Summary: Add CompiledPlan annotations to BatchExecPythonCalc Key: FLINK-36728 URL: https://issues.apache.org/jira/browse/FLINK-36728 Project: Flink Issue Type

[jira] [Created] (FLINK-36725) Add CompiledPlan annotations to BatchExecRuntimeFilter exec nodes

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36725: -- Summary: Add CompiledPlan annotations to BatchExecRuntimeFilter exec nodes Key: FLINK-36725 URL: https://issues.apache.org/jira/browse/FLINK-36725 Project: Flink

[jira] [Created] (FLINK-36727) Add a completeness test to cover BatchExecNodes

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36727: -- Summary: Add a completeness test to cover BatchExecNodes Key: FLINK-36727 URL: https://issues.apache.org/jira/browse/FLINK-36727 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-36726) Add CompiledPlan annotations to BatchExecInputAdapter

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36726: -- Summary: Add CompiledPlan annotations to BatchExecInputAdapter Key: FLINK-36726 URL: https://issues.apache.org/jira/browse/FLINK-36726 Project: Flink Issue Type

[jira] [Created] (FLINK-36724) Add CompiledPlan annotations to BatchExecExecutionOrderEnforcer

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36724: -- Summary: Add CompiledPlan annotations to BatchExecExecutionOrderEnforcer Key: FLINK-36724 URL: https://issues.apache.org/jira/browse/FLINK-36724 Project: Flink

[jira] [Created] (FLINK-36723) Add CompiledPlan annotations to BatchExecDynamicFilteringDataCollector

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36723: -- Summary: Add CompiledPlan annotations to BatchExecDynamicFilteringDataCollector Key: FLINK-36723 URL: https://issues.apache.org/jira/browse/FLINK-36723 Project: Flink

[jira] [Created] (FLINK-36722) Add CompiledPlan annotations to BatchExecSortWindowAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36722: -- Summary: Add CompiledPlan annotations to BatchExecSortWindowAggregate Key: FLINK-36722 URL: https://issues.apache.org/jira/browse/FLINK-36722 Project: Flink

[jira] [Created] (FLINK-36721) Add CompiledPlan annotations to BatchExecHashWindowAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36721: -- Summary: Add CompiledPlan annotations to BatchExecHashWindowAggregate Key: FLINK-36721 URL: https://issues.apache.org/jira/browse/FLINK-36721 Project: Flink

[jira] [Created] (FLINK-36720) Add CompiledPlan annotations to BatchExecWindowTableFunction

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36720: -- Summary: Add CompiledPlan annotations to BatchExecWindowTableFunction Key: FLINK-36720 URL: https://issues.apache.org/jira/browse/FLINK-36720 Project: Flink

[jira] [Created] (FLINK-36719) Add CompiledPlan annotations to BatchExecMultipleInput

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36719: -- Summary: Add CompiledPlan annotations to BatchExecMultipleInput Key: FLINK-36719 URL: https://issues.apache.org/jira/browse/FLINK-36719 Project: Flink Issue

[jira] [Created] (FLINK-36718) Add CompiledPlan annotations to BatchExecLookupJoin and BatchExecSortMergeJoin

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36718: -- Summary: Add CompiledPlan annotations to BatchExecLookupJoin and BatchExecSortMergeJoin Key: FLINK-36718 URL: https://issues.apache.org/jira/browse/FLINK-36718 Project

Re: Flink technical debt.

2024-11-11 Thread Jim Hughes
Hi David, I know finding a meeting time will be very hard; I am on the East coast of the US. Do you mean 11:30 AM or PM? (I assume AM.). If there are others in the US, we can work async or maybe there could be separate meetings for different goals. In case I cannot attend, I'd like to suggest t

Re: [VOTE] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-11 Thread Jim Hughes
Hi Timo, I'm +1 (non-binding) on the FLIP. As a point of order, is the vote supposed to happen in a new thread? Cheers, Jim On Mon, Nov 11, 2024 at 9:46 AM Konstantin Knauf wrote: > +1 (binding) > > Am Mo., 11. Nov. 2024 um 15:20 Uhr schrieb Sergey Nuyanzin < > snuyan...@apache.org>: > > > T

Re: Flink technical debt.

2024-11-06 Thread Jim Hughes
Hi David, Tom, Regarding bots, I've seen that there is some JIRA bot which moves priority down over time. See https://issues.apache.org/jira/browse/FLINK-12173 as an example. I recently hit an issue where a new-to-Flink contributor had filed a ticket and put up a PR around six months ago and no

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-10-23 Thread Jim Hughes
Hi Timo, Thank you for the answers. I have a few clarifications inlined. On Mon, Oct 14, 2024 at 8:07 AM Timo Walther wrote: > 3. Change of interfaces for multiple output tables > Currently, I think using a STATEMENT SET should be enough for side > output semantics. I have added an example in

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-10-06 Thread Jim Hughes
to be the first one / most important that I'd find missing. Cheers, Jim On Tue, Oct 1, 2024 at 5:02 PM Jim Hughes wrote: > Hi Timo, > > Thanks for the FLIP! Also, thanks for saying that this has been in your > head for a few years; there is a ton here. > > 1. For the pass th

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-10-01 Thread Jim Hughes
Hi Timo, Thanks for the FLIP! Also, thanks for saying that this has been in your head for a few years; there is a ton here. 1. For the pass through semantics, if the partition columns are already listed in the pass through column, they are not duplicated right? 2. A number of places mention that

[jira] [Created] (FLINK-36049) Add CompiledPlan annotations to BatchExecSortLimit

2024-08-13 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36049: -- Summary: Add CompiledPlan annotations to BatchExecSortLimit Key: FLINK-36049 URL: https://issues.apache.org/jira/browse/FLINK-36049 Project: Flink Issue Type

[jira] [Created] (FLINK-36048) Add CompiledPlan annotations to BatchExecRank

2024-08-13 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36048: -- Summary: Add CompiledPlan annotations to BatchExecRank Key: FLINK-36048 URL: https://issues.apache.org/jira/browse/FLINK-36048 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-36047) Add CompiledPlan annotations to BatchExecOverAggregate

2024-08-13 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36047: -- Summary: Add CompiledPlan annotations to BatchExecOverAggregate Key: FLINK-36047 URL: https://issues.apache.org/jira/browse/FLINK-36047 Project: Flink Issue

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-08-09 Thread Jim Hughes
David, Junrui, Is there a brief description of the prerequisites for compiled plan-based submission? Cheers, Jim On Fri, Aug 9, 2024 at 3:55 AM David Morávek wrote: > Thanks, Junrui, for the summary, and Zhu, I appreciate the detailed offline > conversation. It was incredibly helpful in align

[jira] [Created] (FLINK-36003) Add CompiledPlan annotations to BatchExecExpand and BatchExecSortAggregate

2024-08-07 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36003: -- Summary: Add CompiledPlan annotations to BatchExecExpand and BatchExecSortAggregate Key: FLINK-36003 URL: https://issues.apache.org/jira/browse/FLINK-36003 Project

[jira] [Created] (FLINK-36002) Add CompiledPlan annotations to BatchExecMatch

2024-08-07 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36002: -- Summary: Add CompiledPlan annotations to BatchExecMatch Key: FLINK-36002 URL: https://issues.apache.org/jira/browse/FLINK-36002 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-35944) Add CompiledPlan annotations to BatchExecUnion

2024-07-31 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35944: -- Summary: Add CompiledPlan annotations to BatchExecUnion Key: FLINK-35944 URL: https://issues.apache.org/jira/browse/FLINK-35944 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-35943) Add CompiledPlan annotations to BatchExecHashJoin and BatchExecNestedLoopJoin

2024-07-31 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35943: -- Summary: Add CompiledPlan annotations to BatchExecHashJoin and BatchExecNestedLoopJoin Key: FLINK-35943 URL: https://issues.apache.org/jira/browse/FLINK-35943 Project

[jira] [Created] (FLINK-35942) Add CompiledPlan annotations to BatchExecSort

2024-07-31 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35942: -- Summary: Add CompiledPlan annotations to BatchExecSort Key: FLINK-35942 URL: https://issues.apache.org/jira/browse/FLINK-35942 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-35941) Add CompiledPlan annotations to BatchExecLimit

2024-07-31 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35941: -- Summary: Add CompiledPlan annotations to BatchExecLimit Key: FLINK-35941 URL: https://issues.apache.org/jira/browse/FLINK-35941 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-35934) Add CompiledPlan annotations to BatchExecValues

2024-07-30 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35934: -- Summary: Add CompiledPlan annotations to BatchExecValues Key: FLINK-35934 URL: https://issues.apache.org/jira/browse/FLINK-35934 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-35923) Add CompiledPlan annotations to BatchExecSort

2024-07-29 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35923: -- Summary: Add CompiledPlan annotations to BatchExecSort Key: FLINK-35923 URL: https://issues.apache.org/jira/browse/FLINK-35923 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-35799) Add CompiledPlan annotations to BatchExecCalc

2024-07-09 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35799: -- Summary: Add CompiledPlan annotations to BatchExecCalc Key: FLINK-35799 URL: https://issues.apache.org/jira/browse/FLINK-35799 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-35798) Implement a BatchCompiledPlanTestBase

2024-07-09 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35798: -- Summary: Implement a BatchCompiledPlanTestBase Key: FLINK-35798 URL: https://issues.apache.org/jira/browse/FLINK-35798 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35797) FLIP-456: CompiledPlan support for Batch Execution Mode

2024-07-09 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35797: -- Summary: FLIP-456: CompiledPlan support for Batch Execution Mode Key: FLINK-35797 URL: https://issues.apache.org/jira/browse/FLINK-35797 Project: Flink Issue

Re: [VOTE] FLIP-465: Introduce DESCRIBE FUNCTION

2024-07-03 Thread Jim Hughes
Hi Natea, Looks good to me! +1 (non-binding). Cheers, Jim On Wed, Jul 3, 2024 at 3:16 PM Natea Eshetu Beshada wrote: > Sorry I forgot to include the FLIP [1] and the mailing thread discussion > link [2] in my previous email. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-

Re: [VOTE] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-07-01 Thread Jim Hughes
Hi Alexey, +1 (non-binding) I'm looking forward to parity between streaming and batch bound for compiled plans! Cheers, Jim On Mon, Jul 1, 2024 at 12:55 PM Alexey Leonov-Vendrovskiy < vendrov...@gmail.com> wrote: > Hello everyone, > > We had a good discussion of FLIP-456: CompiledPlan support

[jira] [Created] (FLINK-35725) Translate new DISTRIBUTED BY documentation into Chinese

2024-06-28 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35725: -- Summary: Translate new DISTRIBUTED BY documentation into Chinese Key: FLINK-35725 URL: https://issues.apache.org/jira/browse/FLINK-35725 Project: Flink Issue

Re: [DISCUSS] FLIP-456: Introduce DESCRIBE FUNCTION

2024-06-25 Thread Jim Hughes
Hi Natea, Looks good. As a note, in the title of this email, a number got switched! FLIP-456 is about compiled plans for batch operators. :) The link below is correct. Cheers, Jim On Tue, Jun 25, 2024 at 1:29 PM Natea Eshetu Beshada wrote: > Hello all, > > I would like to kickstart the disc

Re: [VOTE] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-21 Thread Jim Hughes
Hi Sergio, +1 (non-binding) Thanks, Jim On Fri, Jun 21, 2024 at 10:50 AM Timo Walther wrote: > +1 (binding) > > Thanks, > Timo > > > On 21.06.24 16:18, Sergio Pena wrote: > > Hi everyone, > > > > Thanks for all the feedback about FLIP-463: Schema Definition in CREATE > > TABLE AS Statement [1

Re: [DISCUSSION] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-06-17 Thread Jim Hughes
nity). BatchExecNodes can evolve quicker than StreamExecNodes as > > the state component isn't an issue. Backwards compatibility of 2-3 Flink > > versions and at least 1 year of time should be enough for batch > > infrastructure to update. Of course we should avoid breaking change

[jira] [Created] (FLINK-35585) Add documentation for distribution

2024-06-12 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35585: -- Summary: Add documentation for distribution Key: FLINK-35585 URL: https://issues.apache.org/jira/browse/FLINK-35585 Project: Flink Issue Type: Sub-task

Re: [DISCUSSION] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-06-07 Thread Jim Hughes
As I read the JavaDocs for `TableEnvironment.loadPlan`, it looks like the compiled plan ought to be sufficient to run a job at a later time. I think the FLIP should be clear on the backwards support strategy here. The strategy for streaming is "forever". This may be the most inte

Re: [VOTE] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-07 Thread Jim Hughes
HI all, +1 (non-binding) Cheers, Jim On Fri, Jun 7, 2024 at 4:03 AM Yuxin Tan wrote: > Hi everyone, > > Thanks for all the feedback about the FLIP-459 Support Flink > hybrid shuffle integration with Apache Celeborn[1]. > The discussion thread is here [2]. > > I'd like to start a vote for it.

Re: [DISCUSSION] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-05-13 Thread Jim Hughes
Hi Alexey, After some thought, I have a question about deprecations: 3. Can we remove old versions of batch operators eventually? Or do we need to keep them forever like we would for streaming operators? Cheers, Jim On Thu, May 9, 2024 at 11:29 AM Jim Hughes wrote: > Hi Ale

Re: Alignment with FlinkSQL Standards | Feedback requested

2024-05-13 Thread Jim Hughes
Hi Kanchi, One can already directly query Kafka topics using Flink SQL. The Flink Kafka connector allows one to use Kafka to back a Flink table. As a concrete example, this blog post should explain things: https://flink.apache.org/2020/07/28/flink-sql-demo-building-an-end-to-end-streaming-applic

Re: [DISCUSSION] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-05-09 Thread Jim Hughes
Hi Alexey, Overall, the FLIP looks good and makes sense to me. 1. For the testing, I'd call the tests "execution" tests rather than "restore" tests. For streaming execution, restore tests have the compiled plan and intermediate state; the tests verify that those can work together and continue pr

Re: [DISCUSS] FLIP-XXX: Introduce Flink SQL variables

2024-03-27 Thread Jim Hughes
Hi Ferenc, Looks like a good idea. I'd prefer sticking to the SQL standard if possible. Would it be possible / sensible to allow for each syntax, perhaps managed by a config setting? Cheers, Jim On Tue, Mar 26, 2024 at 6:59 AM Ferenc Csaky wrote: > Hello devs, > > I would like to start a di

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

2024-03-11 Thread Jim Hughes
Hi Jeyhun, I like the idea! Given FLIP-376[1], I wonder if it'd make sense to generalize FLIP-434 to be about "pre-divided" data to cover "buckets" and "partitions" (and maybe even situations where a data source is partitioned and bucketed). Separate from that, the page mentions TPC-H Q1 as an e

[jira] [Created] (FLINK-34173) Implement CatalogTable.Builder

2024-01-19 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-34173: -- Summary: Implement CatalogTable.Builder Key: FLINK-34173 URL: https://issues.apache.org/jira/browse/FLINK-34173 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34172) Add support for altering a distribution via ALTER TABLE

2024-01-19 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-34172: -- Summary: Add support for altering a distribution via ALTER TABLE Key: FLINK-34172 URL: https://issues.apache.org/jira/browse/FLINK-34172 Project: Flink Issue

Re: [DISCUSS] FLIP-419: Optimize multi-sink query plan generation

2024-01-16 Thread Jim Hughes
Hi Jeyhun, Generally, I like the idea of speeding up the optimizer in the case of multiple queries! I am new to the optimizer, but I have a few comments / questions. 1. StreamOptimizeContext may still be needed to pass the fact that we are optimizing a streaming query. I don't think t

[jira] [Created] (FLINK-34067) Fix javacc warnings in flink-sql-parser

2024-01-11 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-34067: -- Summary: Fix javacc warnings in flink-sql-parser Key: FLINK-34067 URL: https://issues.apache.org/jira/browse/FLINK-34067 Project: Flink Issue Type: Improvement

Re: [VOTE] FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2023-12-21 Thread Jim Hughes
Hi Alan, +1 (non binding) Cheers, Jim On Wed, Dec 20, 2023 at 2:41 PM Alan Sheinberg wrote: > Hi everyone, > > I'd like to start a vote on FLIP-400 [1]. It covers introducing a new UDF > type, AsyncScalarFunction for completing invocations asynchronously. It > has been discussed in this thre

[jira] [Created] (FLINK-33918) Fix AsyncSinkWriterThrottlingTest test failure

2023-12-20 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33918: -- Summary: Fix AsyncSinkWriterThrottlingTest test failure Key: FLINK-33918 URL: https://issues.apache.org/jira/browse/FLINK-33918 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-33805) Implement restore tests for OverAggregate node

2023-12-12 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33805: -- Summary: Implement restore tests for OverAggregate node Key: FLINK-33805 URL: https://issues.apache.org/jira/browse/FLINK-33805 Project: Flink Issue Type: Sub

Re: Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-11 Thread Jim Hughes
and I are working on. Just mentioning that ahead of time Cheers, Jim > > [1] https://issues.apache.org/jira/browse/FLINK-24204 > > > > > > > -- > > Best! > Xuyang > > > > > > At 2023-12-09 06:25:30, "Jim Hughes" wrote: > &g

Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-08 Thread Jim Hughes
Hi Xuyang, As a clarification, since FLINK-24204 is finishing up work from FLIP-145[1], do we need to discuss anything before you work out the details of FLINK-24024 as a PR? Relatedly, as that goes up for a PR, as part of FLINK-33421 [2], Bonnie and I are working through migrating some of the Js

[jira] [Created] (FLINK-33777) ParquetTimestampITCase>FsStreamingSinkITCaseBase failing in CI

2023-12-07 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33777: -- Summary: ParquetTimestampITCase>FsStreamingSinkITCaseBase failing in CI Key: FLINK-33777 URL: https://issues.apache.org/jira/browse/FLINK-33777 Project: Fl

Re: [DISCUSS] FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2023-12-06 Thread Jim Hughes
Hi Alan, Nicely written and makes sense. The only feedback I have is around the naming of the generalization, e.g. "Specifically, PythonCalcSplitRuleBase will be generalized into RemoteCalcSplitRuleBase." This naming seems to imply/suggest that all Async functions are remote. I wonder if we can

[jira] [Created] (FLINK-33767) Implement restore tests for TemporalJoin node

2023-12-06 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33767: -- Summary: Implement restore tests for TemporalJoin node Key: FLINK-33767 URL: https://issues.apache.org/jira/browse/FLINK-33767 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-33758) Implement restore tests for TemporalSort node

2023-12-05 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33758: -- Summary: Implement restore tests for TemporalSort node Key: FLINK-33758 URL: https://issues.apache.org/jira/browse/FLINK-33758 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-33757) Implement restore tests for Rank node

2023-12-05 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33757: -- Summary: Implement restore tests for Rank node Key: FLINK-33757 URL: https://issues.apache.org/jira/browse/FLINK-33757 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33756) Missing record with CUMULATE/HOP windows using an optimization

2023-12-05 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33756: -- Summary: Missing record with CUMULATE/HOP windows using an optimization Key: FLINK-33756 URL: https://issues.apache.org/jira/browse/FLINK-33756 Project: Flink

[jira] [Created] (FLINK-33676) Implement restore tests for WindowAggregate node

2023-11-28 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33676: -- Summary: Implement restore tests for WindowAggregate node Key: FLINK-33676 URL: https://issues.apache.org/jira/browse/FLINK-33676 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-33667) Implement restore tests for MatchRecognize node

2023-11-27 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33667: -- Summary: Implement restore tests for MatchRecognize node Key: FLINK-33667 URL: https://issues.apache.org/jira/browse/FLINK-33667 Project: Flink Issue Type: Sub

Re: [VOTE] FLIP-393: Make QueryOperations SQL serializable

2023-11-21 Thread Jim Hughes
+1 (non-binding) Thanks, Dawid! Jim On Tue, Nov 21, 2023 at 7:20 AM Gyula Fóra wrote: > +1 (binding) > > Gyula > > On Tue, 21 Nov 2023 at 13:11, xiangyu feng wrote: > > > +1 (non-binding) > > > > Thanks for driving this. > > > > Best, > > Xiangyu Feng > > > > > > Ferenc Csaky 于2023年11月21日周二

[jira] [Created] (FLINK-33601) Implement restore tests for Expand node

2023-11-20 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33601: -- Summary: Implement restore tests for Expand node Key: FLINK-33601 URL: https://issues.apache.org/jira/browse/FLINK-33601 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33521) Implement restore tests for PythonCalc node

2023-11-10 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33521: -- Summary: Implement restore tests for PythonCalc node Key: FLINK-33521 URL: https://issues.apache.org/jira/browse/FLINK-33521 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33488) Implement restore tests for Deduplicate node

2023-11-08 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33488: -- Summary: Implement restore tests for Deduplicate node Key: FLINK-33488 URL: https://issues.apache.org/jira/browse/FLINK-33488 Project: Flink Issue Type: Sub

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-07 Thread Jim Hughes
Hi all, +1 (non-binding) Cheers, Jim On Mon, Nov 6, 2023 at 6:39 AM Timo Walther wrote: > Hi everyone, > > I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which > has been discussed in this thread [2]. > > The vote will be open for at least 72 hours unless there is an objec

[jira] [Created] (FLINK-33470) Implement restore tests for Join node

2023-11-06 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33470: -- Summary: Implement restore tests for Join node Key: FLINK-33470 URL: https://issues.apache.org/jira/browse/FLINK-33470 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33469) Implement restore tests for Limit node

2023-11-06 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-33469: -- Summary: Implement restore tests for Limit node Key: FLINK-33469 URL: https://issues.apache.org/jira/browse/FLINK-33469 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-09-11 Thread Jim Hughes
Hi Jing and Jark! I can definitely appreciate the desire to have fewer configurations. Do you have a suggested alternative for platform providers to limit or restrict the hints that Bonnie is talking about? As one possibility, maybe one configuration could be set to control all hints. Cheers,

[jira] [Created] (FLINK-32691) SELECT fcn does not work with an unset catalog or database

2023-07-26 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-32691: -- Summary: SELECT fcn does not work with an unset catalog or database Key: FLINK-32691 URL: https://issues.apache.org/jira/browse/FLINK-32691 Project: Flink Issue

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread Jim Hughes
may contain information from the truncated table. Should this FLIP involve invalidating that information in some manner? Or does truncating a source table for a query cause undefined behavior on that query? Basically, I'm trying to think through the implementations of a truncate operation to st

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread Jim Hughes
Hi Yuxia, Two questions: 1. Are you expecting all DynamicTableSinks to support Truncate? The FLIP could use some explanation for what supporting and not supporting the operation means. 2. How will truncate inoperate with streaming queries? That is, if I truncate an input to a streaming query

Re: [DISCUSS] Add support for Apache Arrow format

2023-03-30 Thread Jim Hughes
Hi all, How do Flink formats relate to or interact with Paimon (formerly Flink-Table-Store)? If the Flink format interface is used there, then it may be useful to consider Arrow along with other columnar formats. Separately, from previous experience, I've seen the Arrow format be useful as an ou

Re: [DISCUSS] FLIP-275: Support Remote SQL Client Based on SQL Gateway

2022-11-30 Thread Jim Hughes
Hi Yu, Thanks for moving my comments to this thread! Also, thank you for answering my questions; it is helping me understand the SQL Gateway better. 5. > Our idea is to introduce a new session option (like 'sql-client.result.fetch-interval') to control the fetching requests sending frequency. Wh

Re: SQL Gateway and SQL Client

2022-11-28 Thread Jim Hughes
:) > > > Last week, I’ve discussed within my team about my design. My teammates > > think it’s better to unify the local and remote mode, so I’ve > investigated > > and redesigned a new plan. I’ll inform you after the rewriting of FLIP > > finished (will be soon) and Sh

Re: SQL Gateway and SQL Client

2022-11-21 Thread Jim Hughes
Overall, the PRs I see look pretty good. Are they going to be merged soon? Anything else I can do to help? Cheers, Jim On Mon, Nov 14, 2022 at 12:52 PM Jim Hughes wrote: > Hi Yu, > > The PR looks good to me; the only thing I noticed is that the > RemoveJarOperation may need to be

Re: SQL Gateway and SQL Client

2022-11-14 Thread Jim Hughes
/apache/flink/table/gateway/rest/handler/AbstractSqlGatewayRestHandler.java#L98 > > Jim Hughes 于2022年11月12日周六 00:45写道: > > > Hi Shengkai, > > > > I think there is an additional case where a proxy is between the client > and > > gateway. In that case, being able to pass head

Re: SQL Gateway and SQL Client

2022-11-14 Thread Jim Hughes
3, 2022 at 10:45 PM yu zelin wrote: > Hi Jim, > > It would be nice if you can take a look on > https://github.com/apache/flink/pull/21133 and give me some feedback. > > Best, > Yu Zelin > > > 2022年11月12日 00:44,Jim Hughes 写道: > > > > Hi Shengkai, > >

Re: SQL Gateway and SQL Client

2022-11-11 Thread Jim Hughes
an join us to finish the feature. I think the > modification about the SQL Gateway side is ready to review. > > Best, > Shengkai > > > Jim Hughes 于2022年11月11日周五 05:19写道: > > > Hi Yu Zelin, > > > > I have read through your draft and it looks good. I am new

Re: SQL Gateway and SQL Client

2022-11-10 Thread Jim Hughes
Hi Yu Zelin, I have read through your draft and it looks good. I am new to Flink, so I haven't learned about everything which needs to be done yet. One of the considerations that I'm interested in understanding is how to pass additional headers when sending REST requests. From looking at the co