RocMarshal created FLINK-33386:
--
Summary: Introduce the strategy for Default Scheduler to pursue
tasks balancing based on slots level.
Key: FLINK-33386
URL: https://issues.apache.org/jira/browse/FLINK-33386
RocMarshal created FLINK-33387:
--
Summary: Introduce the abstraction and the interface about loading
Key: FLINK-33387
URL: https://issues.apache.org/jira/browse/FLINK-33387
Project: Flink
Issue T
RocMarshal created FLINK-33388:
--
Summary: Implement slots to taskmanagers balancing for the Default
Scheduler
Key: FLINK-33388
URL: https://issues.apache.org/jira/browse/FLINK-33388
Project: Flink
RocMarshal created FLINK-33389:
--
Summary: Introduce the assigner for Adaptive Scheduler to pursuit
task balancing based slots level
Key: FLINK-33389
URL: https://issues.apache.org/jira/browse/FLINK-33389
RocMarshal created FLINK-33390:
--
Summary: Support slot balancing at TM level for Adaptive Scheduler
Key: FLINK-33390
URL: https://issues.apache.org/jira/browse/FLINK-33390
Project: Flink
Issue T
RocMarshal created FLINK-33391:
--
Summary: Support tasks balancing at TM level for Adaptive Scheduler
Key: FLINK-33391
URL: https://issues.apache.org/jira/browse/FLINK-33391
Project: Flink
Issue
RocMarshal created FLINK-33392:
--
Summary: Add the documentation page for balanced tasks scheduling
Key: FLINK-33392
URL: https://issues.apache.org/jira/browse/FLINK-33392
Project: Flink
Issue Ty
蔡灿材 created FLINK-33393:
---
Summary: flink document description error
Key: FLINK-33393
URL: https://issues.apache.org/jira/browse/FLINK-33393
Project: Flink
Issue Type: Improvement
Components:
Sergey Nuyanzin created FLINK-33394:
---
Summary: DataGeneratorSourceITCase.testGatedRateLimiter fails on
AZP
Key: FLINK-33394
URL: https://issues.apache.org/jira/browse/FLINK-33394
Project: Flink
xuyang created FLINK-33395:
--
Summary: The join hint doesn't work when appears in subquery
Key: FLINK-33395
URL: https://issues.apache.org/jira/browse/FLINK-33395
Project: Flink
Issue Type: Bug
xuyang created FLINK-33396:
--
Summary: The table alias when using join hints should be removed
in the final plan
Key: FLINK-33396
URL: https://issues.apache.org/jira/browse/FLINK-33396
Project: Flink
Thanks for the improvements, Jiabao.
There are some details that I am not sure about.
1. The new option `source.filter-push-down.enabled` will be added to which
class? I think it should be `SourceReaderOptions`.
2. How are the connector developers able to know and follow the FLIP? Do we
need an ab
Jane Chan created FLINK-33397:
-
Summary: FLIP-373: Support Configuring Different State TTLs using
SQL Hint
Key: FLINK-33397
URL: https://issues.apache.org/jira/browse/FLINK-33397
Project: Flink
Hi Jark,
my intention was to avoid too complex syntax in the first version. In
the past years, we could enable use cases also without this clause, so
we should be careful with overloading it with too functionality in the
first version. We can still iterate on it later, the interfaces are
flex
Hi Yunfan and Benchao,
it seems the FLIP discussion thread got split into two parts. At least
this is what I see in my mail program. I would kindly ask to answer in
the other thread [1].
I will also reply there now to maintain the discussion link.
Regards,
Timo
[1] https://lists.apache.org/
Let me reply to the feedback from Yunfan:
> Distribute by in DML is also supported by Hive
I see DISTRIBUTED BY and DISTRIBUTE BY as two separate discussions. This
discussion is about DDL. For DDL, we have more freedom as every vendor
has custom syntax for CREATE TABLE clauses. Furthermore, th
+1 (non-binding)
- Verified Singatures
- Verified Checksum
- Build source successfully
- Checked release tag exists
- Reviewed the web PR
Best Regards
Ahmed Hamdy
On Sun, 29 Oct 2023 at 08:02, Leonard Xu wrote:
> +1 (binding)
>
> - Verified signatures
> - Verified hashsums
> - Checked Github re
Xuannan Su created FLINK-33398:
--
Summary: Support switching from batch to stream mode for one input
stream operator
Key: FLINK-33398
URL: https://issues.apache.org/jira/browse/FLINK-33398
Project: Flink
Xuannan Su created FLINK-33399:
--
Summary: Support switching from batch to stream mode for
KeyedCoProcessOperator and IntervalJoinOperator
Key: FLINK-33399
URL: https://issues.apache.org/jira/browse/FLINK-33399
Hi everyone,
I would like to +1 Gordon's proposal to close FLINK-30238, create a
new follow-up ticket and try to address the specific
PostCommitTopology in the work that's currently being done by Peter on
SinkV2. If there's no feedback on this topic, I assume everyone's OK
with that.
Best regards
Hello all,
I would like to start the discussion to release Apache Flink AWS connectors
v4.2.0. We released v4.1.0 over six months ago on 2023-04-03. Since then we
have resolved 23 issues [1]. Additionally now Flink 1.18 is live we need to
add support for this. I am proposing we skip 4.1.0 for Flin
The Apache Flink community is very happy to announce the release of Apache
Flink Kubernetes Operator 1.6.1.
Please check out the release blog post for an overview of the release:
https://flink.apache.org/2023/10/27/apache-flink-kubernetes-operator-1.6.1-release-announcement/
The release is availa
Thank you Rui for taking care of this!
On Mon, Oct 30, 2023 at 11:55 AM Rui Fan <1996fan...@gmail.com> wrote:
> The Apache Flink community is very happy to announce the release of Apache
> Flink Kubernetes Operator 1.6.1.
>
> Please check out the release blog post for an overview of the release:
Hi Tawfek,
> The idea is to generate a watermark for each key (sub-stream), in order
to avoid the fast progress of the global watermark which affects low-rate
sources.
Let's consider the sensors example from the paper. Shouldn't it be about
the delay between the time of taking the measurement and
Hi Timo,
The FLIP looks great! Thanks for bringing it to our attention! In order to
make sure we are on the same page, I would ask some questions:
1. DISTRIBUTED BY reminds me DISTRIBUTE BY from Hive like Benchao mentioned
which is used to distribute rows amond reducers, i.e. focusing on the
shuf
Martijn Visser created FLINK-33400:
--
Summary: Pulsar connector doesn't compile for Flink 1.18 due to
Archunit update
Key: FLINK-33400
URL: https://issues.apache.org/jira/browse/FLINK-33400
Project: F
Hi Alexander,
Thank you for your reply.
Yes. As you showed keyed-watermarks mechanism is mainly required for the case
when we need a fine-grained calculation for each partition
[Calculation over data produced by each individual sensor], as scalability
factors require partitioning the calculatio
Hi Danny,
+1 Thanks for driving it. Did you mean skip 4.1.1, since 4.1.0 has already
been released?
Best regards,
Jing
On Mon, Oct 30, 2023 at 11:49 AM Danny Cranmer
wrote:
> Hello all,
>
> I would like to start the discussion to release Apache Flink AWS connectors
> v4.2.0. We released v4.1.0
+1 (non-binding)
- Verified signatures
- Verified Checksum
- Build with Java 8 /11 - build success
- Started MSK cluster and EMR cluster with flink, successfully ran some
examples to read and write data to MSK.
- Checked release tag exists
Bests,
Samrat
On Mon, Oct 30, 2023 at 3:47 PM Ahmed Ham
Pavel Khokhlov created FLINK-33401:
--
Summary: Kafka connector has broken version
Key: FLINK-33401
URL: https://issues.apache.org/jira/browse/FLINK-33401
Project: Flink
Issue Type: Bug
Hi Danny ,
Thank you for driving it.
+1 (non binding )
> I am proposing we skip 4.1.0 for Flink 1.18 and go
straight to 4.2.0.
Does this imply that the 4.1.x series will be reserved for Flink 1.17, and
the 4.2.x series will correspond to Flink 1.18?
Bests,
Samrat
On Mon, Oct 30, 2023 at 7:
Thanks Hang for the suggestion.
I think the configuration of TableSource is not closely related to
SourceReader,
so I prefer to introduce a independent configuration class TableSourceOptions
in the flink-table-common module, similar to LookupOptions.
For the second point, I suggest adding Jav
Hey,
> Did you mean skip 4.1.1, since 4.1.0 has already been released?
I meant skip "4.1.0-1.18" since we could release this with the existing
source. We will additionally skip 4.1.1 and jump to 4.2.0 since this
version has features it should be a minor version rather than a patch [1].
> Does th
+1 (binding)
- Hashes and checksums
- Build succeeds against 1.18.0: mvn clean install -Dflink.version=1.18.0
- Verified that memory leak issue is fixed for idle topics. Tested against
Flink 1.18.0 cluster.
Thanks,
Gordon
On Mon, Oct 30, 2023 at 8:20 AM Samrat Deb wrote:
> +1 (non-binding)
>
+1
On Mon, Oct 30, 2023 at 9:00 AM Danny Cranmer
wrote:
> Hey,
>
> > Did you mean skip 4.1.1, since 4.1.0 has already been released?
>
> I meant skip "4.1.0-1.18" since we could release this with the existing
> source. We will additionally skip 4.1.1 and jump to 4.2.0 since this
> version has fe
Hi Jing,
> Have you considered using BUCKET BY directly?
Which vendor uses this syntax? Most vendors that I checked call this
concept "distribution".
In any case, the "BY" is optional, so certain DDL statements would
declare it like "BUCKET INTO 6 BUCKETS"? And following the PARTITIONED,
we
+1 (non-binding)
* Verified hashes and checksums
* Built from source
* Checked release tag
* Reviewed the web PR
On Mon, Oct 30, 2023 at 5:13 PM Tzu-Li (Gordon) Tai
wrote:
> +1 (binding)
>
> - Hashes and checksums
> - Build succeeds against 1.18.0: mvn clean install -Dflink.version=1.18.0
> - Ve
Hello! I took a look at FLINK-33045, which is somewhat related: In
that improvement, the author wants to control who registers schemas.
The Flink job would know the Avro schema to use, and would look up the
ID to use in framing the Avro binary. It uses but never changes the
schema registry.
Here
(Note: You are receiving this because you are subscribed to the dev@
list for one or more projects of the Apache Software Foundation.)
It's back *and* it's new!
We're excited to announce that the first edition of Community over
Code Europe (formerly known as ApacheCon EU) which will be held at th
Thanks for your proposal, Zhanghao Chen. I think it adds more transparency
to the configuration documentation.
+1 from my side on the proposal
On Wed, Oct 11, 2023 at 2:09 PM Zhanghao Chen
wrote:
> Hi Flink users and developers,
>
> Currently, Flink won't generate doc for the deprecated options
+1 (non-binding)
* Verified hashes and signatures
* Verified no binaries
* Verified poms point to 3.0.1
* Reviewed web PR
* Built from source
* Verified git tag
@Xianxun, good catch. The datastream docs should be automatically updated
via the doc shortcode. However, it seems that the sql connecto
Hi all!
I would like to kick off the release planning for the operator 1.7.0
release. We have added quite a lot of new functionality over the last few
weeks and I think the operator is in a good state to kick this off.
Based on the original release schedule we had Nov 1 as the proposed feature
fr
I submitted PR to fix it since I was looking at the Kafka code already:
https://github.com/apache/flink-connector-kafka/pull/63
On Mon, Oct 30, 2023 at 12:19 PM Mason Chen wrote:
> +1 (non-binding)
>
> * Verified hashes and signatures
> * Verified no binaries
> * Verified poms point to 3.0.1
> *
Thanks for the catch on the docs and fixing it, Xianxun and Mason!
On Mon, Oct 30, 2023 at 12:36 PM Mason Chen wrote:
> I submitted PR to fix it since I was looking at the Kafka code already:
> https://github.com/apache/flink-connector-kafka/pull/63
>
> On Mon, Oct 30, 2023 at 12:19 PM Mason Che
I'm happy to announce that we have unanimously approved this release.
There are 10 approving votes, 4 of which are binding:
* Qingsheng Ren (binding)
* Martijn Visser (binding)
* Xianxun Ye
* Mystic Lama
* Leonard Xu (binding)
* Ahmed Hamdy
* Samrat Deb
* Tzu-Li (Gordon) Tai (binding)
* Sergey Nuy
Varun Narayanan Chakravarthy created FLINK-33402:
Summary: Hybrid Source Concurrency Race Condition Fixes and
Related Bugs
Key: FLINK-33402
URL: https://issues.apache.org/jira/browse/FLINK-33402
Hi Jiabao and Ruanhang,
Adding a configuration of source.filter-push-down.enabled as a common
source configuration seems problematic.
1. The config name is misleading. filter pushdown should only be determined
by whether the SupportsFilterPushdown interface is implemented or not.
2. The behavior o
Hi Martijn and Gordon,
Very sorry for the very late reply, +1 for close FLINK-30238 and open
dedicated issues
for the remaining issues.
Best,
Yun
On Mon, Oct 30, 2023 at 6:42 PM Martijn Visser wrote:
>
> Hi everyone,
>
> I would like to +1 Gordon's proposal to close FLINK-30238, create a
> new
Rui Fan created FLINK-33403:
---
Summary: Bump flink version to 1.18.0 for flink-kubernetes-operator
Key: FLINK-33403
URL: https://issues.apache.org/jira/browse/FLINK-33403
Project: Flink
Issue Type:
Thanks Becket for the feedback.
1. Currently, the SupportsFilterPushDown#applyFilters method returns a result
that includes acceptedFilters and remainingFilters. The source can decide to
push down some filters or not accept any of them.
2. Introducing common configuration options does not mean t
Hi Becket,
Sorry, there was a typo in the second point. Let me correct it:
Introducing common configurations does not mean that all sources must accept
these configuration options.
The configuration options supported by a source are determined by the
requiredOptions and optionalOptions in the
Jaehyeon Kim created FLINK-33404:
Summary: on_timer method is missing in ProcessFunction and
CoProcessFunction of Pyflink
Key: FLINK-33404
URL: https://issues.apache.org/jira/browse/FLINK-33404
Projec
Jaehyeon Kim created FLINK-33405:
Summary: ProcessJoinFunction not found in Pyflink
Key: FLINK-33405
URL: https://issues.apache.org/jira/browse/FLINK-33405
Project: Flink
Issue Type: Improvem
Hi Devs,
Currently, Flink Avro Format doesn't support the Avro time (milli/micros)
with local timezone type.
Although the Avro timestamp (millis/micros) type is supported and is mapped
to flink timestamp without timezone,
it is not compliant to semantics defined in Consistent timestamp types in
Ha
Thanks @Peter for driving this FLIP
+1 from my side, the timestamp semantics mapping looks good to me.
> In the end, the legacy behavior will be dropped in
> Flink 2.0
> I don’t think we can drop this option which introduced in 1.19 and drop in
> 2.0, the API removal requires at least two minor
+1, thanks Dany for driving this.
One related question, do we have plan to find some volunteers to release rest
external connectors for 1.18 support?
Best,
Leonard
> 2023年10月31日 上午12:17，Tzu-Li (Gordon) Tai 写道：
>
> +1
>
> On Mon, Oct 30, 2023 at 9:00 AM Danny Cranmer
> wrote:
>
>> Hey,
>>
Hi Jiabao,
Please see the replies inline.
Introducing common configurations does not mean that all sources must
> accept these configuration options.
> The configuration options supported by a source are determined by the
> requiredOptions and optionalOptions in the Factory interface.
This is no
Hi Timo,
Thank you for the update. The FLIP looks good to me now.
I only have one more question.
What does Flink check and throw exceptions for the bucketing?
For example, do we check interfaces when executing create/alter
DDL and when used as a source?
Best,
Jark
On Tue, 31 Oct 2023 at 00:25,
Deng Liwen created FLINK-33406:
--
Summary: Flink Job failed due to losing connection from ZK server
Key: FLINK-33406
URL: https://issues.apache.org/jira/browse/FLINK-33406
Project: Flink
Issue Ty
59 matches
Mail list logo
