Thanks for driving the release, Jingsong!
I only have one comment about the versions on the GitHub source code
which I don't think needs another RC.
- Checked all POM files point to the same version: *Action Required*
* Source code under release-0.2.1-rc2 tag on GitHub[1] is still
0.2-SNAPSHOT
Jiang Xin created FLINK-29592:
-
Summary: Add Transformer and Estimator for RobustScaler
Key: FLINK-29592
URL: https://issues.apache.org/jira/browse/FLINK-29592
Project: Flink
Issue Type: New Feat
Hi everyone! What is the status of this FLIP? I am really interested
in moving this forward.
Best regards,
Sergey
On 2022/01/04 07:04:01 Dong Lin wrote:
> Hi all,
>
> We created FLIP-208: Update KafkaSource to detect EOF based on
> de-serialized records. Please find the KIP wiki in the link
> htt
+1 from me, thanks for the clarification.
On Wed, Oct 12, 2022 at 7:57 AM Péter Váry
wrote:
> Thanks Abid,
>
> Count me in, and drop a note, if I can help in any way.
>
> Thanks,
> Peter
>
> On Tue, Oct 11, 2022, 20:13 wrote:
>
> > Hi Martijn,
> >
> > Yes catalog integration exists and catalogs
Jiang Xin created FLINK-29593:
-
Summary: Add Approximate Quantile Util
Key: FLINK-29593
URL: https://issues.apache.org/jira/browse/FLINK-29593
Project: Flink
Issue Type: Sub-task
Compon
Matthias Pohl created FLINK-29594:
-
Summary: RMQSourceITCase.testMessageDelivery timed out
Key: FLINK-29594
URL: https://issues.apache.org/jira/browse/FLINK-29594
Project: Flink
Issue Type: B
Hi everyone! What is the status of this FLIP? I am really interested
in moving this forward
Best regards,
Sergey
On 2022/01/04 07:04:01 Dong Lin wrote:
> Hi all,
>
> We created FLIP-208: Update KafkaSource to detect EOF based on
> de-serialized records. Please find the KIP wiki in the link
> http
There's no alternative to Kryo for generic types, apart from
implementing your Flink serializer (but technically at that point the
type is no longer treated as a generic type).
enableForAvro only forces Avro to be used for POJO types.
On 11/10/2022 09:29, Sucheth S wrote:
Hello,
How to avoid
Yunfeng Zhou created FLINK-29595:
Summary: Add Estimator and Transformer for ChiSqSelector
Key: FLINK-29595
URL: https://issues.apache.org/jira/browse/FLINK-29595
Project: Flink
Issue Type: N
Yunfeng Zhou created FLINK-29596:
Summary: Add Estimator and Transformer for RFormula
Key: FLINK-29596
URL: https://issues.apache.org/jira/browse/FLINK-29596
Project: Flink
Issue Type: New Fe
Hi, community.
I have done some research about FLIP-208 before. I am looking forward to help
to complete this FLIP and take this ticket.
Best regards,
Hang
发件人: Sergey Troshkov
发送时间: 2022年10月12日 17:04
收件人: dev@flink.apache.org
主题: RE: [DISCUSS] FLIP-208: Updat
Yunfeng Zhou created FLINK-29597:
Summary: Add Estimator and Transformer for QuantileDiscretizer
Key: FLINK-29597
URL: https://issues.apache.org/jira/browse/FLINK-29597
Project: Flink
Issue T
Yunfeng Zhou created FLINK-29598:
Summary: Add Estimator and Transformer for Imputer
Key: FLINK-29598
URL: https://issues.apache.org/jira/browse/FLINK-29598
Project: Flink
Issue Type: New Fea
Yunfeng Zhou created FLINK-29599:
Summary: Add Estimator and Transformer for MinHashLSH
Key: FLINK-29599
URL: https://issues.apache.org/jira/browse/FLINK-29599
Project: Flink
Issue Type: New
Yunfeng Zhou created FLINK-29601:
Summary: Add Estimator and Transformer for
UnivariateFeatureSelector
Key: FLINK-29601
URL: https://issues.apache.org/jira/browse/FLINK-29601
Project: Flink
Yunfeng Zhou created FLINK-29600:
Summary: Add Estimator and Transformer for
BucketedRandomProjectionLSH
Key: FLINK-29600
URL: https://issues.apache.org/jira/browse/FLINK-29600
Project: Flink
Yunfeng Zhou created FLINK-29603:
Summary: Add Transformer for StopWordsRemover
Key: FLINK-29603
URL: https://issues.apache.org/jira/browse/FLINK-29603
Project: Flink
Issue Type: New Feature
Yunfeng Zhou created FLINK-29602:
Summary: Add Transformer for SQLTransformer
Key: FLINK-29602
URL: https://issues.apache.org/jira/browse/FLINK-29602
Project: Flink
Issue Type: New Feature
Yunfeng Zhou created FLINK-29604:
Summary: Add Estimator and Transformer for CountVectorizer
Key: FLINK-29604
URL: https://issues.apache.org/jira/browse/FLINK-29604
Project: Flink
Issue Type:
Thanks Yu,
FLINK-29554 has been adjusted.
Thanks Jark,
I updated the tag of rc2. This is a process problem. I have updated [1].
[1]
https://cwiki.apache.org/confluence/display/FLINK/Creating+a+Flink+Table+Store+Release
Best,
Jingsong
On Wed, Oct 12, 2022 at 3:10 PM Jark Wu wrote:
>
> Thanks
+1 (binding)
- Checked sums and signatures: *OK*
- Checked the jars in the staging repo: *OK*
- Checked source distribution doesn't include binaries: *OK*
- Maven clean install from source: *OK*
Best,
Jingsong
On Wed, Oct 12, 2022 at 6:10 PM Jingsong Li wrote:
>
> Thanks Yu,
>
> FLINK-29554 has
Thanks Chesnay for the reply. +1 for making a unified and clearer
metric definition distinguishing internal and external data transfers.
As you described, having IO in operators is quite common such as
dimension tables in Table/SQL API. This definitely deserves a FLIP and
an overall design.
Howeve
As a supplement, considering it could be a big reconstruction
redefining internal and external traffic and touching metric names in
almost all operators, this requires a lot of discussions and we might
do it finally in Flink 2.0. I think compatibility is a bigger blocker
in front of us, as the outp
Etienne Chauchot created FLINK-29605:
Summary: Create a bounded version of
SourceTestSuiteBase#testSourceMetrics
Key: FLINK-29605
URL: https://issues.apache.org/jira/browse/FLINK-29605
Project: Fl
Hi Qingsheng,
Just want to make sure we are on the same page. Are you suggesting
switching the naming between "numXXXSend" and "numXXXOut" or reverting all
the changes we did with FLINK-26126 and FLINK-26492?
For the naming switch, please pay attention that the behaviour has been
changed since we
Hamid EL MAAZOUZ created FLINK-29606:
Summary: Dynamic Execution Environment
Key: FLINK-29606
URL: https://issues.apache.org/jira/browse/FLINK-29606
Project: Flink
Issue Type: New Feature
Gyula Fora created FLINK-29607:
--
Summary: Simplify controller flow by introducing
FlinkControllerContext
Key: FLINK-29607
URL: https://issues.apache.org/jira/browse/FLINK-29607
Project: Flink
I
王伟 created FLINK-29608:
--
Summary: 使用 pyflink1.17dev datastream 经过reduce 后
add_sink(FlinkKafkaProducer()) 有问题
Key: FLINK-29608
URL: https://issues.apache.org/jira/browse/FLINK-29608
Project: Flink
Iss
Thanks for raising the discussion, Qingsheng,
+1 on reverting the breaking changes.
+1 for making a unified and clearer metric definition in Flink 2.0
Best,
Hang
发件人: Jing Ge
发送时间: 2022年10月12日 19:20
收件人: Qingsheng Ren
抄送: Chesnay Schepler ; dev ; user
; Martij
+1, I have used the iceberg connector and catalog before. It is easy to use.
Márton Balassi 于2022年10月12日周三 16:38写道：
> +1 from me, thanks for the clarification.
>
> On Wed, Oct 12, 2022 at 7:57 AM Péter Váry
> wrote:
>
> > Thanks Abid,
> >
> > Count me in, and drop a note, if I can help in any w
Dear Flink developers,
I would like to start a discussion thread on FLIP-263[1] proposing to
improve the usability of resolving schema compatibility.
Currently, the place for compatibility checks is
TypeSerializerSnapshot#resolveSchemaCompatibility
which belongs to the old serializer, There are n
Since the discussion
(https://lists.apache.org/thread/mpzzlpob9ymkjfybm96vz2y2m5fjyvfo) has
stalled a bit but we need a conclusion to move forward I'm opening a vote.
Proposal summary:
1) Branch model
1.1) The default branch is called "main" and used for the next major
iteration.
1.2) Remain
Gyula Fora created FLINK-29609:
--
Summary: Clean up jobmanager deployment on suspend after recording
savepoint info
Key: FLINK-29609
URL: https://issues.apache.org/jira/browse/FLINK-29609
Project: Flink
Hi Devs!
I would like to start a discussion about referencing the Flink Kubernetes
Operator directly from the Flink Kubernetes deployment documentation.
Currently the Flink deployment/resource provider docs provide some
information for the Standalone and Native Kubernetes integration without
any
I don't see a reason for why we shouldn't at least mention the operator
in the kubernetes docs.
On 12/10/2022 16:25, Gyula Fóra wrote:
Hi Devs!
I would like to start a discussion about referencing the Flink Kubernetes
Operator directly from the Flink Kubernetes deployment documentation.
Curre
Hi everyone,
I'd like to propose adding client.id.prefix to the KafkaSink to mirror the
functionality provided by the KafkaSource.
Defining client.id is very important when running workloads with many
different Kafka clients: they help with identification and enforcing
quotas. Due to the specific
Hi Hangxiang,
Thanks for driving this. It is reasonable to let the new serializer
claim its compatibility with the old serializer. However, I think
there is a little confusion as you described in your proposed change
'Step 1'. You mean that we let the new serializer check the
compatibility first,
I have some flink applications that read streams from Kafka, now
the producer side code has introduced some additional information in Kafka
headers while producing records.
Now I need to change my consumer-side logic to process the records if the
header contains a specific value, if the header valu
+1 from me, let's open a VOTE thread to make this official.
On Wed, Oct 12, 2022 at 1:37 PM Hang Ruan wrote:
> +1, I have used the iceberg connector and catalog before. It is easy to
> use.
>
> Márton Balassi 于2022年10月12日周三 16:38写道：
>
> > +1 from me, thanks for the clarification.
> >
> > On Wed
Thanks for the concise summary Chesnay.
+1 from me (binding)
Just one clarification, for "3.1) The Flink versions supported by the
project (last 2 major Flink versions) must be supported.". Do we actually
mean major here, as in Flink 1.x.x and 2.x.x? Right now we would only
support Flink 1.15.x a
Hi,
You can implement a custom KafkaRecordDeserializationSchema (example
https://docs.immerok.cloud/docs/cookbook/reading-apache-kafka-headers-with-apache-flink/#the-custom-deserializer)
and just avoid emitting the record if the header value matches what you
need.
On Wed, Oct 12, 2022 at 11:04 AM
Hi everyone,
Thanks again for all your feedback. It's very much appreciated.
My overall feeling is that people are not opposed to the FLIP. There is
demand for adding Java 17 support before dropping the Scala APIs. Given
that the proposal for actually dropping the Scala APIs would only happen
wit
Hi everyone,
Since no comments were made, I'm opening a vote to remove the HCatalog
connector [1]
The voting period will be open at least 72hrs.
Best regards,
Martijn
[1]
https://lists.apache.org/thread/j8jc5zrhnqlv8y3lkmc3wdo9ysgmsr84
--
Martijn
https://twitter.com/MartijnVisser82
https://gi
+1 (binding), I am indeed assuming that Chesnay meant the last two minor
versions as supported.
Op wo 12 okt. 2022 om 20:18 schreef Danny Cranmer
> Thanks for the concise summary Chesnay.
>
> +1 from me (binding)
>
> Just one clarification, for "3.1) The Flink versions supported by the
> project
+1 from my side (non-binding)
Best,
F
--- Original Message ---
On Wednesday, October 12th, 2022 at 15:47, Martijn Visser
wrote:
>
>
> +1 (binding), I am indeed assuming that Chesnay meant the last two minor
> versions as supported.
>
> Op wo 12 okt. 2022 om 20:18 schreef Danny Cra
Hi everyone,
I'm reviving this really old discussion thread, but I just stumbled across
Gelly again and realized that this discussion never was finished.
I'll open up a vote thread for dropping the current DataSet based Gelly
library.
Best regards,
Martijn
On 2022/01/05 03:37:18 Yun Gao wr
Hi everyone,
I would like to open a vote for dropping Gelly, which was discussed a long
time ago but never put to a vote [1].
Voting will be open for at least 72 hours.
Best regards,
Martijn
https://twitter.com/MartijnVisser82
https://github.com/MartijnVisser
[1] https://lists.apache.org/threa
Hi Yaroslav,
+1 from my end. Thanks for bringing this up!
Best regards,
Martijn
On Wed, Oct 12, 2022 at 6:34 PM Yaroslav Tkachenko
wrote:
> Hi everyone,
>
> I'd like to propose adding client.id.prefix to the KafkaSink to mirror the
> functionality provided by the KafkaSource.
>
> Defining cli
+1 from my end to include the operator in the related Kubernetes sections
of the Flink docs
On Wed, Oct 12, 2022 at 5:31 PM Chesnay Schepler wrote:
> I don't see a reason for why we shouldn't at least mention the operator
> in the kubernetes docs.
>
> On 12/10/2022 16:25, Gyula Fóra wrote:
> > H
With the model of externalized Flink connector repo (which I fully
support), there is one challenge of supporting versions of two upstream
projects (similar to what Peter Vary mentioned earlier).
E.g., today the Flink Iceberg connector lives in Iceberg repo. We have
separate modules 1.13, 1.14, 1.
+1
On Wed, Oct 12, 2022 at 5:03 PM Martijn Visser
wrote:
> +1 from my end to include the operator in the related Kubernetes sections
> of the Flink docs
>
> On Wed, Oct 12, 2022 at 5:31 PM Chesnay Schepler
> wrote:
>
> > I don't see a reason for why we shouldn't at least mention the operator
>
"Branches are not specific to a Flink version. (i.e., no v3.2-1.15)"
Sorry for the late question. I could not find in the discussion thread how
a connector can make use of features of the latest Flink version that were
not present in the previous Flink version, when branches cannot be Flink
versio
Hi,
Just to double check: while I believe most Iceberg content refers to
Iceberg as a format, it's considered as a connector in Flink terms, right?
So there is no 'format' option to specify.
And one more question: is there a specific goal or reason why you would
want to contribute this to Flink i
+1
Thanks for driving.
Best,
Jingsong
On Thu, Oct 13, 2022 at 3:46 AM Martijn Visser wrote:
>
> Hi everyone,
>
> Since no comments were made, I'm opening a vote to remove the HCatalog
> connector [1]
>
> The voting period will be open at least 72hrs.
>
> Best regards,
>
> Martijn
>
> [1]
> http
I'm happy to announce that we have unanimously approved this release.
There are 3 approving votes, 3 of which are binding:
* Yu Li (binding)
* Jark Wu (binding)
* Jingsong Lee (binding)
There are no disapproving votes.
Thank you for verifying the release candidate. I will now proceed to
finalize
Jiale Tan created FLINK-29610:
-
Summary: Infinite timeout is used in SavepointHandlers calls to
RestfulGateway
Key: FLINK-29610
URL: https://issues.apache.org/jira/browse/FLINK-29610
Project: Flink
+1,
Best,
Hang
Jingsong Li 于2022年10月13日周四 10:09写道：
> +1
>
> Thanks for driving.
>
> Best,
> Jingsong
>
> On Thu, Oct 13, 2022 at 3:46 AM Martijn Visser
> wrote:
> >
> > Hi everyone,
> >
> > Since no comments were made, I'm opening a vote to remove the HCatalog
> > connector [1]
> >
> > The vot
The Apache Flink community is very happy to announce the release of
Apache Flink Table Store 0.2.1.
Apache Flink Table Store is a unified storage to build dynamic tables
for both streaming and batch processing in Flink, supporting
high-speed data ingestion and timely data query.
Please check out
+1 (non-binding)
Thanks for driving.
Best regards,
Yuxia
- 原始邮件 -
发件人: "Hang Ruan"
收件人: "dev"
发送时间: 星期四, 2022年 10 月 13日 上午 10:16:46
主题: Re: [VOTE] Remove HCatalog connector
+1,
Best,
Hang
Jingsong Li 于2022年10月13日周四 10:09写道：
> +1
>
> Thanks for driving.
>
> Best,
> Jingsong
>
> On T
Congratulations Danny!
Best,
Yun Gao
--
From:yuxia
Send Time:2022 Oct. 12 (Wed.) 09:49
To:dev
Subject:Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer
Congratulations Danny!
Best regards,
Yuxia
- 原始邮件 -
发件人: "Xingbo
+1
Best,
Yun Gao
--
From:Martijn Visser
Send Time:2022 Oct. 13 (Thu.) 04:59
To:dev
Subject:[VOTE] Drop Gelly
Hi everyone,
I would like to open a vote for dropping Gelly, which was discussed a long
time ago but never put to a vote [1]
Congratulations Danny!
Best,
Hang
Yun Gao 于2022年10月13日周四 10:56写道：
> Congratulations Danny!
> Best,
> Yun Gao
> --
> From:yuxia
> Send Time:2022 Oct. 12 (Wed.) 09:49
> To:dev
> Subject:Re: [ANNOUNCE] New Apache Flink PMC Member -
+1, thanks to drive it
Abid Mohammed 于2022年10月10日周一 09:22写道：
> Hi,
>
> I would like to start a discussion about contributing Iceberg Flink
> Connector to Flink.
>
> I created a doc <
> https://docs.google.com/document/d/1WC8xkPiVdwtsKL2VSPAUgzm9EjrPs8ZRjEtcwv93ISI/edit?usp=sharing>
> with all th
Hi Hangxiang,
Thanks for raising the discussion, +1 for reversing the direction of
resolving schema compatibility.
As you described, in 'Step 1', Typeserializer#resolveSchemaCompatibility
will return TYPE.INCOMPATIBLE default,
Typeserializer#resolveSchemaCompatibility is a default method; in 'St
Sopan Phaltankar created FLINK-29611:
Summary: Fix flaky tests in CoBroadcastWithNonKeyedOperatorTest
Key: FLINK-29611
URL: https://issues.apache.org/jira/browse/FLINK-29611
Project: Flink
+1
On Thu, 13 Oct 2022 at 04:56, Yun Gao wrote:
> +1
> Best,
> Yun Gao
> --
> From:Martijn Visser
> Send Time:2022 Oct. 13 (Thu.) 04:59
> To:dev
> Subject:[VOTE] Drop Gelly
> Hi everyone,
> I would like to open a vote for dropping
+1
On Thu, 13 Oct 2022 at 04:53, yuxia wrote:
> +1 (non-binding)
> Thanks for driving.
>
> Best regards,
> Yuxia
>
> - 原始邮件 -
> 发件人: "Hang Ruan"
> 收件人: "dev"
> 发送时间: 星期四, 2022年 10 月 13日 上午 10:16:46
> 主题: Re: [VOTE] Remove HCatalog connector
>
> +1,
>
> Best,
> Hang
>
> Jingsong Li 于20
Hi Martijn,
>From the last replies of the previous discussion, I could see there are
still users using Gelly that expressed their wish to somehow keep this
module [1] [2] [3]. Therefore, Before giving my vote, I'd like to
confirm what "Drop Gelly" exactly means. Does it mean that 1) we remove the
Hi all,
I’m Alexey from Confluent. This is my first email in this discussion list.
I’m rather new to Flink, and to local customs of communication. I want to
dive deeper and hopefully get more involved over time.
Currently I have a few questions around SQL Gateway and SQL Client.
Specifically I wa
Caizhi Weng created FLINK-29612:
---
Summary: Extract changelog files out of DataFileMeta#extraFiles
Key: FLINK-29612
URL: https://issues.apache.org/jira/browse/FLINK-29612
Project: Flink
Issue Ty
Hi Yaroslav,
+1 from my end too. I get some questions internally on the warning logs due
to conflicting client-id and it would be nice to resolve them.
Best,
Mason
On Wed, Oct 12, 2022 at 2:03 PM Martijn Visser
wrote:
> Hi Yaroslav,
>
> +1 from my end. Thanks for bringing this up!
>
> Best reg
Hi Ryan,
Thanks for the additional context! Yes, the offset initializer would need
to take a cluster as a parameter and the MultiClusterKafkaSourceSplit can
be exposed in an initializer.
Best,
Mason
On Thu, Oct 6, 2022 at 11:00 AM Ryan van Huuksloot <
ryan.vanhuuksl...@shopify.com> wrote:
> Hi
> In what Flink’s release the connection from SQL Client to the Gateway is
expected to be added?
Flink 1.17
> “Authentication module” (2) and “Persistent Gateway” (4) as
possible future work. Were there any recent discussions on these subjects?
No recent discussions on these subjects, but I think
Thanks martijn for driving this work.
+1
Best,
Leonard
> 2022年10月13日 下午12:29，Gyula Fóra 写道：
>
> +1
>
> On Thu, 13 Oct 2022 at 04:53, yuxia wrote:
>
>> +1 (non-binding)
>> Thanks for driving.
>>
>> Best regards,
>> Yuxia
>>
>> - 原始邮件 -
>> 发件人: "Hang Ruan"
>> 收件人: "dev"
>> 发送时间:
qiaomengnan created FLINK-29613:
---
Summary: An error occurred during the running of the Flink
pulsar，it shows "We only support normal message id currently."
Key: FLINK-29613
URL: https://issues.apache.org/jira/browse
Hi Yaroslav,
+1 from me. It is meaningful to keep the common Kafka client configuration
the same between Kafka source and sink.
Best,
Hang
Mason Chen 于2022年10月13日周四 13:51写道：
> Hi Yaroslav,
>
> +1 from my end too. I get some questions internally on the warning logs due
> to conflicting client-
Hi Martijn,
Maybe a bit of an off-topic, but regarding Java 17 support, will it be
possible to replace POJOs with Java records in existing applications?
In a project I maintain we use Lombok a lot, but with Java records we would
probably stop using it (or significantly reduce its usage).
Will th
Jingsong Lee created FLINK-29614:
Summary: Introduce Spark writer for table store
Key: FLINK-29614
URL: https://issues.apache.org/jira/browse/FLINK-29614
Project: Flink
Issue Type: New Featur
Zhanghao Chen created FLINK-29615:
-
Summary: MetricStore does not remove metrics of nonexistent
subtasks when adaptive scheduler lowers job parallelism
Key: FLINK-29615
URL: https://issues.apache.org/jira/browse/F
+1
Thanks for driving this Martijn!
Best,
Qingsheng
> On Oct 13, 2022, at 03:45, Martijn Visser wrote:
>
> Hi everyone,
>
> Since no comments were made, I'm opening a vote to remove the HCatalog
> connector [1]
>
> The voting period will be open at least 72hrs.
>
> Best regards,
>
> Martij
Aiden Gong created FLINK-29616:
--
Summary: Polish Table Store Pom file to avoid warning.
Key: FLINK-29616
URL: https://issues.apache.org/jira/browse/FLINK-29616
Project: Flink
Issue Type: Improve
81 matches
Mail list logo
