Re: [VOTE] Release 1.16.2, release candidate #1

2023-05-23 Thread Samrat Deb
+1 (non-binding) - Verified signature - Verified hashes - Build form source with mac - Verify that the source archives do not contain any binaries - Run streaming and batch job in sql-client successfully. Thank you for driving this release candidate. On Tue, 23 May 2023 at 1:51 PM, Qingsheng Ren

[DISCUSS] FLIP-307: Flink connector Redshift

2023-05-28 Thread Samrat Deb
Hello all , Context: Amazon Redshift [1] is a fully managed, petabyte-scale data warehouse service in the cloud. It allows analyzing data without all of the configurations of a provisioned data warehouse. Resources are automatically provisioned and data warehouse capacity is intelligently scaled t

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-05-29 Thread Samrat Deb
ink, will it only support append-only tables (no changelog > mode support)? It looks like it's the case, so IMO, it should be mentioned > in the limitations section. > > On Sun, May 28, 2023 at 9:52 PM Samrat Deb wrote: > > > Hello all , > > > > Context: >

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-05-30 Thread Samrat Deb
est, > Leonard > > > > On May 29, 2023, at 12:51 PM, Samrat Deb wrote: > > > > Hello all , > > > > Context: > > Amazon Redshift [1] is a fully managed, petabyte-scale data warehouse > > service in the cloud. It allows analyzing data without all of th

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-05-30 Thread Samrat Deb
[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-307%3A++Flink+Connector+Redshift [note] Missed the trailing link for previous mail On Tue, May 30, 2023 at 2:43 PM Samrat Deb wrote: > Hi Leonard, > > > and I’m glad to help review the design as well as the code review.

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-05-31 Thread Samrat Deb
ode`, you say here provides two > modes, respectively, jdbc and `unload or copy`, What is the default value > for `read.mode` and `write.mode? > 2. For Source, does it both support batch read and streaming read? > > > Best, > Ron > > Samrat Deb 于2023年5月30日周二 17:15写道: >

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-03 Thread Samrat Deb
> > > > > > Bests, > > > Samrat > > > > > > On Wed, May 31, 2023 at 8:03 AM liu ron wrote: > > > > > > > Hi, Samrat > > > > > > > > Thanks for driving this FLIP. It looks like sup

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-03 Thread Samrat Deb
/redshift/latest/mgmt/amazon-redshift-limits.html On Sat, Jun 3, 2023 at 11:40 PM Samrat Deb wrote: > Hi Ahmed, > > >>> please let me know If you need any collaboration regarding integration > with > AWS connectors credential providers or regarding FLIP-171 I would be mor

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-03 Thread Samrat Deb
Hi Feng, Thank you for providing the proposal. I believe this feature will be highly valuable. I have a couple of inquiries: 1. According to the documentation [1], the createCatalog method does not mention any exceptions being thrown. However, I would like to confirm if it is always true that th

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-06 Thread Samrat Deb
est adding that information into the > FLIP. > > +1 Looking forward to your PR :-) > > Best regards, > Jing > > On Sat, Jun 3, 2023 at 9:19 PM Samrat Deb wrote: > > > Hi Jing Ge, > > > > >>> Do you already have any prototype? I'd like to join t

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-06 Thread Samrat Deb
Hi Jing, > I would suggest adding that information into the FLIP. Updated now, please review the new version of flip whenever time. > +1 Looking forward to your PR :-) I will request for your review once m ready with PR :-) Bests, Samrat On Tue, Jun 6, 2023 at 11:43 PM Samrat Deb

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-06-21 Thread Samrat Deb
but I don't think the ASync API yet supports exactly-once. > > Thanks, > > Martijn > > On Fri, Jun 9, 2023 at 7:22 PM Jing Ge wrote: > > > Hi Samrat, > > > > The FLIP looks good, thanks! > > > > Best regards, > > Jing > > > >

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-07-04 Thread Samrat Deb
de > > 3 The source of Redshift connector supports JDBC queries, IIUC, we can > also support the LookupTableSource as well? > > Best, > Leonard > > > On Jun 21, 2023, at 4:57 PM, Samrat Deb wrote: > > > > Hi Martijn, > > > > Thank you for sharing your thought

Re: Kubernetes Operator 1.6.0 release planning

2023-07-19 Thread Samrat Deb
thank you gyula , for driving it. +1(non binding) Bests, Samrat On Thu, 20 Jul 2023 at 8:02 AM, Rui Fan <1996fan...@gmail.com> wrote: > Thanks Gyula for driving this release. > > +1 for the timeline > > Best, > Rui Fan > > On Wed, Jul 19, 2023 at 11:03 PM Gyula Fóra wrote: > > > Hi Devs! > > >

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-03 Thread Samrat Deb
Congratulations, Hong Teoh On Fri, 4 Aug 2023 at 7:52 AM, Benchao Li wrote: > Congratulations, Hong! > > yuxia 于2023年8月4日周五 09:23写道: > > > Congratulations, Hong Teoh! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Matthias Pohl" > > 收件人: "dev" > > 发送时间: 星期四, 2023年 8 月 03日

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-03 Thread Samrat Deb
Congrats, Matthias! On Fri, 4 Aug 2023 at 10:13 AM, Benchao Li wrote: > Congratulations, Matthias! > > Jing Ge 于2023年8月4日周五 12:35写道: > > > Congrats! Matthias! > > > > Best regards, > > Jing > > > > On Fri, Aug 4, 2023 at 12:09 PM Yangze Guo wrote: > > > > > Congrats, Matthias! > > > > > > Bes

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-11 Thread Samrat Deb
t;>>> wrote: > >>>>>> > >>>>>>> Congratulations and welcome aboard, Hong! > >>>>>>> > >>>>>>> Best, > >>>>>>> Qingsheng > >>>>>>> > >>>>>>> On

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-11 Thread Samrat Deb
Congratulations, Matthias Bests, Samrat On Wed, Aug 9, 2023 at 4:18 PM Benchao Li wrote: > Congratulations, Matthias! > > Maximilian Michels 于2023年8月8日周二 17:54写道: > > > Congrats, well done, and welcome to the PMC Matthias! > > > > -Max > > > > On Tue, Aug 8, 2023 at 8:36 AM yh z wrote: > > >

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-08-28 Thread Samrat Deb
#x27;re already seeing > that coupling causes a lot of issues down the line. Why can't we decouple > these? > > Best regards, > > Martijn > > On Tue, Jul 4, 2023 at 3:35 PM Samrat Deb wrote: > > > Hi Leonard, > > > > Sorry for the late rep

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate 2

2023-09-04 Thread Samrat Deb
Hi, +1 (non-binding) Verified NOTICE files Verified CheckSum and signatures Glanced through PR[1] , Looks good to me Bests, Samrat [1]https://github.com/apache/flink-web/pull/591 > On 04-Sep-2023, at 2:22 PM, Ahmed Hamdy wrote: > > Hi Martijn, > +1 (non-binding) > > - verified Check

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

2023-09-05 Thread Samrat Deb
Hi Max, > are we planning to add an alternative implementation against the new interfaces? Yes, we are simultaneously working on the YARN implementation using the interface. During the initial interface design, we encountered some anomalies while implementing it in YARN. Once the interfaces are

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-09-10 Thread Samrat Deb
Hello Danny, I wanted to express my gratitude for your valuable feedback and insightful suggestions. I will be revising the FLIP to incorporate all of your queries and review suggestions. Additionally, I plan to provide a Proof of Concept (POC) for the connector by the end of this week. This POC

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-09-10 Thread Samrat Deb
load-driver.html On Mon, Sep 11, 2023 at 12:02 PM Samrat Deb wrote: > Hello Danny, > > I wanted to express my gratitude for your valuable feedback and insightful > suggestions. > > I will be revising the FLIP to incorporate all of your queries and review > suggestions. Addit

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread Samrat Deb
Thank you for driving this FLIP, +1 (non-binding) Bests, Samrat On Tue, Sep 12, 2023 at 2:27 PM Ahmed Hamdy wrote: > Hi Allison > Thanks for the proposal. > + (non-binding) > Best Regards > Ahmed Hamdy > > > On Mon, 11 Sept 2023 at 03:48, Weihua Hu wrote: > > > +1 (binding) > > > > Best, > >

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread Samrat Deb
+1 (non binding ) Best, Samrat On Wed, 13 Sep 2023 at 7:08 PM, Feng Jin wrote: > Thanks for driving this, looking forward to this feature. > > > +1 (non-binding) > > Best, > Feng > > On Wed, Sep 13, 2023 at 9:11 PM Chen Zhanghao > wrote: > > > Thanks for driving this. +1 (non-binding) > > > >

Re: [VOTE] FLIP-361: Improve GC Metrics

2023-09-13 Thread Samrat Deb
+1 ( non binding) These improved GC metrics will be a great addition. Bests, Samrat On Wed, 13 Sep 2023 at 7:58 PM, ConradJam wrote: > +1 (non-binding) > gc metrics help with autoscale tuning features > > Chen Zhanghao 于2023年9月13日周三 22:16写道: > > > +1 (unbinding). Looking forward to it > > > >

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-09-15 Thread Samrat Deb
tion/SinkFunction interfaces > because it hasn't been migrated yet. > > Best regards, > > Martijn > > On Mon, Sep 11, 2023 at 8:54 AM Samrat Deb wrote: > > > Hi Leonard, > > > > > Do we have to rely on the latest version of JDBC Connector here? &

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-09-16 Thread Samrat Deb
gmt/jdbc20-download-driver.html [3] - https://github.com/Samrat002/flink-connector-aws/tree/redshift-connector Bests, Samrat On Sat, Sep 16, 2023 at 10:46 AM Samrat Deb wrote: > Hello Martijn, > > I apologize for the delay in responding. > > Regarding your question about inte

[VOTE] FLIP-307: Flink Connector Redshift

2023-09-17 Thread Samrat Deb
Hi All, Thanks for all the feedback on FLIP-307: Flink Connector Redshift [1][2] I'd like to start a vote for FLIP-307. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. Bests, Samrat [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-307%3A

Re: [VOTE] FLIP-312: Prometheus Sink Connector

2023-09-21 Thread Samrat Deb
Thank you , +1 (non binding) Bests, Samrat On Thu, Sep 21, 2023 at 9:43 AM Leonard Xu wrote: > Thanks Lorenzo for driving this. > > +1(binding) > > Best, > Leonard > > > On Sep 21, 2023, at 11:47 AM, Yun Tang wrote: > > > > +1 (binding) > > > > Thanks for driving this, Lorenzo. > > > > Best >

Re: [VOTE] FLIP-307: Flink Connector Redshift

2023-09-21 Thread Samrat Deb
PM Danny Cranmer > >> wrote: > >> > >>> Thanks for driving this Samrat! > >>> > >>> +1 (binding) > >>> > >>> Thanks, > >>> Danny > >>> > >>> On Mon, Sep 18, 2023 at 4:17 AM Samrat Deb >

[RESULT][VOTE] FLIP-307: Flink Connector Redshift

2023-09-21 Thread Samrat Deb
Hi Everyone, The proposal, FLIP-307: Flink Connector Redshift, has been accepted with 5 votes (4 binding) . +1 votes: - Danny Cranmer (binding) - Jing Ge (binding) - Ahmed Hamdy (non-binding) - Martijn Visser (binding) - Leonard Xu (binding) Bests, Samrat

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

2023-09-21 Thread Samrat Deb
Hello Junrui, +1 for the proposal. Bests, Samrat On Fri, Sep 22, 2023 at 10:18 AM Shammon FY wrote: > +1 for the proposal, thanks for driving. > > Bet, > Shammon FY > > On Fri, Sep 22, 2023 at 12:41 PM Yangze Guo wrote: > > > Thanks for driving this, +1 for the proposal. > > > > Best, > > Ya

Re: [VOTE] FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-10 Thread Samrat Deb
+1 (non binding ) On Wed, 11 Oct 2023 at 12:02 PM, Jing Ge wrote: > +1(binding) > > Best Regards, > Jing > > On Wed, Oct 11, 2023 at 5:36 AM Zakelly Lan wrote: > > > +1(non-binding) > > > > Thanks for driving this. > > > > Best, > > Zakelly > > > > On Wed, Oct 11, 2023 at 11:22 AM Weihua Hu >

Re: [VOTE] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-10-11 Thread Samrat Deb
+1 (non binding) On Wed, 11 Oct 2023 at 1:29 PM, Martijn Visser wrote: > +1 (binding) > > On Wed, Oct 11, 2023 at 9:15 AM Sergey Nuyanzin > wrote: > > > > +1 (binding) > > > > that's a nice improvement > > thanks for driving that > > > > On Wed, Oct 11, 2023 at 8:42 AM Lincoln Lee > wrote: > >

dev@flink.apache.org

2023-10-11 Thread Samrat Deb
+1 (non binding ) Bests, Samrat On Thu, Oct 12, 2023 at 11:14 AM Jing Ge wrote: > +1(binding) Thanks! > > Best regards, > Jing > > On Wed, Oct 11, 2023 at 9:34 AM Yuepeng Pan wrote: > > > +1(non-binding) > > Thanks for your driving the voting thread. > > > > Best Regards. > > Yuepeng Pan > > >

Re: [VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-12 Thread Samrat Deb
+1 (non binding ) On Fri, 13 Oct 2023 at 7:47 AM, Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui Fan > > On Fri, Oct 13, 2023 at 10:12 AM Junrui Lee wrote: > > > Hi all, > > > > Thank you to everyone for the feedback on FLIP-366[1]: Support standard > > YAML for FLINK config

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

2023-10-15 Thread Samrat Deb
Congratulations Ron Liu :) On Mon, 16 Oct 2023 at 7:29 AM, tison wrote: > Congrats! Glad to see more and more committers on board :D > > Enjoy your journey ;-) > > Best, > tison. > > > Jark Wu 于2023年10月16日周一 09:57写道: > > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Ro

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-15 Thread Samrat Deb
Congratulations Jane Chan :) On Mon, 16 Oct 2023 at 7:30 AM, tison wrote: > Congrats! I noticed Jane has been around for a while; well-deserved. > > Best, > tison. > > > Jark Wu 于2023年10月16日周一 09:58写道: > > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Jane Chan as a ne

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.6.1, release candidate #1

2023-10-23 Thread Samrat Deb
+1 (non binding) - Verified checksum and signatures, - checked Helm repo - Installed operator, - tested woed count and state machine example Bests, Samrat On Mon, 23 Oct 2023 at 9:35 PM, Mate Czagany wrote: > +1 (non-binding) > > - Verified checksums, signatures, no binary found in source >

Re: [VOTE] Release 1.18.0, release candidate #3

2023-10-23 Thread Samrat Deb
+1(non-binding) - Downloaded artifacts from dist[1] - Verified SHA512 checksums - Verified GPG signatures - Build the source with java 8 and 11 [1] https://dist.apache.org/repos/dist/dev/flink/flink-1.18.0-rc3/ Bests, Samrat On Tue, Oct 24, 2023 at 10:44 AM Jingsong Li wrote: > +1 (binding) >

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread Samrat Deb
Congratulations on the great release Bests, Samrat On Fri, 27 Oct 2023 at 7:59 AM, Yangze Guo wrote: > Great work! Congratulations to everyone involved! > > Best, > Yangze Guo > > On Fri, Oct 27, 2023 at 10:23 AM Qingsheng Ren wrote: > > > > Congratulations and big THANK YOU to everyone helpin

[Discuss] Proposal to add TTL Configuration in JobResultStore for cleanJobResults

2023-10-28 Thread Samrat Deb
Hi All, The JobResultStore interface includes an Abstract implementation known as `AbstractThreadsafeJobResultStore`. This implementation is extended by two concrete implementations: `FileSystemJobResultStore` and `EmbeddedJobResultStore`. Both of these concrete implementations handle two types of

Re: [VOTE] Apache Flink Kafka connector version 3.0.1, RC1

2023-10-30 Thread Samrat Deb
+1 (non-binding) - Verified signatures - Verified Checksum - Build with Java 8 /11 - build success - Started MSK cluster and EMR cluster with flink, successfully ran some examples to read and write data to MSK. - Checked release tag exists Bests, Samrat On Mon, Oct 30, 2023 at 3:47 PM Ahmed Ham

Re: [DISCUSS] AWS Connectors v4.2.0 release + 1.18 support

2023-10-30 Thread Samrat Deb
Hi Danny , Thank you for driving it. +1 (non binding ) > I am proposing we skip 4.1.0 for Flink 1.18 and go straight to 4.2.0. Does this imply that the 4.1.x series will be reserved for Flink 1.17, and the 4.2.x series will correspond to Flink 1.18? Bests, Samrat On Mon, Oct 30, 2023 at 7:

Re: [DISCUSS] Kubernetes Operator 1.7.0 release planning

2023-10-31 Thread Samrat Deb
Thank you Gyula (+1 non-binding) in support of you taking on the role of release manager. > I think this is reasonable as I am not aware of any big features / bug fixes being worked on right now. Given the size of the changes related to the autoscaler module refactor we should try to focus the re

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Samrat Deb
Thanks for the proposal , +1 for adding deprecated identifier [Thought] Can we have seperate section / page for deprecated configs ? Wdut ? Bests, Samrat On Tue, 31 Oct 2023 at 3:44 PM, Alexander Fedulov < alexander.fedu...@gmail.com> wrote: > Hi Zhanghao, > > Thanks for the proposition. > In

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.2, release candidate #1

2023-11-06 Thread Samrat Deb
+1(non-binding) - Checked release notes - Verified checksums and signatures - Verified no binaries in release - Build connector from source Bests, Samrat On Mon, 6 Nov 2023 at 8:20 PM, Ryan Skraba wrote: > Hello! +1 (non-binding) > > One note: the parent pom still has 1.16.0 for the Maven prop

Re: [VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-12 Thread Samrat Deb
+1 (non binding) Bests, Samrat On Mon, 13 Nov 2023 at 9:10 AM, Yangze Guo wrote: > +1 (binding) > > Best, > Yangze Guo > > On Mon, Nov 13, 2023 at 11:35 AM weijie guo > wrote: > > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Lijie Wang 于2023年11月13日周一 10:40写道: > > > > > +1

Re: [VOTE] Release flink-connector-aws, v4.2.0 release candidate #1

2023-11-29 Thread Samrat Deb
Hi danny , +1 (non binding) Release notes look good - Signatures and checksums verified - pom versions checked - Source build and tests verified Bests, Samrat On Wed, 29 Nov 2023 at 12:11 PM, Leonard Xu wrote: > Thanks Danny for driving this, sorry for late verification. > > +1 (binding) > >

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-06 Thread Samrat Deb
That's really cool :) +1 for the great addition Bests, Samrat On Thu, 7 Dec 2023 at 9:20 AM, Jingsong Li wrote: > Wow, Cool, Nice > > CDC is playing an increasingly important role. > > +1 > > Best, > Jingsong > > On Thu, Dec 7, 2023 at 11:25 AM Leonard Xu wrote: > > > > Dear Flink devs, > > >

Re: [VOTE] FLIP-396: Trial to test GitHub Actions as an alternative for Flink's current Azure CI infrastructure

2023-12-11 Thread Samrat Deb
+1 (non binding) Thanks for driving On Tue, 12 Dec 2023 at 11:59 AM, Sergey Nuyanzin wrote: > +1 (binding) > > Thanks for driving this > > On Tue, Dec 12, 2023, 07:22 Rui Fan <1996fan...@gmail.com> wrote: > > > +1(binding) > > > > Best, > > Rui > > > > On Tue, Dec 12, 2023 at 11:58 AM weijie guo

Re: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-02 Thread Samrat Deb
Congratulations Alex

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Samrat Deb
+1 (non binding) Bests, Samrat

[DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-02 Thread Samrat Deb
Hi everyone, I would like to open a discussion[1] on providing GlueCatalog support in Flink. Currently, Flink offers 3 major types of catalog[2]. Out of which only HiveCatalog is a persistent catalog backed by Hive Metastore. We would like to introduce GlueCatalog in Flink offering another option

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-06 Thread Samrat Deb
config for the GlueCatalog? If yes, can we add this config to the > "Configurations" section and explain how users should choose the client > type? > > Regards, > Dong > > > On Sat, Dec 3, 2022 at 12:31 PM Samrat Deb wrote: > > > Hi everyone, > > > > I

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-06 Thread Samrat Deb
user don't specify any connection type. I have updated the FLIP-277[1] #configuration section with all the configs . Please review it again . [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-277%3A+Native+GlueCatalog+Support+in+Flink Samrat On Tue, Dec 6, 2022 at 5:50 PM Sam

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-06 Thread Samrat Deb
logs or will it be better to add it in flink-connector-aws[1] ? [1] https://github.com/apache/flink-connector-aws Samrat On Tue, Dec 6, 2022 at 6:52 PM Samrat Deb wrote: > Hi Dong Lin, > > Aws Glue Data catalog is vendor specific and in future we will get such > type of implementati

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-12 Thread Samrat Deb
Lin wrote: > > > Hi Samrat, > > > > Sorry for the late reply. Yeah I am referring to creating a similar > > external repo such as flink-catalog-glue. flink-connector-aws is already > > named with `connector` so it seems a bit weird to put a catalog there. > &g

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-12 Thread Samrat Deb
nstants.java [3] https://cwiki.apache.org/confluence/display/FLINK/FLIP-277%3A+Native+GlueCatalog+Support+in+Flink Bests, Samrat On Mon, Dec 12, 2022 at 5:32 PM Samrat Deb wrote: > Hi Jark, > Apologies for late reply. > Thank you for your valuable input. > > Besides, I have a question abou

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-14 Thread Samrat Deb
we already use localstack for > integration tests so we can follow suite here. > > Thanks, > Danny > > [1] > https://github.com/apache/flink-connector-aws/tree/main/flink-connector-aws-base > [2] https://docs.localstack.cloud/user-guide/aws/glue/ > > On Mon, Dec 12, 2

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-14 Thread Samrat Deb
PM Samrat Deb wrote: > > > Thank you Danny for more insights on the flink-connector-aws-base[1]. > > It looks like localstack supports glue [2], we already use localstack for >> integration tests so we can follow suite here. > > > As GlueCatalog will be a part of fl

[VOTE] FLIP-277: Improve Catalog API to Support ALTER TABLE syntax

2022-12-16 Thread Samrat Deb
Hi All, Thanks for all the feedback so far. Based on the discussion[1] we seem to have a consensus, so I would like to start a vote on FLIP-277[2]. The vote will last for at least 72 hours (Dec 21st at 11:00 GMT, excluding weekend days) unless there is an objection or insufficient votes. Best, Samr

[VOTE] FLIP-277: Glue catalog support in Flink

2022-12-16 Thread Samrat Deb
Hi All, Thanks for all the feedback so far. Based on the discussion[1] we seem to have a consensus, so I would like to start a vote on FLIP-277[2]. The vote will last for at least 72 hours (Dec 21st at 11:00 GMT, excluding weekend days) unless there is an objection or insufficient votes. Please i

Re: [VOTE] FLIP-277: Improve Catalog API to Support ALTER TABLE syntax

2022-12-16 Thread Samrat Deb
Apologies ! Please ignore this email. I have sent a fresh one correcting the subject :( On Fri, Dec 16, 2022 at 3:45 PM Samrat Deb wrote: > Hi All, Thanks for all the feedback so far. Based on the discussion[1] we > seem to have a consensus, so I would like to start a vote on FLIP-277[2].

Re: [VOTE] FLIP-277: Glue catalog support in Flink

2022-12-16 Thread Samrat Deb
; Danny. > > On Fri, Dec 16, 2022 at 10:26 AM Jark Wu wrote: > > > +1 (binding) > > > > It would be better to mention in the FLIP which repository and module to > > put the Glue Catalog. > > > > Best, > > Jark > > > > On Fri, 16 Dec 2022

[RESULT][VOTE] FLIP-277: Glue native catalog support in Flink

2022-12-20 Thread Samrat Deb
Hi Flink Devs, FLIP-277: Glue native catalog support in Flink[1] has been accepted. There are 4 binding votes and 1 non-binding votes Binding votes in favour: 1. Jark Wu 2. Danny Cranmer 3. Dong Lin 4. Konstantin Knauf Non-binding: 1. Yuxia There are no disapproving votes. Bests, Samrat [1] h

Re: [VOTE] FLIP-282: Introduce Delete & Update API

2023-01-09 Thread Samrat Deb
+1 (non binding ) thank you for driving On Mon, 9 Jan 2023 at 3:36 PM, yuxia wrote: > Hi, all. > > I'd like to start a vote on FLIP-282: Introduce Delete & Update API[1]. > You can find the discussion on it in here[2]. > > The vote will last for at least 72 hours (Jan 12th at 10:00 AM GMT ) >

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-12 Thread Samrat Deb
congratulation ! Lincoln On Thu, 12 Jan 2023 at 1:32 PM, Yang Wang wrote: > Congratulations, Lincoln! > > Best, > Yang > > Lincoln Lee 于2023年1月12日周四 12:13写道: > > > Thank you all! > > > > I'm honored to join the committers and look forward to continue working > > with the community. > > > > Best

Re: [VOTE] Externalize AWS formats to flink-connector-aws

2023-01-30 Thread Samrat Deb
+1 (non-binding) Thanks for driving it. On Mon, Jan 30, 2023 at 2:53 PM Matthias Pohl wrote: > Sounds reasonable to me. > > +1 (binding) > > On Mon, Jan 30, 2023 at 9:52 AM Martijn Visser > wrote: > > > +1 (binding) > > > > Op ma 30 jan. 2023 om 09:30 schreef yuxia > > > > > +1 (non-binding).

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-12 Thread Samrat Deb
Congratulations, Weijie! On Mon, 13 Feb 2023 at 10:08 AM, Benchao Li wrote: > Congratulations, Weijie! > > Rui Fan <1996fan...@gmail.com> 于2023年2月13日周一 12:27写道: > > > Congratulations, Weijie! > > > > Best > > Rui Fan > > > > On Mon, Feb 13, 2023 at 12:20 Yuxin Tan wrote: > > > > > Congratulatio

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Samrat Deb
Congratulations , Dong! On Thu, Feb 16, 2023 at 1:39 PM Jing Ge wrote: > Congrats, Dong! > > On Thu, Feb 16, 2023 at 8:49 AM Martijn Visser > wrote: > > > Congratulations Dong! > > > > On Thu, Feb 16, 2023 at 8:47 AM zhouenning > > > wrote: > > > > > Congratulations, Dong! Best, Eming > > > >

[DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
Hi , *Context:* Auto Scaling was introduced in Flink as part of FLIP-271[1]. It discusses one of the important aspects to provide a robust default scaling algorithm. a. Ensure scaling yields effective usage of assigned task slots. b. Ramp up in case of any backlog to ensure it gets pro

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
rnetes-operator/commit/5bb8e9dc4dd29e10f3ba7c8ce7cefcdffbf92da4 > > Gyula > > On Thu, Feb 16, 2023 at 10:27 AM Samrat Deb wrote: > > > Hi , > > > > *Context:* > > Auto Scaling was introduced in Flink as part of FLIP-271[1]. > > It discusses one of t

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
s. It will take additional work for the logic to > > work independently of the cluster manager. > > > > -Max > > > > On Thu, Feb 16, 2023 at 11:14 AM Samrat Deb > wrote: > > > > > > Oh! yesterday it got merged. > > > Apologies , I missed t

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
incrementally working on making an autoscaling recommendation framework generic enough, Once it reaches a point where the community feels it needs to be moved to a separate repo we can take a call. Bests, Samrat On Thu, Feb 16, 2023 at 7:37 PM Samrat Deb wrote: > Hi Max , > If you are fi

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-17 Thread Samrat Deb
or may be a pretty > big > > > > task. > > > > You must not forget 2 core requirements here. > > > > > > > > 1. The autoscaler logic itself has to run somewhere (in this case on > > k8s > > > > within the operator)S > > > &g

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Samrat Deb
congratulations Anton! Bests, Samrat On Mon, 20 Feb 2023 at 9:29 PM, John Roesler wrote: > Congratulations, Anton! > -John > > On Mon, Feb 20, 2023, at 08:18, Piotr Nowojski wrote: > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Anton Kalashnikov as a > new > > Flink C

Re: Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-20 Thread Samrat Deb
ts and evaluates scaling related performance metrics > > > but does not trigger any job upgrades. > > > 2. Support for automatic upgrades of yarn jobs. > > > > > > Also, I also hope to join it, and improve it together. > > > > > > And very happy Gy

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Samrat Deb
Congrats Rui On Mon, 20 Feb 2023 at 10:28 PM, Anton Kalashnikov wrote: > Congrats Rui! > > -- > Best regards, > Anton Kalashnikov > > On 20.02.23 17:53, Matthias Pohl wrote: > > Congratulations, Rui :) > > > > On Mon, Feb 20, 2023 at 5:10 PM Jing Ge > wrote: > > > >> Congrats Rui! > >> > >> On

Re: Connectin two jobs with socket over AWS EMR - How to define the ip?

2023-02-21 Thread Samrat Deb
Hi Italy, `writeToSocket` supports passing the hostname , port and schema as arguments. I think you can pass the hostname of one of the core nodes in the flink job you intend to view the message. Have you tried that ? Can you add more details , 1. Which flink version are you using? 2. If you are

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

2023-02-22 Thread Samrat Deb
Congratulations Sergey On Wed, Feb 22, 2023 at 3:31 PM Hang Ruan wrote: > Congratulations Sergey! > > Jane Chan 于2023年2月22日周三 15:53写道: > > > Congratulations, Sergey! > > > > Best regards, > > Jane > > > > > > On Wed, Feb 22, 2023 at 9:44 AM Dian Fu wrote: > > > > > Congratulations Sergey! > >

Re: [VOTE] Flink minor version support policy for old releases

2023-02-28 Thread Samrat Deb
+1 (non binding) Thanks for driving it Bests, Samrat On Tue, 28 Feb 2023 at 1:36 PM, Junrui Lee wrote: > Thanks Danny for driving it. > > +1 (non-binding) > > Best regards, > Junrui > > yuxia 于2023年2月28日周二 14:04写道: > > > Thanks Danny for driving it. > > > > +1 (non-binding) > > > > Best regar

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

2023-03-12 Thread Samrat Deb
congratulations Yuxia Bests, Samrat On Mon, 13 Mar 2023 at 8:06 AM, Yuxin Tan wrote: > Congratulations, Yuxia! > > Best, > Yuxin > > > Jark Wu 于2023年3月13日周一 10:26写道: > > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Yuxia Luo as a new Flink > > Committer. > > > > Yuxi

Re: Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-03-13 Thread Samrat Deb
Hi Ramkrishna, I hope this email finds you well. Please accept my apologies for the delay in responding to your previous message. I would like to discuss the following matter with you: Although YARN serves as the platform for Flink, does YARN also operate on K8s? I am curious to know if this is

Re: [VOTE] Release 1.15.4, release candidate #2

2023-03-13 Thread Samrat Deb
+1 (non binding) - checked AWS SDKv2 version has been bumped to 2.19.14 through FLINK-30633 and all NOTICE files updates - Checked release notes - Checked sum and signatures - Maven clean install from source - Checked the jars in the staging repo - Checked website updates Bests, Samrat On Tue,

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

2023-03-13 Thread Samrat Deb
+1 (non binding) Thanks for driving it . Bests, Samrat On Tue, 14 Mar 2023 at 7:41 AM, Jark Wu wrote: > +1 (binding) > > Best, > Jark > > > 2023年3月13日 23:25,Aitozi 写道: > > > > +1 (non-binding) > > > > Best, > > Aitozi > > > > Jing Ge 于2023年3月13日周一 22:10写道: > > > >> +1 (binding) > >> > >> Best

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

2023-03-15 Thread Samrat Deb
+1 ( non binding) Bests, Samrat On Wed, 15 Mar 2023 at 8:54 PM, Dong Lin wrote: > +1 (binding) > > On Mon, Mar 13, 2023 at 1:47 PM Shammon FY wrote: > > > Hi Devs, > > > > I'd like to start the vote on FLIP-293: Introduce Flink Jdbc Driver For > Sql > > Gateway [1]. > > > > The FLIP was discus

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread Samrat Deb
congratulations 🥳 On Mon, 27 Mar 2023 at 6:02 PM, Leonard Xu wrote: > Congratulations! > > > Best, > Leonard > > > On Mar 27, 2023, at 5:23 PM, Yu Li wrote: > > > > Dear Flinkers, > > > > As you may have noticed, we are pleased to announce that Flink Table > Store has joined the Apache Incubato

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread Samrat Deb
congratulations Bests, Samrat On Mon, Mar 27, 2023 at 7:19 PM Yanfei Lei wrote: > Congratulations! > > Best Regards, > Yanfei > > ramkrishna vasudevan 于2023年3月27日周一 21:46写道: > > > > Congratulations !!! > > > > On Mon, Mar 27, 2023 at 2:54 PM Yu Li wrote: > >> > >> Dear Flinkers, > >> > >> > >

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread Samrat Deb
congratulations Bests, Samrat On Mon, 27 Mar 2023 at 8:24 PM, Alexander Fedulov < alexander.fedu...@gmail.com> wrote: > Great to see this, congratulations! > > Best, > Alex > > On Mon, 27 Mar 2023 at 11:24, Yu Li wrote: > > > Dear Flinkers, > > > > > > > > As you may have noticed, we are pleased

Re: [VOTE] FLIP-284: Making AsyncSinkWriter Flush triggers adjustable

2023-03-28 Thread Samrat Deb
Thank you Ahmed for driving the change. This new feature will help flink developers with more control on their job in SinkWriter. +1 (non binding) Bests, Samrat On Mon, Mar 27, 2023 at 12:34 PM Danny Cranmer wrote: > Thanks for driving this Ahmed. This change will benefit future and current

Re: [VOTE] Release flink-connector-aws 4.1.0, release candidate #1

2023-03-28 Thread Samrat Deb
+1 (non-binding) - checked Source archive builds using maven - verified Hashes and Signatures - verified Tag is present in Github - checked dist.apache.org, required files present - verified source archive Bests, Samrat On Tue, Mar 28, 2023 at 5:12 PM Teoh, Hong wrote: > +1 (non-binding) >

Re: [VOTE] Release flink-connector-mongodb, release candidate #1

2023-03-28 Thread Samrat Deb
+1 (non-binding) - checked Source archive builds using maven - verified Hashes and Signatures - verified Tag is present in Github - checked dist.apache.org, required files present - verified source archive Bests, Samrat On Mon, Mar 20, 2023 at 2:08 PM Leonard Xu wrote: > > > + 1 (non-

Re: [VOTE] Release flink-connector-aws, 4.1.0 for Flink 1.17

2023-04-12 Thread Samrat Deb
+1 (non binding) On Tue, 4 Apr 2023 at 1:42 AM, Elphas Tori wrote: > +1 (non-binding) > > + verified hashes and signatures > + checked local build of website pull request and approved > > On 2023/04/03 16:19:00 Danny Cranmer wrote: > > Hi everyone, > > Please review and vote on the binaries for

Re: [VOTE] Release flink-connector-mongodb v1.0.1, release candidate #1

2023-04-14 Thread Samrat Deb
+1 (non binding) On Fri, 14 Apr 2023 at 1:23 PM, Teoh, Hong wrote: > Thanks Danny > > +1 (non-binding) > > * Hashes and Signatures look good > * All required files on dist.apache.org > * Tag is present in Github > * Verified source archive does not contain any binary files > * Source archive bui

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-21 Thread Samrat Deb
congratulations ! On Fri, 21 Apr 2023 at 9:45 PM, David Morávek wrote: > Congratulations, Qingsheng, well deserved! > > Best, > D. > > On Fri 21. 4. 2023 at 16:41, Feng Jin wrote: > > > Congratulations, Qingsheng > > > > > > > > Best, > > Feng Jin > > > > On Fri, Apr 21, 2023 at 8:39 PM Ma

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-21 Thread Samrat Deb
congratulations On Fri, 21 Apr 2023 at 9:44 PM, David Morávek wrote: > Congratulations, Leonard, well deserved! > > Best, > D. > > On Fri 21. 4. 2023 at 16:40, Feng Jin wrote: > > > Congratulations, Leonard > > > > > > > > Best, > > Feng Jin > > > > On Fri, Apr 21, 2023 at 8:38 PM Mang Zha

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-11 Thread Samrat Deb
+1 (non binding) - verified signatures and checksums - ASF headers are present in all expected file - No unexpected binaries files found in the source - Build successful locally - tested basic word count example Bests, Samrat On Mon, 11 Mar 2024 at 7:33 PM, Ahmed Hamdy wrote: > Hi Lincoln >

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Samrat Deb
Congratulations ! On Mon, 18 Mar 2024 at 2:07 PM, Jingsong Li wrote: > Congratulations! > > On Mon, Mar 18, 2024 at 4:30 PM Rui Fan <1996fan...@gmail.com> wrote: > > > > Congratulations, thanks for the great work! > > > > Best, > > Rui > > > > On Mon, Mar 18, 2024 at 4:26 PM Lincoln Lee > wrote

  1   2   >