Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-22 Thread Fabian Paul
+1 (non-binding) - Verified signature - Built from source (Java8) - Run custom jobs on Kubernetes Regards, Fabian > On 18. Apr 2020, at 04:37, Dian Fu wrote: > > Hi everyone, > > Please review and vote on the release candidate #1 for the version 1.9.3, > as follows: > [ ] +1, Approve the rele

Re: [VOTE] Release 1.8.3, release candidate #3

2019-12-09 Thread Fabian Paul
Hi Hequn, +1 (non-binding) - verified checksums and hashes - built from sources (Scala 2.11, Scala 2.12) - build a custom docker image and run several test jobs on Kubernetes Best, Fabian Paul -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Re: [VOTE] Release 1.11.2, release candidate #1

2020-09-14 Thread Fabian Paul
+1 (non-binding) Checks: - Verified signature - Built from source (Java8) - Ran custom jobs on Kubernetes Regards, Fabian

Re: [VOTE] Adopt jemalloc as default memory allocator in docker image

2020-11-06 Thread Fabian Paul
+1 (non-binding) Thanks, Yun for the efforts to bring this topic to a vote. Best, Fabian

[DISCUSS] Programmatically submit Flink job jar to session cluster

2020-12-08 Thread Fabian Paul
Hi all, Currently, the most convenient way of programmatically submitting a job to a running session cluster is using Flink’s RestClusterClient. Unfortunately, it is only supported, as of now, to submit a job graph.[1] To construct a job graph from a jar file, additional Flink dependencies are

Re: [jira] [Created] (FLINK-30238) Unified Sink committer does not clean up state on final savepoint

2022-11-29 Thread Fabian Paul
Hi folks, I did some initial investigation, and the problem seems twofold. If no post-commit topology is used, we do not run into a problem where we could lose data but since we do not clean up the state correctly, we will hit this [1] when trying to stop the pipeline with a savepoint after we ha

Re: [jira] [Created] (FLINK-30238) Unified Sink committer does not clean up state on final savepoint

2022-12-01 Thread Fabian Paul
Yes, the StreamingFileSink is not affected. Best, Fabian

Re: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1

2024-06-04 Thread Fabian Paul
+1 (non-binding) - Verified signature - Verified checksum - Built release tag from source with JDK 11 - approved docs PR Best, Fabian On Wed, May 22, 2024 at 2:22 PM Leonard Xu wrote: > +1 (binding) > > - verified signatures > - verified hashsums > - built from source code with java 1.8 succee

Re: [DISCUSSION] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-06-07 Thread Fabian Paul
Thanks, Alexey, for the proposal. I think this is a nice addition that finally fixes the gap in the CompiledPlan. +1 Best, Fabian On Tue, May 14, 2024 at 1:19 AM Alexey Leonov-Vendrovskiy < vendrov...@gmail.com> wrote: > Thanks Jim. > > > > > 1. For the testing, I'd call the tests "execution" te

Re: [DISCUSS] Releasing Flink 1.14.1

2021-11-24 Thread Fabian Paul
Hi Martijn, Thanks for bringing up this topic. I think it would be great to release a patch version of 1.14 before the end of the year. Currently, FLINK-24596 is in progress and I would block the release until it is merged because it unblocks se

Re: [ANNOUNCE] New Apache Flink Committer - Matthias Pohl

2021-12-02 Thread Fabian Paul
Congrats and well deserved. Best, Fabian On Thu, Dec 2, 2021 at 4:42 PM Ingo Bürk wrote: > > Congrats, Matthias! > > On Thu, Dec 2, 2021 at 4:28 PM Till Rohrmann wrote: > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce Matthias Pohl as a new > > Flink committer. > > >

Re: [ANNOUNCE] New Apache Flink Committer - Ingo Bürk

2021-12-02 Thread Fabian Paul
Thanks for always pushing Ingo. Congratulations! Best, Fabian On Thu, Dec 2, 2021 at 4:24 PM Till Rohrmann wrote: > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Ingo Bürk as a new Flink > committer. > > Ingo has started contributing to Flink since the beginning of this yea

Re: [DISCUSS] Releasing Flink 1.14.1

2021-12-03 Thread Fabian Paul
I just opened a PR for https://issues.apache.org/jira/browse/FLINK-25126 I'll expect to merge it sometime next week. Best, Fabian On Fri, Dec 3, 2021 at 10:49 AM Martijn Visser wrote: > > Hi all, > > Just a status update on the open blockers for 1.14.1: > * https://issues.apache.org/jira/browse/

Re: [DISCUSS] FLIP-196: Source API stability guarantees

2021-12-07 Thread Fabian Paul
Hi all, Thanks Till for starting this discussion. It is great to see these facts written down since they definitely caused friction in the past because of different interpretations. Overall I agree with everything being said in this FLIP. I was just wondering whether we can put the label explainin

Re: [DISCUSS] Releasing Flink 1.14.1

2021-12-09 Thread Fabian Paul
;> > I'd like to backport the fix of FLINK-19142 to 1.14.1. > >> > The backport is in progress. > >> > Will update it here when it is done. > >> > > >> > Thanks, > >> > Zhu > >> > > >> > Jingsong Li

Re: [DISCUSS] Releasing Flink 1.14.1

2021-12-09 Thread Fabian Paul
Actually I meant https://issues.apache.org/jira/browse/FLINK-25126 sorry for the confusion. On Thu, Dec 9, 2021 at 4:55 PM Fabian Paul wrote: > > Hi Martijn, > > I just opened the backport for > https://issues.apache.org/jira/browse/FLINK-25132. The changes are > already approv

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-12-13 Thread Fabian Paul
gt;> > the > >> > end-to-end latency is very important. I think we need to separate the > >> > write and compact phase. For the write phase, there include the Step-1 > >> > and Step-2, we sink data as file and commit it pre checkpoint and > >

Re: Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-12-16 Thread Fabian Paul
o collect committed >> > >> > files >> >> > >> > from multiple checkpoints, and rewriter(compact) them together once >> > >> > the >> >> > >> > total file size or number of files reach the threshold. >> >> > >>

Re: Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-12-16 Thread Fabian Paul
> > On Thu, Dec 16, 2021 at 9:23 AM Fabian Paul wrote: > > > Hi Yun, > > > > Thanks for your fast feedback. Let me clarify your points. > > > > 1. We solve it by using StreamExchangeMode.BATCH before any exchange. > > That obviously doesn’t help with

Re: [DISCUSS] GHA migration roadmap

2021-12-16 Thread Fabian Paul
Hi Nico, Thanks a lot for drafting the proposal. I really like the fully-fledged phasing model. All in all, I am +1 to move away from azure and can only second all the points you have mentioned. I only want to clarify one point. So far my understanding was that the GHA resources are managed on a

Re: Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2022-01-03 Thread Fabian Paul
it > separately in some future > as long as we know how to solve it~ > > Best, > Yun > > > -- > From:Arvid Heise > Send Time:2021 Dec. 16 (Thu.) 19:54 > To:dev > Cc:Yun Gao > Subject:Re: Re:

[VOTE] FLIP-191: Extend unified Sink interface to support small file compaction

2022-01-04 Thread Fabian Paul
Hi everyone, I'd like to start a vote on FLIP-191: Extend unified Sink interface to support small file compaction [1] that has been discussed in this thread [2]. The vote will be open for at least 72 hours unless there is an objection or not enough votes. Best, Fabian [1] https://cwiki.apache.

[RESULT][VOTE] FLIP-191: Extend unified Sink interface to support small file compaction

2022-01-07 Thread Fabian Paul
I am happy to announce that FLIP-191 [1] has been accepted by this vote [2]. There are 5 approving votes, 3 of which are binding: * Martijn Visser (non-binding) * Yun Gao (binding) * Arvid Heise (binding) * Guowei Ma (binding) * Jing Ge (non-binding) There are no disapproving votes. Thanks ever

Re: [VOTE] Create a separate sub project for FLIP-188: flink-store

2022-01-10 Thread Fabian Paul
Hi all, I just wanted to give my two cents for the build system discussion. In general, I agree with David's opinion to start new projects with Gradle but during the development of the external connector repository, we found some difficulties that still need to be solved. I do not want to force an

Re: [DISCUSS] FLIP-208: Update KafkaSource to detect EOF based on de-serialized record

2022-01-10 Thread Fabian Paul
Hi Dong, Thank you for updating the FLIP and making it applicable for all sources. I am a bit unsure about the implementation part. I would propose to add a source mixin interface that implements `getRecordEvaluator` and sources that want to allow dynamically stopping implement that interface. An

Re: [DISCUSS] FLIP-208: Update KafkaSource to detect EOF based on de-serialized record

2022-01-11 Thread Fabian Paul
dedness will continue to be determined with the API > KafkaSourceBuilder::setBounded(..) and > KafkaSourceBuilder::setUnbounded(..). Does this answer your question? > > Thanks, > Dong > > > > > > > > > > On Mon, Jan 10, 2022 at 8:01 PM Fabian Paul wrote: > &g

Re: [DISCUSS] FLIP-208: Update KafkaSource to detect EOF based on de-serialized record

2022-01-12 Thread Fabian Paul
11, 2022 at 11:46 PM Fabian Paul wrote: > > > Hi Dong, > > > > I wouldn't change the org.apache.flink.api.connector.source.Source > > interface because it either breaks existing sinks or we introduce it > > as some kind of optional. I deem both options as not

Re: [VOTE] Deprecate NiFi connector

2022-02-03 Thread Fabian Paul
Thanks for driving the deprecation efforts. +1 (binding) Best, Fabian On Mon, Jan 31, 2022 at 11:47 AM Martijn Visser wrote: > > Hi everyone, > > I would like to open up a vote to deprecate NiFi in Flink 1.15 and remove > it in the next version. I've previously mentioned that we were looking fo

Re: [VOTE] Remove Twitter connector

2022-02-03 Thread Fabian Paul
This connector is really a relict of the past. +1 (binding) Best, Fabian On Mon, Jan 31, 2022 at 11:47 AM Martijn Visser wrote: > > Hi everyone, > > I would like to open up a vote to remove the Twitter connector in Flink > 1.15. This was brought up previously for a discussion [1]. > > The vote

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Fabian Paul
Congrats to all three of you, well deserved. Best, Fabian On Wed, Feb 16, 2022 at 2:23 PM Robert Metzger wrote: > > Hi all, > > I would like to formally announce a few new Flink PMC members on the dev@ > list. The PMC has not done a good job of always announcing new PMC members > (and committers

Re: [DISCUSS] Release Flink 1.14.4

2022-02-22 Thread Fabian Paul
Hi Konstantin, Thanks for all the efforts driving the release. From my side, FLINK-26018 can also be seen as some kind of new feature that was planned but never implemented. Of course, it would be great to have it because it currently blocks the migration from the FlinkKafkaConsumer to the KafkaSo

Re: [DISCUSS] Release Flink 1.14.4

2022-02-22 Thread Fabian Paul
EDIT: Wrong link before https://issues.apache.org/jira/browse/FLINK-26304 On Tue, Feb 22, 2022 at 4:55 PM Fabian Paul wrote: > > Hi Konstantin, > > Thanks for all the efforts driving the release. From my side, > FLINK-26018 can also be seen as some kind of new feature that wa

Re: [DISCUSS] Looking for maintainers for Cassandra connector or decide to remove connector

2022-02-22 Thread Fabian Paul
Hi Marco, Great to hear that you put some thought into the topic. Judging from the past we already tried once to support multiple external versions within one connector (ElasticSearch) and it complicates things a lot. So if it makes your development easier to create a different module that should

Re: [ANNOUNCE] Flink 1.15 Feature Freeze

2022-02-23 Thread Fabian Paul
Hi all, I would like to merge the following PR [1]. It has been approved before the feature freeze but no one had time to merge it, unfortunately. The feature is very contained and only adds a simple capability to the Elastic connector when used with Flink SQL. If there are no concerns until end o

Re: [DISCUSS] Drop Mesos in 1.14

2021-06-23 Thread Fabian Paul
+ 1 for dropping mesos. Most of the PMCs have already left the project [1] and a move to attic was barely avoided. Overall kubernetes has taken its place and it is unlikely that we will see a surge in Mesos very soon. Best, Fabian [1] https://lists.apache.org/thread.html/rab2a820507f7c846e54

Re: [Flink blogs]

2021-09-30 Thread Fabian Paul
Hi Etienne, Thanks for reaching out I think your list already looks very appealing. > * - metrics (https://github.com/apache/flink/pull/14510): it was > dealing with delimiters. I think it is a bit low level for a blog post ? > * I am also unsure whether this a good fit to present. I can only

[DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-02 Thread Fabian Paul
Hi all, More and more data lake sinks rely on columnar formats which benefit from few larger files than a lot of small files (read amplification). Our current FileSink cannot ensure a certain size when writing to an external filesystem which I call the small file compaction problem. Unfortunat

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-03 Thread Fabian Paul
Hi David and Till, Thanks for your great feedback. One definitely confusing point in the FLIP is who is doing the actual compaction. The compaction will not be done by the CommittableAggregator operator but the committers so it should also not affect the checkpointing duration or have a signif

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-08 Thread Fabian Paul
Hi all, Thanks for the lively discussions. I am really excited to see so many people participating in this thread. It also underlines the need that many people would like to see a solution soon. I have updated the FLIP and removed the parallelism configuration because it is unnecessary since user

Re: [NOTICE] Please keep flink-examples up to date

2021-11-08 Thread Fabian Paul
Hi Seth, Thanks for brining up this topic. Huge appreciations that you take this over initially and we should definitely take care as a community to what we show beginner users. We can also take the examples as show cases about things we have developed and are proud of. Best, Fabian

Re: [DISCUSS] Update Policy for old releases

2021-11-11 Thread Fabian Paul
Thanks for bringing up this topic Piotr. I also think we should try to decouple our release cycles from our support plans. Currently we are very limited by the approach because faster release cycles result in also faster deprecation of versions. Therefore I am also favoring version 2 where we can

Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul

2021-11-15 Thread Fabian Paul
Thanks for the warm welcome, I am looking forward to continuing working with you all. Best, Fabian

Re: [DISCUSS] Definition of Done for Apache Flink

2021-11-16 Thread Fabian Paul
Hi all, Maybe I am the devil's advocate but I see the stability of master and the definition of done as disjunct properties. I think it is more a question of prioritization that test instabilities are treated as critical tickets and have to be addressed before continuing any other work. It will al

[DISCUSS] Release Flink 1.15.3

2022-10-25 Thread Fabian Paul
Hi all, I want to start the discussion of creating a new 1.15 patch release (1.15.3). The last 1.15 release is almost two months old, and since then, ~60 tickets have been closed, targeting 1.15.3. It includes critical changes to the sink architecture, including: - Reverting the sink metric namin

Re: [DISCUSS] Release Flink 1.15.3

2022-11-02 Thread Fabian Paul
> > On Tue, Oct 25, 2022 at 11:44 AM Xintong Song > > > > wrote: > > > > > > > >> Thanks for bringing this up, Fabian. > > > >> > > > >> +1 for creating a 1.15.3 release. I've also seen users requiring > this

Re: [DISCUSS] Release Flink 1.15.3

2022-11-10 Thread Fabian Paul
-config/FLINK/versions On Wed, Nov 2, 2022 at 2:07 PM Fabian Paul wrote: > Thanks for all the replies. @xintong I'll definitely come back to your > offer when facing steps that require PMC rights for the release. > > I checked the JIRA and found four blocking/critical issues

[VOTE] Release 1.15.3, release candidate #1

2022-11-10 Thread Fabian Paul
Hi everyone, Please review and vote on the release candidate #1 for the version 1.15.3, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: - JIRA release notes [1], - t

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-13 Thread Fabian Paul
Hi everyone, I am still looking for volunteers to validate the release. I'll extend the voting period by another 48hours, please try to give it some time. Best, Fabian On Thu, Nov 10, 2022 at 5:18 PM Fabian Paul wrote: > > Hi everyone, Please review and vote on the release candi

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-15 Thread Fabian Paul
-1.15.3-rc1 [6] https://github.com/apache/flink-web/pull/581 On Mon, Nov 14, 2022 at 8:45 AM Fabian Paul wrote: > > Hi everyone, > > I am still looking for volunteers to validate the release. I'll extend > the voting period by another 48hours, please try to give it some time. &g

Re: [DISCUSS] Release Flink 1.15.3

2022-11-15 Thread Fabian Paul
wrote: > > Hi Fabian, > > I've added 1.15.4 as a new release version. > > Thanks, Martijn > > On Thu, Nov 10, 2022 at 5:18 PM Fabian Paul > wrote: >> >> I conclude that the community has accepted another release, and I will open >> the voting thre

Re: [DISCUSS] Release Flink 1.15.3

2022-11-16 Thread Fabian Paul
r > wrote: > > > Hi Fabian, > > > > I'll try to have a look tomorrow. > > > > Cheers, Martijn > > > > On Tue, Nov 15, 2022 at 6:44 PM Fabian Paul wrote: > > > > > Hi all, > > > > > > The release vote for 1.15.3-rc1

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-21 Thread Fabian Paul
ase files, and maven artifacts. > > > - Verified that the source archives do not contain any binary file. > > > - Verified that all POM files point to the same version. > > > - Checked that the README.md file does not have anything unexpected. > > > - Checked

[RESULT][VOTE] Release 1.15.3, release candidate #1

2022-11-24 Thread Fabian Paul
Hi all, @Yun sorry I forgot to post the result of the vote before continuing. I only created the tag in the repository after I received the third binding vote. I'm happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: * Danny * Mar

[ANNOUNCE] Apache Flink 1.15.3 released

2022-11-25 Thread Fabian Paul
The Apache Flink community is very happy to announce the release of Apache Flink 1.15.3, which is the third bugfix release for the Apache Flink 1.15 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming a

Re: [ANNOUNCE] Apache Flink 1.11.0, release candidate #2

2020-06-22 Thread Fabian Paul
Hi, Thanks for the great efforts in preparing the second rc. I was just going through the published artifacts and it seems that some are missing in the latest release. In comparison you can look at https://repository.apache.org/content/repositories/orgapacheflink-1370/org/apache/flink/

Re: [ANNOUNCE] Apache Flink 1.11.0, release candidate #2

2020-06-23 Thread Fabian Paul
Hi, Thanks again for uploading the missing artifacts. Unfortunately this rc does not fully compile due to [1]. Would it be possible for testing purposed to quickly include this fix into the rc or do you think it is necessary to open a complete new one? [1] https://issues.apache.org/jira/brows

[DISCUSS] Retrieve savepoint location after suspension of jobclusters

2020-08-07 Thread Fabian Paul
Hi all, Due to recent changes in the shutdown mechanism of Flink [1] it is not conveniently possible anymore to suspend a job running on a jobcluster with a savepoint and retrieve the savepoint location via the Flink API programmatically. With the introduced changes the rest endpoint shutdowns

Re: [DISCUSS] Retrieve savepoint location after suspension of jobclusters

2020-08-11 Thread Fabian Paul
Hi Till, The problem is reproducible with a basic shell script doing the following operations. 1. Post request to /jobs/${JOB_ID}/savepoints with the payload {"cancel-job": true,"target-directory": $(LOCATION)} and store the trigger ID 2. Sleep 10 seconds 3. Get jobs/${JOB_ID}

Re: [DISCUSS] Retrieve savepoint location after suspension of jobclusters

2020-08-12 Thread Fabian Paul
I attached the last log lines[1] of the jobmanager after triggering the savepoint. I just saw the release for 1.10.2 is started so it would probably be great if we determine whether it is a bug to postpone the release if necessary. What do you think? Best, Fabian [1] https://pastebin.com/eWXN5

Re: Question about v2 committer guarantees

2024-06-27 Thread Fabian Paul
Hi Scott, It's great to see further adoption of the Sink V2 architecture. Happy to answer your questions. 1. The sink architecture should ensure that Committer:commit is always called with all committables from a subtask for a given subtaskId.There is an open issue where users have reported a pro

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-08 Thread Fabian Paul
Hi Kevin, I worked on a project [1] in the past that had a similar purpose. You should be able to use a similar approach with the existing KafkaSource by implementing your own KafkaRecordDeserializationSchema that hides the logic of pulling the records from blob storage from the connector. You can

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-11 Thread Fabian Paul
Thanks for drafting this FLIP. I really like the idea of introducing a concept in Flink that is close to a logical plan submission. I have a few questions about the proposal and its future evolvability. - What is the future plan for job submissions in Flink? With the current proposal, Flink will

Re: [DISCUSS] FLIP-500: Support Join Extension in DataStream V2 API

2025-01-06 Thread Fabian Paul
Hi Xu, Thanks for drafting the FLIP. I have a question regarding the motivation for the change. So far, the datastream API doesn't support any relational operations, and if users want to use joins/groupBy etc., they usually use SQL or the table API. With this FLIP, the difference between the APIs

[jira] [Created] (FLINK-16525) TwoPhaseCommitSinkFunction subtask logs misleading name

2020-03-10 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-16525: --- Summary: TwoPhaseCommitSinkFunction subtask logs misleading name Key: FLINK-16525 URL: https://issues.apache.org/jira/browse/FLINK-16525 Project: Flink Issue

[jira] [Created] (FLINK-16553) KafkaFetcher topic/partition metrics

2020-03-11 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-16553: --- Summary: KafkaFetcher topic/partition metrics Key: FLINK-16553 URL: https://issues.apache.org/jira/browse/FLINK-16553 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16570) Difficulties to select correct metric with long name in dropdown of Flink UI task menu

2020-03-12 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-16570: --- Summary: Difficulties to select correct metric with long name in dropdown of Flink UI task menu Key: FLINK-16570 URL: https://issues.apache.org/jira/browse/FLINK-16570

[jira] [Created] (FLINK-16883) No support for log4j2 configuration formats besides properties

2020-03-31 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-16883: --- Summary: No support for log4j2 configuration formats besides properties Key: FLINK-16883 URL: https://issues.apache.org/jira/browse/FLINK-16883 Project: Flink

[jira] [Created] (FLINK-30238) Unified Sink committer does not clean up state on final savepoint

2022-11-29 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-30238: --- Summary: Unified Sink committer does not clean up state on final savepoint Key: FLINK-30238 URL: https://issues.apache.org/jira/browse/FLINK-30238 Project: Flink

[jira] [Created] (FLINK-35419) scan.bounded.latest-offset makes queries never finish if the latest message is a EndTxn Kafka marker

2024-05-22 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-35419: --- Summary: scan.bounded.latest-offset makes queries never finish if the latest message is a EndTxn Kafka marker Key: FLINK-35419 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-26613) Stateful unified Sink V2 upgrades only work when operator uids are given

2022-03-11 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26613: --- Summary: Stateful unified Sink V2 upgrades only work when operator uids are given Key: FLINK-26613 URL: https://issues.apache.org/jira/browse/FLINK-26613 Project

[jira] [Created] (FLINK-26633) Elasticsearch connector does not report recordsSend metric

2022-03-14 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26633: --- Summary: Elasticsearch connector does not report recordsSend metric Key: FLINK-26633 URL: https://issues.apache.org/jira/browse/FLINK-26633 Project: Flink

[jira] [Created] (FLINK-26701) Relocation of connector-base might break user jars due to changed imports

2022-03-17 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26701: --- Summary: Relocation of connector-base might break user jars due to changed imports Key: FLINK-26701 URL: https://issues.apache.org/jira/browse/FLINK-26701 Project

[jira] [Created] (FLINK-27480) KafkaSources sharing the groupId might lead to InstanceAlreadyExistException warning

2022-05-03 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-27480: --- Summary: KafkaSources sharing the groupId might lead to InstanceAlreadyExistException warning Key: FLINK-27480 URL: https://issues.apache.org/jira/browse/FLINK-27480

[jira] [Created] (FLINK-27484) Reduce ArchUnit violations in the project

2022-05-04 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-27484: --- Summary: Reduce ArchUnit violations in the project Key: FLINK-27484 URL: https://issues.apache.org/jira/browse/FLINK-27484 Project: Flink Issue Type

[jira] [Created] (FLINK-27486) Reduce ArchUnit violations in connector base module

2022-05-04 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-27486: --- Summary: Reduce ArchUnit violations in connector base module Key: FLINK-27486 URL: https://issues.apache.org/jira/browse/FLINK-27486 Project: Flink Issue Type

[jira] [Created] (FLINK-27493) Forward all numeric Kafka metrics to Flink's metrics system

2022-05-05 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-27493: --- Summary: Forward all numeric Kafka metrics to Flink's metrics system Key: FLINK-27493 URL: https://issues.apache.org/jira/browse/FLINK-27493 Project:

[jira] [Created] (FLINK-25041) E2E tar ball cache fails without error message if target directory not specified

2021-11-24 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25041: --- Summary: E2E tar ball cache fails without error message if target directory not specified Key: FLINK-25041 URL: https://issues.apache.org/jira/browse/FLINK-25041

[jira] [Created] (FLINK-25134) Unused RetryRule in KafkaConsumerTestBase swallows retries

2021-12-01 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25134: --- Summary: Unused RetryRule in KafkaConsumerTestBase swallows retries Key: FLINK-25134 URL: https://issues.apache.org/jira/browse/FLINK-25134 Project: Flink

[jira] [Created] (FLINK-25206) Add config option to disable configurations in the user program

2021-12-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25206: --- Summary: Add config option to disable configurations in the user program Key: FLINK-25206 URL: https://issues.apache.org/jira/browse/FLINK-25206 Project: Flink

[jira] [Created] (FLINK-25222) Remove NetworkFailureProxy used for Kafka connector tests

2021-12-08 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25222: --- Summary: Remove NetworkFailureProxy used for Kafka connector tests Key: FLINK-25222 URL: https://issues.apache.org/jira/browse/FLINK-25222 Project: Flink

[jira] [Created] (FLINK-25555) FLIP-191: Extend unified Sink interface to support small file compaction

2022-01-06 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-2: --- Summary: FLIP-191: Extend unified Sink interface to support small file compaction Key: FLINK-2 URL: https://issues.apache.org/jira/browse/FLINK-2 Project

[jira] [Created] (FLINK-25569) Introduce decomposed Sink V2 interfaces

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25569: --- Summary: Introduce decomposed Sink V2 interfaces Key: FLINK-25569 URL: https://issues.apache.org/jira/browse/FLINK-25569 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-25570) Introduce Sink V2 extension APIs

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25570: --- Summary: Introduce Sink V2 extension APIs Key: FLINK-25570 URL: https://issues.apache.org/jira/browse/FLINK-25570 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-25571) Update Elasticsearch Sink to use decomposed interfaces

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25571: --- Summary: Update Elasticsearch Sink to use decomposed interfaces Key: FLINK-25571 URL: https://issues.apache.org/jira/browse/FLINK-25571 Project: Flink Issue

[jira] [Created] (FLINK-25572) Update File Sink to use decomposed interfaces

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25572: --- Summary: Update File Sink to use decomposed interfaces Key: FLINK-25572 URL: https://issues.apache.org/jira/browse/FLINK-25572 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-25573) Update Kafka Sink to use decomposed interfaces

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25573: --- Summary: Update Kafka Sink to use decomposed interfaces Key: FLINK-25573 URL: https://issues.apache.org/jira/browse/FLINK-25573 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-25574) Update Async Sink to use decomposed interfaces

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25574: --- Summary: Update Async Sink to use decomposed interfaces Key: FLINK-25574 URL: https://issues.apache.org/jira/browse/FLINK-25574 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-25575) Implement StreamGraph translation for Sink V2 interfaces

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25575: --- Summary: Implement StreamGraph translation for Sink V2 interfaces Key: FLINK-25575 URL: https://issues.apache.org/jira/browse/FLINK-25575 Project: Flink Issue

[jira] [Created] (FLINK-25578) Graduate Sink V1 interfaces to PublicEvolving and deprecate them

2022-01-07 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25578: --- Summary: Graduate Sink V1 interfaces to PublicEvolving and deprecate them Key: FLINK-25578 URL: https://issues.apache.org/jira/browse/FLINK-25578 Project: Flink

[jira] [Created] (FLINK-25591) Use FileSource for StreamExecutionEnvironment.readFiles

2022-01-10 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25591: --- Summary: Use FileSource for StreamExecutionEnvironment.readFiles Key: FLINK-25591 URL: https://issues.apache.org/jira/browse/FLINK-25591 Project: Flink Issue

[jira] [Created] (FLINK-25608) Mark metrics as Public(Evolving)

2022-01-11 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25608: --- Summary: Mark metrics as Public(Evolving) Key: FLINK-25608 URL: https://issues.apache.org/jira/browse/FLINK-25608 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-25726) Implement GlobalCommitter as custom post commit topology

2022-01-20 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25726: --- Summary: Implement GlobalCommitter as custom post commit topology Key: FLINK-25726 URL: https://issues.apache.org/jira/browse/FLINK-25726 Project: Flink Issue

[jira] [Created] (FLINK-25857) Add committer metrics to track the status of committables

2022-01-27 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25857: --- Summary: Add committer metrics to track the status of committables Key: FLINK-25857 URL: https://issues.apache.org/jira/browse/FLINK-25857 Project: Flink

[jira] [Created] (FLINK-25919) Sink V2 improvements and followups

2022-02-02 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25919: --- Summary: Sink V2 improvements and followups Key: FLINK-25919 URL: https://issues.apache.org/jira/browse/FLINK-25919 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-25920) Allow receiving updates of CommittableSummary

2022-02-02 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25920: --- Summary: Allow receiving updates of CommittableSummary Key: FLINK-25920 URL: https://issues.apache.org/jira/browse/FLINK-25920 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-25921) Support different input parallelism for preCommit topology

2022-02-02 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-25921: --- Summary: Support different input parallelism for preCommit topology Key: FLINK-25921 URL: https://issues.apache.org/jira/browse/FLINK-25921 Project: Flink

[jira] [Created] (FLINK-26118) AsyncSinks do not support downscaling with state

2022-02-14 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26118: --- Summary: AsyncSinks do not support downscaling with state Key: FLINK-26118 URL: https://issues.apache.org/jira/browse/FLINK-26118 Project: Flink Issue Type

[jira] [Created] (FLINK-26119) AsyncSinkWriterStateSerializer needs to be PublicEvolving

2022-02-14 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26119: --- Summary: AsyncSinkWriterStateSerializer needs to be PublicEvolving Key: FLINK-26119 URL: https://issues.apache.org/jira/browse/FLINK-26119 Project: Flink

[jira] [Created] (FLINK-26254) KafkaSink might violate order of sequence numbers and risk exactly-once processing

2022-02-18 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26254: --- Summary: KafkaSink might violate order of sequence numbers and risk exactly-once processing Key: FLINK-26254 URL: https://issues.apache.org/jira/browse/FLINK-26254

[jira] [Created] (FLINK-26304) GlobalCommitter can receive failed committables

2022-02-22 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26304: --- Summary: GlobalCommitter can receive failed committables Key: FLINK-26304 URL: https://issues.apache.org/jira/browse/FLINK-26304 Project: Flink Issue Type

  1   2   >