Re: [VOTE] FLIP-513: Split-level watermark metrics

2025-03-17 Thread Stefan Richter
+1 (binding) Best, Stefan > On 17. Mar 2025, at 11:04, Efrat Levitan wrote: > > Hi everyone, > > I'd like to start a vote on FLIP-513: Split-level watermark metrics [1] > which has been discussed in this thread [2]. > The vote will be open for at least 72 hours unless there is an objection o

Re: [VOTE] FLIP-491: BundledAggregateFunction for batched aggregation

2025-02-24 Thread Stefan Richter
+1 (binding) Thanks, Stefan On 2025/02/24 14:15:09 Fabian Hüske wrote: > +1 (binding) > > Thank you, > Fabian > > On Mon, Feb 24, 2025 at 12:32 PM Timo Walther wrote: > > > +1 (binding) > > > > Thanks for working on this FLIP. > > > > Best regards, > > Timo > > > > On 14.02.25 22:32, Alan She

Re: [VOTE] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-12 Thread Stefan Richter
+1 (binding) Best, Stefan > On 12. Nov 2024, at 11:47, Dawid Wysakowicz wrote: > > +1 (binding) > Best, > Dawid > > On Tue, 12 Nov 2024 at 09:28, Fabian Hüske > > wrote: > >> +1 (binding) >> >> Thanks, Fabian >> >> On Tue, Nov 12, 2024 at 4:13 AM She

Re: [VOTE] FLIP-471: Fixing watermark idleness timeout accounting

2024-07-31 Thread Stefan Richter
+1 (binding) Best, Stefan > On 31. Jul 2024, at 04:56, Zakelly Lan wrote: > > +1 (binding) > > > Best, > Zakelly > > On Wed, Jul 31, 2024 at 12:07 AM Piotr Nowojski > wrote: > >> Hi all! >> >> I would like to open the vote for FLIP-471 [1]. It has been discussed here >> [2]. >> >> The

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Stefan Richter
+1 (binding) Best, Stefan > On 26. Jun 2024, at 16:14, Hong wrote: > > +1 (binding) > > Hong > >> On 26 Jun 2024, at 12:27, Keith Lee > > wrote: >> >> +1 (non binding) >> >> Best regards >> Keith Lee >> >> >>> On Wed, Jun 26, 2024 at 9:48 AM Zakelly

Re: [VOTE] FLIP-443: Interruptible watermark processing

2024-05-27 Thread Stefan Richter
+1 (binding) > On 24. May 2024, at 09:59, Martijn Visser wrote: > > +1 (binding) > > On Fri, May 24, 2024 at 7:31 AM weijie guo > > wrote: > >> +1(binding) >> >> Thanks for driving this! >> >> Best regards, >> >> Weijie >> >> >> Rui Fan <1996fan...@gm

Re: [VOTE] FLIP-452: Allow Skipping Invocation of Function Calls While Constant-folding

2024-05-08 Thread Stefan Richter
Hi Alan, Thanks for this proposal, the ability to exclude functions from constant folding makes sense to me. +1 (binding) Best, Stefan > On 8. May 2024, at 02:01, Alan Sheinberg > wrote: > > Hi everyone, > > I'd like to start a vote on FLIP-452 [1]. It covers adding a new method > Function

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-06 Thread Stefan Richter
+1 (binding) Thanks for updating to a new version! Best, Stefan > On 6. May 2024, at 08:36, Hangxiang Yu wrote: > > +1(binding) > > On Mon, May 6, 2024 at 12:25 PM Yuan Mei > wrote: > >> +1(binding) >> >> Best >> Yuan >> >> On Mon, May 6, 2024 at 11:28 AM R

Re: [DISCUSS] FLIP-444: Native file copy support

2024-04-30 Thread Stefan Richter
Hi, Thanks for the proposal, I think improving download speed in this way is a great idea. Hope we can have similar improvements for other clouds as well. Best, Stefan > On 30. Apr 2024, at 15:15, Piotr Nowojski wrote: > > Hi all! > > I would like to put under discussion: > > FLIP-444: Nat

Re: [DISCUSS] FLIP-443: Interruptible watermark processing

2024-04-30 Thread Stefan Richter
Thanks for the improvement proposal, I’m +1 for the change! Best, Stefan > On 30. Apr 2024, at 15:23, Roman Khachatryan wrote: > > Thanks for the proposal, I definitely see the need for this improvement, +1. > > Regards, > Roman > > > On Tue, Apr 30, 2024 at 3:11 PM Piotr Nowojski

[jira] [Created] (FLINK-34693) Memory leak in KafkaWriter

2024-03-15 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34693: -- Summary: Memory leak in KafkaWriter Key: FLINK-34693 URL: https://issues.apache.org/jira/browse/FLINK-34693 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34579) Introduce metric for time since last completed checkpoint

2024-03-05 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34579: -- Summary: Introduce metric for time since last completed checkpoint Key: FLINK-34579 URL: https://issues.apache.org/jira/browse/FLINK-34579 Project: Flink

[jira] [Created] (FLINK-34546) Emit span with failure labels on failure

2024-02-29 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34546: -- Summary: Emit span with failure labels on failure Key: FLINK-34546 URL: https://issues.apache.org/jira/browse/FLINK-34546 Project: Flink Issue Type

[jira] [Created] (FLINK-34199) Add tracing for durations of rescaling/restoring from local state

2024-01-22 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34199: -- Summary: Add tracing for durations of rescaling/restoring from local state Key: FLINK-34199 URL: https://issues.apache.org/jira/browse/FLINK-34199 Project: Flink

[jira] [Created] (FLINK-34134) Add tracing for restored state size and locations

2024-01-17 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34134: -- Summary: Add tracing for restored state size and locations Key: FLINK-34134 URL: https://issues.apache.org/jira/browse/FLINK-34134 Project: Flink Issue

Re: [VOTE] FLIP-386: Support adding custom metrics in Recovery Spans

2023-11-29 Thread Stefan Richter
+1 (binding) Best, Stefan > On 23. Nov 2023, at 09:49, Roman Khachatryan wrote: > > +1 (binding) > > Regards, > Roman > > > On Wed, Nov 22, 2023 at 12:55 PM Rui Fan <1996fan...@gmail.com > > wrote: > >> +1(binding) >> >> Thanks for driving this proposal! >>

Re: [VOTE] FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

2023-11-29 Thread Stefan Richter
+1 (binding) Best, Stefan > On 22. Nov 2023, at 12:34, Jing Ge wrote: > > +1(binding) > Thanks! > > Best Regards, > Jing > > On Wed, Nov 22, 2023 at 11:21 AM Roman Khachatryan > wrote: > >> +1 (binding) >> >> Regards, >> Roman >> >> On Wed, Nov 22, 2023, 7:30 AM

Re: [VOTE] FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-29 Thread Stefan Richter
+1 (binding) Best, Stefan > On 22. Nov 2023, at 11:20, Roman Khachatryan wrote: > > +1 (binding) > > Regards, > Roman > > On Wed, Nov 22, 2023, 7:08 AM Zakelly Lan > wrote: > >> +1(non-binding) >> >> Best, >> Zakelly >> >> On Wed, Nov 22, 2023 at 3:04 PM Han

[jira] [Created] (FLINK-33341) Use available local state for rescaling

2023-10-23 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33341: -- Summary: Use available local state for rescaling Key: FLINK-33341 URL: https://issues.apache.org/jira/browse/FLINK-33341 Project: Flink Issue Type

[jira] [Created] (FLINK-33246) Add RescalingIT case that uses checkpoints and resource requests

2023-10-11 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33246: -- Summary: Add RescalingIT case that uses checkpoints and resource requests Key: FLINK-33246 URL: https://issues.apache.org/jira/browse/FLINK-33246 Project: Flink

[jira] [Created] (FLINK-33077) Minimize the risk of hard back-pressure with buffer debloating enabled

2023-09-12 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33077: -- Summary: Minimize the risk of hard back-pressure with buffer debloating enabled Key: FLINK-33077 URL: https://issues.apache.org/jira/browse/FLINK-33077 Project

Re: [DISCUSS] FLIP-357: Deprecate Iteration API of DataStream

2023-09-06 Thread Stefan Richter
+1 Thanks, Stefan > On 5. Sep 2023, at 10:45, David Morávek wrote: > > +1 since there is an alternative, more complete implementation available > > Best, > D. > > On Sat, Sep 2, 2023 at 12:07 AM David Anderson > wrote: > >> +1 >> >> Keeping the legacy impleme

Re: [DISCUSS][2.0] FLIP-349: Move RocksDB statebackend classes to o.a.f.state.rocksdb package

2023-07-25 Thread Stefan Richter
+1 > On 24. Jul 2023, at 12:25, Chesnay Schepler wrote: > > To properly reflect the state of the rocksdb statebackend I propose to move > all classes in the state-backend-rocksdb module under the classes to > o.a.f.state.rocksdb package. > > > https://www.google.com/url?q=https://cwiki.ap

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-07-20 Thread Stefan Richter
+1 (binding) Thanks, Stefan > On 20. Jul 2023, at 05:24, Zhu Zhu wrote: > > +1 (binding) > > Thanks, > Zhu > > yuxia mailto:luoyu...@alumni.sjtu.edu.cn>> > 于2023年7月20日周四 09:23写道: >> >> +1(binding) >> >> Best regards, >> Yuxia >> >> - 原始邮件 - >> 发件人: "Guowei Ma" >> 收件人: "dev" >>

Re: [DISCUSS] FLIP-325: Support configuring end-to-end allowed latency

2023-07-10 Thread Stefan Richter
Hi, After reading through the discussion, I think the FLIP should provide additional details and explanations about the exact semantics of the end-to-end latency configuration and how it interacts with all other configurations around latency, such as checkpointing. In this context, I have a few

Re: [VOTE] FLIP-321: introduce an API deprecation process

2023-07-03 Thread Stefan Richter
+1 (binding) > On 3. Jul 2023, at 10:08, Martijn Visser wrote: > > +1 (binding) > > > > On Mon, Jul 3, 2023 at 10:03 AM Xintong Song > wrote: > >> +1 (binding) >> >> Best, >> >> Xintong >> >> >> >> On Sat, Jul 1, 2023 at 11:26 PM Dong Lin wrote: >> >>>

[jira] [Created] (FLINK-32437) Determine and set correct maxParallelism for operator chains

2023-06-26 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32437: -- Summary: Determine and set correct maxParallelism for operator chains Key: FLINK-32437 URL: https://issues.apache.org/jira/browse/FLINK-32437 Project: Flink

[jira] [Created] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

2023-06-21 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32410: -- Summary: Allocate hash-based collections with sufficient capacity for expected size Key: FLINK-32410 URL: https://issues.apache.org/jira/browse/FLINK-32410

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-20 Thread Stefan Richter
Hi Xintong, Thanks for the summary, most of the points that you agreed upon also make sense to me. > 2. Dropping deprecated Public APIs in minor releases, or demoting APIs > from Public to PublicEvolving / Experimental / Retired in any version bump, > are not good practices. I hope we can

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-19 Thread Stefan Richter
there will be a cycle > in the data flow, it will be hard for current Flink to schedule this kind > of graph. I admit we can find a way to do this, but that's probably a > bit outside the scope of this FLIP. So let's do these complex > optimizations later, WDYT?

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-19 Thread Stefan Richter
s#More+underlying+implementations). > > Best, > Lijie > > Stefan Richter <mailto:srich...@confluent.io.invalid>> 于2023年6月19日周一 15:58写道: > >> >> Hi Lijie, >> >> thanks for your response, I agree with what you said about points 2 and 3. >> Let me

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-19 Thread Stefan Richter
bloom filter > implementation introduces some complexity (we need to implement it, test > it, etc), and is not the focus of this FLIP. > > [1] > https://www.google.com/url?q=https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/tuning/%23local-global-aggregation&am

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-16 Thread Stefan Richter
load partitions once we collected enough keys for one round of loading. Best, Stefan <https://www.confluent.io/> Stefan Richter Principal Engineer II Follow us: <https://www.confluent.io/blog?utm_source=footer&utm_medium=email&utm_campaign=ch.email-signature_type.commu

[jira] [Created] (FLINK-32345) Improve parallel download of RocksDB incremental state

2023-06-15 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32345: -- Summary: Improve parallel download of RocksDB incremental state Key: FLINK-32345 URL: https://issues.apache.org/jira/browse/FLINK-32345 Project: Flink

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-13 Thread Stefan Richter
evel of stability for Flink. > > So, it looks like our story for API stability and compatibility would be > complete with this FLIP. > > Thanks, > > Jiangjie (Becket) Qin > > > On Tue, Jun 13, 2023 at 12:30 AM Stefan Richter > mailto:srich...@confluent.io.invalid>&g

[jira] [Created] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

2023-06-13 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32326: -- Summary: Disable WAL in RocksDBWriteBatchWrapper by default Key: FLINK-32326 URL: https://issues.apache.org/jira/browse/FLINK-32326 Project: Flink Issue

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-12 Thread Stefan Richter
easier to write adapter code than changing method signatures in-place on the existing interface. Those concerns should be considered in our process for evolving interfaces. Best, Stefan <https://www.confluent.io/> Stefan Richter Principal Engineer II Follow us: <https://www.con

Re: [DISCUSS] FLIP-151: Incremental snapshots for heap-based state backend

2020-11-09 Thread Stefan Richter
Hi, Very happy to see that the incremental checkpoint idea is finally becoming a reality for the heap backend! Overall the proposal looks pretty good to me. Just wanted to point out one possible improvement from what I can still remember from my ideas back then: I think you can avoid doing peri

[jira] [Created] (FLINK-13325) Add test case for FLINK-13249

2019-07-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-13325: -- Summary: Add test case for FLINK-13249 Key: FLINK-13325 URL: https://issues.apache.org/jira/browse/FLINK-13325 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-13248) Enhance mailbox executor with yield-to-downstream functionality

2019-07-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-13248: -- Summary: Enhance mailbox executor with yield-to-downstream functionality Key: FLINK-13248 URL: https://issues.apache.org/jira/browse/FLINK-13248 Project: Flink

[jira] [Created] (FLINK-12958) Integrate AsyncWaitOperator with mailbox

2019-06-24 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12958: -- Summary: Integrate AsyncWaitOperator with mailbox Key: FLINK-12958 URL: https://issues.apache.org/jira/browse/FLINK-12958 Project: Flink Issue Type: Sub

Re: [DISCUSS] Change threading-model in StreamTask to a mailbox-based approach

2019-06-12 Thread Stefan Richter
As there have been no objections, we are moving forward with this effort. Progress is tracked here: https://issues.apache.org/jira/browse/FLINK-12477 <https://issues.apache.org/jira/browse/FLINK-12477> Best, Stefan > On 7. May 2019, at 17:39, Stefan Richter wrote: > > Hi,

[jira] [Created] (FLINK-12804) Introduce mailbox-based ExecutorService

2019-06-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12804: -- Summary: Introduce mailbox-based ExecutorService Key: FLINK-12804 URL: https://issues.apache.org/jira/browse/FLINK-12804 Project: Flink Issue Type: Sub

Re: [DISCUSS] Proposal to support disk spilling in HeapKeyedStateBackend

2019-05-29 Thread Stefan Richter
Hi Yu, Sorry for the late reaction. As already discussed internally, I think this is a very good proposal and design that can help to improve a major limitation of the current state backend. I think that most discussion is happening in the design doc and I left my comments there. Looking forwar

[jira] [Created] (FLINK-12591) StatsDReporterTest is unstable

2019-05-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12591: -- Summary: StatsDReporterTest is unstable Key: FLINK-12591 URL: https://issues.apache.org/jira/browse/FLINK-12591 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12484) Drop unnecessary locking for code-paths that now use the mailbox

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12484: -- Summary: Drop unnecessary locking for code-paths that now use the mailbox Key: FLINK-12484 URL: https://issues.apache.org/jira/browse/FLINK-12484 Project: Flink

[jira] [Created] (FLINK-12483) Support (legacy) SourceFunctions with mailbox

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12483: -- Summary: Support (legacy) SourceFunctions with mailbox Key: FLINK-12483 URL: https://issues.apache.org/jira/browse/FLINK-12483 Project: Flink Issue Type

[jira] [Created] (FLINK-12482) Make checkpoint trigger/notifyComplete run via the mailbox queue

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12482: -- Summary: Make checkpoint trigger/notifyComplete run via the mailbox queue Key: FLINK-12482 URL: https://issues.apache.org/jira/browse/FLINK-12482 Project: Flink

[jira] [Created] (FLINK-12481) Make processing time timer trigger run via the mailbox

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12481: -- Summary: Make processing time timer trigger run via the mailbox Key: FLINK-12481 URL: https://issues.apache.org/jira/browse/FLINK-12481 Project: Flink

[jira] [Created] (FLINK-12480) Introduce mailbox to StreamTask main-loop

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12480: -- Summary: Introduce mailbox to StreamTask main-loop Key: FLINK-12480 URL: https://issues.apache.org/jira/browse/FLINK-12480 Project: Flink Issue Type

[jira] [Created] (FLINK-12479) Make InputProcessors and StreamIterationHead non-blocking

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12479: -- Summary: Make InputProcessors and StreamIterationHead non-blocking Key: FLINK-12479 URL: https://issues.apache.org/jira/browse/FLINK-12479 Project: Flink

[jira] [Created] (FLINK-12478) Decompose monolithic run-loops in StreamTask implementations into step-wise calls

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12478: -- Summary: Decompose monolithic run-loops in StreamTask implementations into step-wise calls Key: FLINK-12478 URL: https://issues.apache.org/jira/browse/FLINK-12478

[jira] [Created] (FLINK-12477) Change threading-model in StreamTask to a mailbox-based approach

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12477: -- Summary: Change threading-model in StreamTask to a mailbox-based approach Key: FLINK-12477 URL: https://issues.apache.org/jira/browse/FLINK-12477 Project: Flink

[DISCUSS] Change threading-model in StreamTask to a mailbox-based approach

2019-05-07 Thread Stefan Richter
Hi, we want to start a discussion about changing the threading-model in stream task to a mailbox-based approach: https://docs.google.com/document/d/1eDpsUKv2FqwZiS1Pm6gYO5eFHScBHfULKmH1-ZEWB4g/edit?usp=sharing

Re: kafka partitions, data locality

2019-04-26 Thread Stefan Richter
Hi Sergey, The point why this I flagged as beta is actually less about stability but more about the fact that this is supposed to be more of a "power user" feature because bad things can happen if your data is not 100% correctly partitioned in the same way as Flink would partition it. This is w

Re: Introducing Flink's Plugin mechanism

2019-04-10 Thread Stefan Richter
Thank you Piotr for bringing this discussion to the mailing list! As it was not explicitly mentioned in the first email, I wanted to add that there is also already an open PR[1] with my implementation of the basic plugin mechanism for FileSystem. Looking forward to some feedback from the communi

Re: [ANNOUNCE] Apache Flink 1.8.0 released

2019-04-10 Thread Stefan Richter
Congrats and thanks to Aljoscha for managing the release! Best, Stefan > On 10. Apr 2019, at 13:01, Biao Liu wrote: > > Great news! Thanks Aljoscha and all the contributors. > > Till Rohrmann mailto:trohrm...@apache.org>> > 于2019年4月10日周三 下午6:11写道: > Thanks a lot to Aljoscha for being our rele

[jira] [Created] (FLINK-12143) Mechanism to ship plugin jars in the cluster

2019-04-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12143: -- Summary: Mechanism to ship plugin jars in the cluster Key: FLINK-12143 URL: https://issues.apache.org/jira/browse/FLINK-12143 Project: Flink Issue Type

[jira] [Created] (FLINK-11980) Improve efficiency of iterating KeySelectionListener on notification

2019-03-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11980: -- Summary: Improve efficiency of iterating KeySelectionListener on notification Key: FLINK-11980 URL: https://issues.apache.org/jira/browse/FLINK-11980 Project

[jira] [Created] (FLINK-11956) Remove shading from filesystems build

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11956: -- Summary: Remove shading from filesystems build Key: FLINK-11956 URL: https://issues.apache.org/jira/browse/FLINK-11956 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11955: -- Summary: Modify build to move filesystems from lib to plugins folder Key: FLINK-11955 URL: https://issues.apache.org/jira/browse/FLINK-11955 Project: Flink

[jira] [Created] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11953: -- Summary: Introduce Plugin/Loading system and integrate it with FileSystem Key: FLINK-11953 URL: https://issues.apache.org/jira/browse/FLINK-11953 Project: Flink

[jira] [Created] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11954: -- Summary: Provide unit test(s) for new plugin infrastructure Key: FLINK-11954 URL: https://issues.apache.org/jira/browse/FLINK-11954 Project: Flink Issue

[jira] [Created] (FLINK-11952) Introduce Plugin Architecture for loading FileSystems

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11952: -- Summary: Introduce Plugin Architecture for loading FileSystems Key: FLINK-11952 URL: https://issues.apache.org/jira/browse/FLINK-11952 Project: Flink

[jira] [Created] (FLINK-11744) Provide stable/final toHexString for AbstractID

2019-02-25 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11744: -- Summary: Provide stable/final toHexString for AbstractID Key: FLINK-11744 URL: https://issues.apache.org/jira/browse/FLINK-11744 Project: Flink Issue

[jira] [Created] (FLINK-11417) Make access to ExecutionGraph single threaded from JobMaster main thread

2019-01-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11417: -- Summary: Make access to ExecutionGraph single threaded from JobMaster main thread Key: FLINK-11417 URL: https://issues.apache.org/jira/browse/FLINK-11417 Project

[jira] [Created] (FLINK-11141) Key generation for RocksDBMapState can theoretically be ambiguous

2018-12-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11141: -- Summary: Key generation for RocksDBMapState can theoretically be ambiguous Key: FLINK-11141 URL: https://issues.apache.org/jira/browse/FLINK-11141 Project: Flink

[jira] [Created] (FLINK-11121) Check and update licensing notes for Aliyun FS [FLINK-10865]

2018-12-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11121: -- Summary: Check and update licensing notes for Aliyun FS [FLINK-10865] Key: FLINK-11121 URL: https://issues.apache.org/jira/browse/FLINK-11121 Project: Flink

[jira] [Created] (FLINK-11012) Introduce abstract superclass for filesystem IT cases

2018-11-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11012: -- Summary: Introduce abstract superclass for filesystem IT cases Key: FLINK-11012 URL: https://issues.apache.org/jira/browse/FLINK-11012 Project: Flink

[jira] [Created] (FLINK-10863) Assign uids to all operators

2018-11-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10863: -- Summary: Assign uids to all operators Key: FLINK-10863 URL: https://issues.apache.org/jira/browse/FLINK-10863 Project: Flink Issue Type: Sub-task

Re: Kinesis consumer e2e test

2018-11-12 Thread Stefan Richter
tion, I will see what I can do in that regard. From > where I start it may make more sense to do some of that as follow-up when > the Kafka test is ported. > > Thanks, > Thomas > > > On Thu, Nov 8, 2018 at 10:20 AM Stefan Richter > wrote: > >> Hi, >> &g

Re: How to use RocksDBStateBackend predefined options

2018-11-12 Thread Stefan Richter
tion > file seems to be a valid feature request to me. > > @Stefan Richter (cc'd): Are there any reasons that speak against > exposing these options via the configuration file in your opinion? > > Best, > > Ufuk > > [1] Looking at the code in [2] and [3], the only o

[jira] [Created] (FLINK-10839) Fix implementation of PojoSerializer.duplicate() w.r.t. subclass serializer

2018-11-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10839: -- Summary: Fix implementation of PojoSerializer.duplicate() w.r.t. subclass serializer Key: FLINK-10839 URL: https://issues.apache.org/jira/browse/FLINK-10839

[jira] [Created] (FLINK-10828) Enforce that all TypeSerializers are tested through SerializerTestBase

2018-11-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10828: -- Summary: Enforce that all TypeSerializers are tested through SerializerTestBase Key: FLINK-10828 URL: https://issues.apache.org/jira/browse/FLINK-10828 Project

[jira] [Created] (FLINK-10827) Add test for duplicate() to SerializerTestBase

2018-11-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10827: -- Summary: Add test for duplicate() to SerializerTestBase Key: FLINK-10827 URL: https://issues.apache.org/jira/browse/FLINK-10827 Project: Flink Issue

Re: Kinesis consumer e2e test

2018-11-08 Thread Stefan Richter
and we could also port the tests for Kafka to that. What do you think? Best, Stefan > On 8. Nov 2018, at 07:22, Tzu-Li (Gordon) Tai wrote: > > Hi Thomas, > > I think Stefan Richter is also working on the Kinesis end-to-end test, and > seems to be planning to implement it agai

Re: [DISCUSS]Rethink the rescale operation, can we do it async

2018-11-08 Thread Stefan Richter
Hi, in general, I think it is clearly a good idea to make rescaling as cheap and as dynamic as possible and this is a goal that is surely on the long term roadmap of Flink. However, from a technical point of view I think that things are not as simple if you go into details, and details is what

[jira] [Created] (FLINK-10816) Fix LockableTypeSerializer.duplicate()

2018-11-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10816: -- Summary: Fix LockableTypeSerializer.duplicate() Key: FLINK-10816 URL: https://issues.apache.org/jira/browse/FLINK-10816 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-10793) Change visibility of TtlValue and TtlSerializer to public for external tools

2018-11-05 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10793: -- Summary: Change visibility of TtlValue and TtlSerializer to public for external tools Key: FLINK-10793 URL: https://issues.apache.org/jira/browse/FLINK-10793

[jira] [Created] (FLINK-10713) RestartIndividualStrategy does not restore state

2018-10-29 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10713: -- Summary: RestartIndividualStrategy does not restore state Key: FLINK-10713 URL: https://issues.apache.org/jira/browse/FLINK-10713 Project: Flink Issue

[jira] [Created] (FLINK-10712) RestartPipelinedRegionStrategy does not restore state

2018-10-29 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10712: -- Summary: RestartPipelinedRegionStrategy does not restore state Key: FLINK-10712 URL: https://issues.apache.org/jira/browse/FLINK-10712 Project: Flink

[jira] [Created] (FLINK-10652) Update StatefulJobWBroadcastStateMigrationITCase for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10652: -- Summary: Update StatefulJobWBroadcastStateMigrationITCase for 1.6 Key: FLINK-10652 URL: https://issues.apache.org/jira/browse/FLINK-10652 Project: Flink

[jira] [Created] (FLINK-10650) Update BucketingSinkMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10650: -- Summary: Update BucketingSinkMigrationTest for 1.6 Key: FLINK-10650 URL: https://issues.apache.org/jira/browse/FLINK-10650 Project: Flink Issue Type

[jira] [Created] (FLINK-10651) Update CEPMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10651: -- Summary: Update CEPMigrationTest for 1.6 Key: FLINK-10651 URL: https://issues.apache.org/jira/browse/FLINK-10651 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10649) Update FlinkKafkaConsumerBaseMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10649: -- Summary: Update FlinkKafkaConsumerBaseMigrationTest for 1.6 Key: FLINK-10649 URL: https://issues.apache.org/jira/browse/FLINK-10649 Project: Flink Issue

[jira] [Created] (FLINK-10648) Update ContinuousFileProcessingMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10648: -- Summary: Update ContinuousFileProcessingMigrationTest for 1.6 Key: FLINK-10648 URL: https://issues.apache.org/jira/browse/FLINK-10648 Project: Flink

[jira] [Created] (FLINK-10646) Update AbstractOperatorRestoreTestBase for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10646: -- Summary: Update AbstractOperatorRestoreTestBase for 1.6 Key: FLINK-10646 URL: https://issues.apache.org/jira/browse/FLINK-10646 Project: Flink Issue

[jira] [Created] (FLINK-10647) Update WindowOperatorMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10647: -- Summary: Update WindowOperatorMigrationTest for 1.6 Key: FLINK-10647 URL: https://issues.apache.org/jira/browse/FLINK-10647 Project: Flink Issue Type

[jira] [Created] (FLINK-10645) Update StatefulJobSavepointMigrationITCase for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10645: -- Summary: Update StatefulJobSavepointMigrationITCase for 1.6 Key: FLINK-10645 URL: https://issues.apache.org/jira/browse/FLINK-10645 Project: Flink Issue

[jira] [Created] (FLINK-10490) OperatorSnapshotUtil should probably use SavepointV2Serializer

2018-10-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10490: -- Summary: OperatorSnapshotUtil should probably use SavepointV2Serializer Key: FLINK-10490 URL: https://issues.apache.org/jira/browse/FLINK-10490 Project: Flink

[jira] [Created] (FLINK-10433) Stepwise creation of the ExecutionGraph sub-structures

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10433: -- Summary: Stepwise creation of the ExecutionGraph sub-structures Key: FLINK-10433 URL: https://issues.apache.org/jira/browse/FLINK-10433 Project: Flink

[jira] [Created] (FLINK-10432) Introduce bulk/group-aware scheduling

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10432: -- Summary: Introduce bulk/group-aware scheduling Key: FLINK-10432 URL: https://issues.apache.org/jira/browse/FLINK-10432 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-10431) Extract scheduling-related code from SlotPool

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10431: -- Summary: Extract scheduling-related code from SlotPool Key: FLINK-10431 URL: https://issues.apache.org/jira/browse/FLINK-10431 Project: Flink Issue Type

[jira] [Created] (FLINK-10430) Extract scheduling-related code from Executions

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10430: -- Summary: Extract scheduling-related code from Executions Key: FLINK-10430 URL: https://issues.apache.org/jira/browse/FLINK-10430 Project: Flink Issue

[jira] [Created] (FLINK-10429) Redesign Flink Scheduling, introducing dedicated Scheduler component

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10429: -- Summary: Redesign Flink Scheduling, introducing dedicated Scheduler component Key: FLINK-10429 URL: https://issues.apache.org/jira/browse/FLINK-10429 Project

[jira] [Created] (FLINK-10377) Remove precondition in TwoPhaseCommitSinkFunction.notifyCheckpointComplete

2018-09-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10377: -- Summary: Remove precondition in TwoPhaseCommitSinkFunction.notifyCheckpointComplete Key: FLINK-10377 URL: https://issues.apache.org/jira/browse/FLINK-10377

Re: [ANNOUNCE] New committer Gary Yao

2018-09-07 Thread Stefan Richter
Congrats Gary! > Am 07.09.2018 um 15:14 schrieb Till Rohrmann : > > Hi everybody, > > On behalf of the PMC I am delighted to announce Gary Yao as a new Flink > committer! > > Gary started contributing to the project in June 2017. He helped with the > Flip-6 implementation, implemented many of t

[jira] [Created] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2018-09-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10297: -- Summary: PostVersionedIOReadableWritable ignores result of InputStream.read(...) Key: FLINK-10297 URL: https://issues.apache.org/jira/browse/FLINK-10297 Project

[jira] [Created] (FLINK-10200) Consolidate FileBasedStateOutputStream and FsCheckpointStateOutputStream

2018-08-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10200: -- Summary: Consolidate FileBasedStateOutputStream and FsCheckpointStateOutputStream Key: FLINK-10200 URL: https://issues.apache.org/jira/browse/FLINK-10200 Project

[jira] [Created] (FLINK-10198) Set Env object in DBOptions for RocksDB

2018-08-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10198: -- Summary: Set Env object in DBOptions for RocksDB Key: FLINK-10198 URL: https://issues.apache.org/jira/browse/FLINK-10198 Project: Flink Issue Type

  1   2   3   4   >