cannot locate classes in flink-release-2.0-preview1 source

2024-12-11 Thread Enric Ott
Hello,Community:   When I import flink-release-2.0-preview1 source to Intellij Idea,some imported class found cannot be located,and I post them as follows,are they imported from some pre-built modules or they just lay somewhere of the project.   Thanks,guys. 38D99134@52E32E75.495B5967.png Descri

?????? How the Async Exuecution Model improved the throughtput

2024-11-25 Thread Enric Ott
Thank you,Zakelly. Seems that versions before 2.0-preview just handle the state I/O with the user thread?My gosh. --  -- ??: "Zake

How the Async Exuecution Model improved the throughtput

2024-11-25 Thread Enric Ott
Hello,Community:   I'm conducting experiments on flink-release-2.0-preview1,and I got puzzled that How the Async Exuecution Model achieved significant improvement on end to end throughput  in the scenarios of streaming state processing.The state access is relatively light weighted(in my personal

How the Async Exuecution Model improvement the throughput

2024-11-25 Thread Enric Ott
Hello,Community:   I'm conducting experiments on flink-release-2.0-preview1,and I got puzzled that How the Async Exuecution Model achieved significant improvement on end to end throughput in the scenarios of streaming state processing.The state access is relatively light weighted(in my personal

??????[ANNOUNCE] Apache Flink 2.0 Preview released

2024-11-03 Thread Enric Ott
Hello,Community:   Is there a compelete benchmark for Apache Flink 2.0 Preview?   Thanks. --  -- ??: "Enri

??????[ANNOUNCE] Apache Flink 2.0 Preview released

2024-10-23 Thread Enric Ott
How to import the source code(from github) to Intelligent Idea,seems that a project descriptor is missing. --  -- ??: "Xintong Son

flow model based autoscaling

2024-09-26 Thread Enric Ott
Hi,Community:   I wonder if there any plan to develop flow model based autoscaling feature?   A possible Flow model based autoscaling mechanism may work as follow steps: 1.take flow metrics samples from operators,maybe other features. 2.infer operators to be tuned and associated operator parallel

flink datastream to table convertion

2024-09-03 Thread Enric Ott
Hi,Community:   Are there any approaches to add with clause to flink table definition in some way of dynamic?   Thanks.

flink datastream to table convertion

2024-09-03 Thread Enric Ott
Hi,Community:   Are there any approaches to add with clause to flink table definition in some way of dynamic?   Thanks.

?????? checkpoint upload thread

2024-08-01 Thread Enric Ott
ink/streaming/runtime/tasks/SubtaskCheckpointCoordinatorImpl.java#L716 > > Enric Ott <243816...@qq.com> ??2024??7??30?? 11:11?? > > > > Hi,Community: > >   Does Flink upload states and inflight buffers within the same opratorchain using the same connecti

?????? checkpoint upload thread

2024-07-31 Thread Enric Ott
a/src/main/java/org/apache/flink/streaming/runtime/tasks/StreamTask.java#L443 [2] https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/SubtaskCheckpointCoordinatorImpl.java#L716 Enric Ott <243816...@qq.com> ??2024??7

checkpoint upload thread

2024-07-29 Thread Enric Ott
Hi,Community:   Does Flink upload states and inflight buffers within the same opratorchain using the same connection (instead of per connection per operator)?

Re: flight buffer local storage

2024-07-22 Thread Enric Ott
Thanks,Zhanghao. I think it's the async upload mechanism helped mitigating the in flight buffers materialization latency,and the execution vertex restarting procedure just reads the in flight buffers and the local  TaskStateSnapshots to make its job done. -- Original 

Re: Buffer Priority

2024-07-17 Thread Enric Ott
nghao Chen" https://issues.apache.org/jira/browse/FLINK-19026 for more details where it is firstly introduced. Best, Zhanghao Chen From: Enric Ott <243816...@qq.com> Sent: Wednesday, July 10, 2024 18:02 To: user

flight buffer local storage

2024-07-17 Thread Enric Ott
Hello,Community:  Why doesn't flink store in flight buffers to local disks when it checkpoints?   Thanks.

Re: Flink reactive deployment on with kubernetes operator

2024-07-11 Thread Enric Ott
Thanks,nacisimsek.I will try your suggestion. -- Original -- From: "nacisimsek"

?????? Flink reactive deployment on with kubernetes operator

2024-07-11 Thread Enric Ott
Thanks,Gyula.I agree with you on Autoscaler,and I will try the latest Flink Operator version. --  -- ??: "Gyula F??ra"

Flink reactive deployment on with kubernetes operator

2024-07-10 Thread Enric Ott
Hi,Community:   I hava encountered a problem when deploy reactive flink scheduler on kubernetes with flink kubernetes operator 1.6.0,the manifest and exception stack info listed as follows. Any clues would be appreciated. #

Buffer Priority

2024-07-10 Thread Enric Ott
Hello,Community:   I am puzzled by what the Priority means in Flink Buffer,it explains with example(as follows) in Buffer.java,but I still don't get what exactly is "it skipped buffers"??Could anyone give me a  intuitive explanation?   Thanks. /** Same as EVENT_BUFFER, but the event has been

?????? puzzle on OperatorChain

2024-07-04 Thread Enric Ott
Thanks for your confirmation,Yunfeng. --  -- ??: "Yunfeng Zhou"

puzzle on OperatorChain

2024-07-04 Thread Enric Ott
Hello,guys:   Does Flink transform all operators(including source operator) to OperatorChain even disableoperatorchaining was set to true and even the OperatorChain contains only one single Operator.   Thanks.

watermark and barrier

2024-07-02 Thread Enric Ott
! --  -- ??: "Enric Ott" <243816...@qq.com>; : 2024??1??25??(??) 2:54 ??: "user"

??????Fail to pull image autoscaling

2024-07-02 Thread Enric Ott
. --  -- ??: "Enric Ott" <243816...@qq.com>; : 2024??6??28??(??) 10:26 ??: "user"https://github.com/apache/flink-kub

Fail to pull image autoscaling

2024-06-27 Thread Enric Ott
give me some clues to work this shit out ?   Thanks. --  -- ??: "

?????? flink kubernetes flink autoscale behavior

2024-06-25 Thread Enric Ott
Thanks,Rion.I roughly understand.And I still want to know whether the deployment of Adaptive Scheduler relies on Kubernetes?  Are there any cases of deploying Flink Adaptive Scheduler on bare metal machine? Appreciated again. --  -- ??:

flink kubernetes flink autoscale behavior

2024-06-24 Thread Enric Ott
Hello,Community:   I??ve recently started using the Flink Kubernetes Operator,and I'd like to know if CPU and Job Parallelism autoscaling are supported without restarting the whole job,if it??s supported, please tell me how to configure and deploy it.     Thanks.

??????RE: how to get flink accumulated sink record count

2024-01-25 Thread Enric Ott
deployment/metric_reporters/ [2] https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/ops/rest_api/#jobs-metrics On 2024/01/25 06:54:36 Enric Ott wrote: > Hi??Team?? > I was wondering how to get flink accumulated sink record count(just like the flink UI displays),any help would be appreciated.

how to get flink accumulated sink record count

2024-01-24 Thread Enric Ott
Hi??Team?? I was wondering how to get flink accumulated sink record count(just like the flink UI displays),any help would be appreciated.

?????? Flink SQL runtime

2023-10-12 Thread Enric Ott
For example, operator state and checkpoint listener of flink sql runtime.I'm trying to modify flink sql compiled behavior programmatically and get corresponding flink sql runtime. --  -- ??:

Flink SQL runtime

2023-10-11 Thread Enric Ott
Hi,Team: Is there any approach to get flink sql runtime via api ? Any help would be appreciated.

flink exactly once semantics implementation internals

2023-10-09 Thread Enric Ott
Hi,Team: Does Flink really discard replayed duplicated records via record timestamp as the paper Lightweight Asynchronous Snapshots for Distributed Dataflows states "To achieve this we can follow a similar scheme to SDGs [5] and mark records with sequence numbers from the sources, thus, every do