Re: [External] Re:Re: Backpressure issue with Flink Sql Job

2024-07-01 Thread Penny Rastogi
Hi Ashish, How are you performing the backfill operation? Some time window? Can you specify details? I mean ,if it helps, you can check out https://www.ververica.com/blog/how-to-write-fast-flink-sql . Regards On Tue, Jun 25, 2024 at 4:30 PM Ashish Khatkar via user < user@flink.apache.org> wrot

JVM heap not getting freed

2024-07-01 Thread Ganesh Walse
Hi Team, After I ran my fink application on cluster and application runs successfully but my JVM heap is still showing 50% is filled. What will be the reason?

Re: JVM heap not getting freed

2024-07-01 Thread Feng Jin
Hi Ganesh After the job is finished, was there a Full GC during this period? You can try to capture a heap dump to trigger FullGC and then check the actual memory usage. If the memory usage is still high after a Full GC, you should analyze the heap dump file. Best, Feng On Mon, Jul 1, 2024 at 9

Stateful Function Roadmap

2024-07-01 Thread Ran Jiang via user
Hi team, We noticed that there wasn't any new version of Stateful Function released since last year. Is it still actively being developed? We also noticed that the dependencies of it were also old. Is there a roadmap regarding supporting newer Flink and Protobuf versions? Thanks, Ran

Flink cache support

2024-07-01 Thread Ganesh Walse
Hi All, My prerequisite for datastream is to cache 25-30 table data into the some java collection and use them later while processing the stream. Right now I am just writing select queries and using jdbc api storing those results in java collection and filtering data as per need. Do you have any

unsubscribe

2024-07-01 Thread Phil Stavridis

Re:Flink cache support

2024-07-01 Thread Xuyang
Hi, Ganesh. Can you take a look if the cache strategy in jdbc lookup table can meet your requirement? [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/table/jdbc/#lookup-cache -- Best! Xuyang At 2024-07-02 03:35:41, "Ganesh Walse" wrote:

Please suggest Flink OpenSearch connector ver 1.0.1-1.16 is compatible with which version of “opensearch-rest-high-level-client”

2024-07-01 Thread Sonal Sharma A via user
Hello Team, We are using the Flink version 1.16.3 and we are planning to use the Flink OpenSearch connector, which requires the dependency of "opensearch-rest-high-level-client". Latest version of opensearch-rest-high-level-client is 2.15 which is not working with Flink OpenSearch connector 1.

Re:Stateful Function Roadmap

2024-07-01 Thread Xuyang
Hi, Ran. As far as I know, the development of stateFun has currently come to a standstill. You maybe need to fork this repo and pick up what your need. You can see the latest mail thread here[1]. [1] https://lists.apache.org/thread/mz5956pry8fzowdw399q0hq16zqg5f57 -- Best! Xu