Appoligies correction done to previous email
Hi Fabian and Mike
*flink-conf.yaml [In a 3 node cluster having 120 GB memory each and 3 TB
hard disk ]*
jobmanager.heap.size: 50120m
taskmanager.heap.size: 50120m
*With Idle state retention having below configuration (Same heap space
issue)
Hi Fabian and Mike
*flink-conf.yaml [In a 3 node cluster having 120 GB memory each and 3 TB
hard disk ]*
jobmanager.heap.size: 50120m
taskmanager.heap.size: 50120m
*With Idle state retention having below configuration (Same heap space
issue) *
*execution:*
planner: old
type: streaming
ti
Hi,
I don' think that the memory configuration is the issue.
The problem is the join query. The join does not have any temporal
boundaries.
Therefore, both tables are completely stored in memory and never released.
You can configure a memory eviction strategy via idle state retention [1]
but you
You can configure the task manager memory in the config.yaml file.
What is the current configuration?
On Thu, Sep 26, 2019, 17:14 Nishant Gupta
wrote:
> am running a query to join a stream and a table as below. It is running
> out of heap space. Even though it has enough heap space in flink clu
am running a query to join a stream and a table as below. It is running
out of heap space. Even though it has enough heap space in flink cluster
(60GB * 3)
Is there an eviction strategy needed for this query ?
*SELECT sourceKafka.* FROM sourceKafka INNER JOIN DefaulterTable ON
sourceKafka.CC=Def
