Hi Great,
-> Will these methods work?
I think it will not work. It can control that the slots are evenly
distributed on the TM, but cannot control the correspondence between tasks
and slots.
For example, the Flink cluster has 2 TMs, each TM has 4 slots(so total 8
slots in this cluster), and your j
Kindly help with this, I got stuck
-> If so, I think you can set Task1 and Task2 to the same parallelism and
set them in the same slot sharing group. In this way, Task1 and Task2 will
be deployed into the same slot(That is, the same task manager).
*Updating task details *
*Task1- Source some stati
-> If so, I think you can set Task1 and Task2 to the same parallelism and
set them in the same slot sharing group. In this way, Task1 and Task2 will
be deployed into the same slot(That is, the same task manager).
*Updating task details *
*Task1- Source some static data over HTTPS and keep it in me
Hi Great,
-> Is there a way to set the restart strategy so that only tasks in the
same slot group will restart during failure?
No. On task failover, all tasks in the same region will be restarted at the
same time (to ensure the data consistency).
You can get more details about failover strategy i
thanks for helping with some inputs
actually, I have created task1 and task2 in separate slot groups,
thought it would be good if they run in independent slots. Also now facing
some issues during restarts. whenever task1 has any exception entire job
is restarting.
Is there a way to set the restar
Hi Great,
Do you mean there is a Task1 and a Task2 on each task manager?
If so, I think you can set Task1 and Task2 to the same parallelism and set
them in the same slot sharing group. In this way, the Task1 and Task2 will
be deployed into the same slot(That is, the same task manager).
You can g
Hi,
IMO, Broadcast is a better way to do this, which can reduce the QPS of
external access.
If you do not want to use Broadcast, Try using RichFunction, start a thread
in the open() method to refresh the data regularly. but be careful to clean
up your data and threads in the close() method, otherw
Hi,
I have one flink job which has two tasks
Task1- Source some static data over https and keep it in memory, this keeps
refreshing it every 1 hour
Task2- Process some real-time events from Kafka and uses static data to
validate something and transform, then forward to other Kafka topic.
so far, e
