Hi everyone,
I am currently looking into how Flink can coexist and interoperate with other frameworks in a cluster, such as plain single-machine processes or Spark?. ?Tachyon seems to be nice solution to exchange data between them. However, I think it is a problem that Flink's taskmanagers allocate their managed memory upfront - in contrast to Spark, as far as I know. If I want ?a taskmanager to yield its main memory, so that another process can use that memory, is there any other option besides shutting that taskmanager down? Would it be beneficial to use YARN? Thanks for your help! Cheers, Sebastian