Hello all, I wonder if an external YARN container can send requests to LLAP daemon to read data from its in-memory cache. For example, YARN containers owned by a typical MapReduce job (e.g., TeraSort) could fetch data directly from LLAP instead of contacting HDFS. In this scenario, LLAP daemon just serves IO requests from YARN containers and does not run its executors to perform non-trivial computation.
If this is feasible, LLAP daemon can be shared by all services running in the cluster. Any comment would be appreciated. Thanks a lot. -- Gla Park