Prasanth Jayachandran created HIVE-18269:
--------------------------------------------

             Summary: LLAP: Fast llap io with slow processing pipeline can lead 
to OOM
                 Key: HIVE-18269
                 URL: https://issues.apache.org/jira/browse/HIVE-18269
             Project: Hive
          Issue Type: Bug
    Affects Versions: 3.0.0
            Reporter: Prasanth Jayachandran
            Assignee: Prasanth Jayachandran


pendingData linked list in Llap IO elevator (LlapRecordReader.java) may have 
grow indefinitely when Llap IO is faster than processing pipeline. Since we 
don't have backpressure to slow down the IO, this can lead to indefinite growth 
of pending data leading to severe GC pressure and eventually lead to OOM.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to