Xi Lyu created SPARK-51737:
------------------------------

             Summary: Memory based MLCache eviction policy
                 Key: SPARK-51737
                 URL: https://issues.apache.org/jira/browse/SPARK-51737
             Project: Spark
          Issue Type: Improvement
          Components: ML
    Affects Versions: 4.0.0, 4.1.0
            Reporter: Xi Lyu


Currently the ML Cache is limited by the number of cache entries (100 entries 
at this time), but it is not ideal. We need to update the eviction policy to be 
memory based, i.e. to evict old models if the total size is greater than a 
limit.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to