[
https://issues.apache.org/jira/browse/SOLR-17050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christine Poerschke updated SOLR-17050:
---------------------------------------
Description:
We reached the limit of zk for storing LTR models. I want to avoid the
usage of DefaultWrapperModel for as long as possible because we have
deployed in an container orchestrator and this implementation can be
really risky if you can not guarantee the presence of the model on
disk all the time.
So I want to use the managed model feature to upload some bigger
models but zk is dying with OOM. What we noticed is that solr stores
the models in a json indented file. By saving the models in compacted
json our models will be 60% smaller.
user mailing list thread:
[https://lists.apache.org/thread/5s5dq4j4bd74sfym7frwoqdokoh64s5l]
was:
We reached the limit of zk for storing LTR models. I want to avoid the
usage of DefaultWrapperModel for as long as possible because we have
deployed in an container orchestrator and this implementation can be
really risky if you can not guarantee the presence of the model on
disk all the time.
So I want to use the managed model feature to upload some bigger
models but zk is dying with OOM. What we noticed is that solr stores
the models in a json indented file. By saving the models in compacted
json our models will be 60% smaller.
> Store the models compacted so we can store bigger models on zk
> --------------------------------------------------------------
>
> Key: SOLR-17050
> URL: https://issues.apache.org/jira/browse/SOLR-17050
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: contrib - LTR, ltr
> Affects Versions: main (10.0), 9.4
> Reporter: Florin Babes
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> We reached the limit of zk for storing LTR models. I want to avoid the
> usage of DefaultWrapperModel for as long as possible because we have
> deployed in an container orchestrator and this implementation can be
> really risky if you can not guarantee the presence of the model on
> disk all the time.
> So I want to use the managed model feature to upload some bigger
> models but zk is dying with OOM. What we noticed is that solr stores
> the models in a json indented file. By saving the models in compacted
> json our models will be 60% smaller.
> user mailing list thread:
> [https://lists.apache.org/thread/5s5dq4j4bd74sfym7frwoqdokoh64s5l]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org
For additional commands, e-mail: issues-h...@solr.apache.org
