[
https://issues.apache.org/jira/browse/LUCENE-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702135#comment-16702135
]
Rinka Singh edited comment on LUCENE-7745 at 11/28/18 4:57 PM:
---------------------------------------------------------------
Edited. Sorry...
A few questions.
* How critical is the inverted index to the user experience?
* What happens if the inverted index is speeded up?
* How many AWS instances would usually be used for searching through ~140GB
sized inverted index and are there any performance numbers around this? (I'd
like to compare to a server with 8 GPUs costing about $135-140K) - not sure
what the equivalent GPU instances on Google Cloud/AWS would cost...
Assumptions (please validate):
* Documents are being added to the inverted index however the Index itself
doesn't grow rapidly
* the Maximum Index size will be less than 140GB - I assume 8 GPUs
was (Author: rinka):
A few questions. How critical is the inverted index to the user experience?
What happens if the inverted index is speeded up?
> Explore GPU acceleration
> ------------------------
>
> Key: LUCENE-7745
> URL: https://issues.apache.org/jira/browse/LUCENE-7745
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Ishan Chattopadhyaya
> Assignee: Ishan Chattopadhyaya
> Priority: Major
> Labels: gsoc2017, mentor
> Attachments: TermDisjunctionQuery.java, gpu-benchmarks.png
>
>
> There are parts of Lucene that can potentially be speeded up if computations
> were to be offloaded from CPU to the GPU(s). With commodity GPUs having as
> high as 12GB of high bandwidth RAM, we might be able to leverage GPUs to
> speed parts of Lucene (indexing, search).
> First that comes to mind is spatial filtering, which is traditionally known
> to be a good candidate for GPU based speedup (esp. when complex polygons are
> involved). In the past, Mike McCandless has mentioned that "both initial
> indexing and merging are CPU/IO intensive, but they are very amenable to
> soaking up the hardware's concurrency."
> I'm opening this issue as an exploratory task, suitable for a GSoC project. I
> volunteer to mentor any GSoC student willing to work on this this summer.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
