Re: new segments and merged segments

2012-08-17 Thread Michael McCandless
Hmm, actually, we only warm newly merged (not newly flushed) segments, today. We don't warm flushed segments today because, in an NRT setting, it's just an added latency on turning around updates to the index (vs merging which is purely replacing old segments with new ones). But one hack you coul

new segments and merged segments

2012-08-16 Thread Greg Steffensen
I'm curious as to whether it's possible to abuse merged segment warmers to run some queries on all documents that have been newly added to an index. This would be run in the context of a large, continuously growing index (using NRT search), and would allow me to publish live streams of incoming do