I just meant whether it would live in a lucene release (somewhere
under contrib/) or just in JIRA. Would including the functionality
in Solr help get it into lucene?
-Mike
On 29-Aug-07, at 4:58 AM, Mark Miller wrote:
It kind of is a contrib -- its really just a new Scorer class (with
som
The patch you refer to should include the javadoc/source code. If that
is not sufficient, drop me a line privately and I will email you all of
the source code / javadoc.
- Mark
Michael Stoppelman wrote:
Ah, much clearer now. It seems that the jar file is just the class files. Is
the source/ja
It kind of is a contrib -- its really just a new Scorer class (with some
axillary helper classes) for the old contrib Highlighter. Since the
contrib Highlighter is pretty hardened at this point, I figured that was
the best way to go. Or do you mean something different?
- Mark
Mike Klaas wrote
Mark,
I'm still interested in integrating this into Solr--this is a feature
that has been requested a few times. It would be easier to do so if
it were a contrib/...
thanks for the great work,
-Mike
On 27-Aug-07, at 4:21 AM, Mark Miller wrote:
I am a bit unclear about your question. The
Ah, much clearer now. It seems that the jar file is just the class files. Is
the source/javadoc code somewhere else?
-M
On 8/27/07, Mark Miller <[EMAIL PROTECTED]> wrote:
>
> I am a bit unclear about your question. The patch you mention extends
> the original Highlighter to support phrase and spa
I am a bit unclear about your question. The patch you mention extends
the original Highlighter to support phrase and span queries. It does not
include any major performance increases over the original Highlighter
(in fact, it takes a bit longer to Highlight a Span or Phrase query than
it does t
Is this jar going to be in the next release of lucene? Also, are these the
same as the changes in the following patch:
https://issues.apache.org/jira/secure/attachment/12362653/spanhighlighter10.patch
-M
On 6/27/07, Mark Miller <[EMAIL PROTECTED]> wrote:
>
>
> > I have not looked at any highlight
I have not looked at any highlighting code yet. Is there already an extension
of PhraseQuery that has getSpans() ?
Currently I am using this code originally by M. Harwood:
Term[] phraseQueryTerms = ((PhraseQuery) query).getTerms();
int i;
SpanQuery[] clauses
On Wednesday 27 June 2007 17:17, mark harwood wrote:
> >>you would still have the major problem of which matches do you keep
information for
>
> Yes, doing this efficiently is the main issue. Some vague thoughts I had:
>...
> 3) For each call to scorer.next() on the top level query, the
Highligh
h for
just these few docs.
Cheers
Mark
- Original Message
From: Mark Miller <[EMAIL PROTECTED]>
To: java-user@lucene.apache.org
Sent: Wednesday, 27 June, 2007 12:59:21 PM
Subject: Re: Highlighter that works with phrase and span queries
markharw00d wrote:
>
> I was t
Depending on what these guys are doing, here is another possibility if
TermOffests and Ronnie's highlighter are not an option.
If you are highlighting whole documents (NullFragmenter) or are not very
concerned about the fragments you get back, you can change the line in
the Highlighter at abou
markharw00d wrote:
I was thinking along the lines of wrapping some core classes such as
IndexReader to somehow observe the query matching process and deduce
from that what to highlight (avoiding the need for MemoryIndex) but
I'm not sure that is viable. It would be nice to get some more ma
11:19:22 PM
Subject: Re: Highlighter that works with phrase and span queries
Results of my tests :
The new SpanScorer is just about the same speed as the old Highlighter's
QueryScorer if the Query contains no position sensitive elements. This
is only the case, however, if the CachingTokenF
Hi Mark,
Good summary. I was running some timings earlier and my results echo
your findings.
>>I am currently trying to think of some possible hybrid approach to
highlighting...
I was thinking along the lines of wrapping some core classes such as
IndexReader to somehow observe the query mat
From: Mark Miller <[EMAIL PROTECTED]>
To: java-user@lucene.apache.org
Sent: Thursday, 21 June, 2007 2:11:52 AM
Subject: Re: Highlighter that works with phrase and span queries
I will work up some performance numbers over the next day or two to
share with you. I have spent the last day or
ng "helper" interfaces (Fragmenter/Scorer) remains to be seen.
Cheers,
Mark
- Original Message
From: Mark Miller <[EMAIL PROTECTED]>
To: java-user@lucene.apache.org
Sent: Thursday, 21 June, 2007 2:11:52 AM
Subject: Re: Highlighter that works with phrase and span queries
I wil
I will work up some performance numbers over the next day or two to
share with you. I have spent the last day or two with a profiler trying
to find the biggest performance drains.
Unfortunately, I will probably not be able to squeeze out much more
performance than the current Highlighter. When
On 6/20/07, Chris Lu <[EMAIL PROTECTED]> wrote:
Agree. But I think another reason why highlighting is slow could also
be the need to retrieve the document's content, quite likely it's on
the hard drive, which usually takes around 10ms for each small
document, more for larger document.
I'm not
Agree. But I think another reason why highlighting is slow could also
be the need to retrieve the document's content, quite likely it's on
the hard drive, which usually takes around 10ms for each small
document, more for larger document.
--
Chris Lu
-
Instant Scalable Ful
Hi Mark,
I know one large user (meaning: high query/highlight rates) of the current
Highlighter and this user wasn't too happy with its performance. I don't know
the details, other than it was inefficient. So now I'm wondering if you've
benchmarked your Highlighter against that/current Highli
On 19-Jun-07, at 3:39 PM, Mark Miller wrote:
I have been working on extending the Highlighter with a new Scorer
that correctly scores phrase and span queries. The highlighter is
working great for me, but could really use some more banging on.
If you have a need or an interest in a more accu
21 matches
Mail list logo
