RE: how to query against payload

2008-04-21 Thread Fang_Li
Hi Grant, Thanks for your help. BoostingTermQuery uses reader.termPositions(term) to get the term position. In the Term, we cannot put any payload value to find the result documents. What I want is Find out all documents which have a specific payload value in a specific term. We does not

Re: Need addtional info for Field(希望看得 懂中文的朋友帮我出出主意)

2008-04-21 Thread 王建新
谢谢,我只是检索sub,不检索时间,在检索sub时,只想得到匹配Field对应的时间。 用payload似乎不可以? - Original Message - From: <[EMAIL PROTECTED]> To: Sent: Tuesday, April 22, 2008 1:55 PM Subject: RE: Need addtional info for Field(希望看得懂中文的朋友帮我出出主意) Try to use payload which is stored as additional information. Currently luce

RE: Need addtional info for Field(希望看得 懂中文的朋友帮我出出主意)

2008-04-21 Thread Fang_Li
Try to use payload which is stored as additional information. Currently lucene only support per token payload, but you can add an arbitrary token for the time information. I am not sure what are the query information? Only the subtitle or both subtitle and time? Regards, -Original Message

Need addtional info for Field(希望看得懂中 文的朋友帮我出出主意)

2008-04-21 Thread 王建新
用英文可能描述得不是很清楚,不好意思:) - Original Message - From: 王建新 To: Chris Sent: Tuesday, April 22, 2008 9:52 AM Subject: Re: Need addtional info for Field 谢谢。 我的问题是这样的:要对一批视频文件(video)建立索引(index),在建立索引之前,我已经分析出了在视频的什么时间出现了什么样的字幕内容。 在这种情况下,一个视频节目就相当于一个Document,那么需要(希望)对字幕建立索引,如下: Field("Sub","

Re: Binding lucene instance/threads to a particular processor(or core)

2008-04-21 Thread Anshum
The paper seems pretty good but I am still wondering if there was a way to achieve this through the command line parameters. I'm just trying this to optimize the code, if this works, would let all know else would keep everyone informed :) Any other suggestions for handling a concurrency of over 7 s

Re: Binding lucene instance/threads to a particular processor(or core)

2008-04-21 Thread Antony Bowesman
That paper from 1997 is pretty old, but mirrors our experiences in those days. Then, we used Solaris processor sets to really improve performance by binding one of our processes to a particular CPU while leaving the other CPUs to manage the thread intensive work. You can bind processes/LWPs to

FW: Re: Occasional Hang in IndexWriter.close()

2008-04-21 Thread Stu Hood
Hey gang, The finally block was not hiding any exceptions: I'm still seeing the hangs in IndexWriter.close(). I'm appending the relevant output from 'setInfoStream(System.out)'. It looks like after I order the close, the IndexWriter begins a flush, and then hangs. Any ideas? Thanks, Stu >>>

RE: Highlighting phrases

2008-04-21 Thread Scott Smith
And a well deserved beer it would be... Thanks Scott -Original Message- From: Mark Miller [mailto:[EMAIL PROTECTED] Sent: Sunday, April 20, 2008 7:50 PM To: java-user@lucene.apache.org Subject: Re: Highlighting phrases https://issues.apache.org/jira/browse/LUCENE-794 Because its for a

Re: Binding lucene instance/threads to a particular processor(or core)

2008-04-21 Thread Glen Newton
I realised that not everyone on this list might be able to access the IEEE paper I pointed-out, so I will include the abstract and some paragraphs from the paper which I have included below. Also of interest (and should be available to all): Fedorova et al. 2005. Performance of Multithreaded Chip

Re: Binding lucene instance/threads to a particular processor(or core)

2008-04-21 Thread Glen Newton
And this discussion on bound threads may also shed light on things: http://coding.derkeiler.com/Archive/Java/comp.lang.java.programmer/2007-11/msg02801.html -Glen On 21/04/2008, Glen Newton <[EMAIL PROTECTED]> wrote: > BInding threads to processors - in many situations - improves > throughput by

Re: how to query against payload

2008-04-21 Thread Grant Ingersoll
On Apr 21, 2008, at 5:34 AM, [EMAIL PROTECTED] wrote: Hi, I want to use payload to store some kind of object id which is an arbitrary byte array for better performance. But I do need some kind of function like searching against payload value. Have a look at the BoostingTermQu

Re: Binding lucene instance/threads to a particular processor(or core)

2008-04-21 Thread Glen Newton
BInding threads to processors - in many situations - improves throughput by reducing memory overhead. When a thread is running on a core, its state is local; if it is timeshared-out and either 1) swapped back in on the same core, it is likely that there will be the core's L1 cache; or 2) onto anot

how to query against payload

2008-04-21 Thread Fang_Li
Hi, I want to use payload to store some kind of object id which is an arbitrary byte array for better performance. But I do need some kind of function like searching against payload value. Also when the hits are available, how to get the payload of a specific term from a docum

Re: Binding lucene instance/threads to a particular processor(or core)

2008-04-21 Thread Ulf Dittmer
This sounds odd. Why would restricting it to a single core improve performance? The point of using multiple cores (and multiple threads) is to improve performance isn't it? I'd leave thread scheduling decisions to the JVM. Plus, I don't think there is anything in Java to facilitate this (short of u

Binding lucene instance/threads to a particular processor(or core)

2008-04-21 Thread Anshum
Hi, I have been trying to bind my lucene instance (JVM - Sun Hotspot*) to a particular core so as to improve the performance. Is there a way to do so or is there support in lucene to explicitly control the thread - processor linkup? -- -- The facts expressed here belong to everybody, the opinion