Re: New tool: LSql

2009-04-13 Thread Glen Newton
As the creator of LuSql [http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql] I would have hoped for a more creative (and more different) name. :-) -glen 2009/4/13 jonathan esposito : > I created a command-line tool in Java that allows the user to execute > sql-like commands again

Re: Sequential match query

2009-04-13 Thread Tim Williams
On Mon, Apr 13, 2009 at 2:18 PM, John Seer wrote: > > If I understand you guys correct > If I have term which has n tokens I will need to create n SpanTermQuery put > them in array and pass it to SpanNearQuery? Can you post inline instead of top-posting? What you have is essentially my suggestio

New tool: LSql

2009-04-13 Thread jonathan esposito
I created a command-line tool in Java that allows the user to execute sql-like commands against a lucene index. This is useful for automating Lucene index migrations without writing any code. Essentially, you can treat a Lucene index the same as you would a database. For example, you can write:

New tool: LSql

2009-04-13 Thread jonathan esposito
I created a command-line tool in Java that allows the user to execute sql-like commands against a lucene index. This is useful for automating Lucene index migrations without writing any code. Essentially, you can treat a Lucene index the same as you would a database. For example, you can write:

Re: Sequential match query

2009-04-13 Thread John Seer
If I understand you guys correct If I have term which has n tokens I will need to create n SpanTermQuery put them in array and pass it to SpanNearQuery? Erik Hatcher wrote: > > > On Apr 12, 2009, at 8:15 AM, Tim Williams wrote: > >> On Sun, Apr 12, 2009 at 5:56 AM, Erik Hatcher >> wrote: >>

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Noble Paul നോബിള്‍ नोब्ळ्
yeah we never know which jvm has the latest data you can have a separate app for writes say solr_master.appspot.com instead of POSTing data to the master it may be able to pull data (say using DataImportHandler) and index it and when it has to commit it can serialize the data into a Blob and sav

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Glen Newton
Another solution is to have your application on the AppEngine, but the index is on another machine. Then the application 'proxies' the requests to the machine that has the index, which is using Solr [http://lucene.apache.org/solr/] or some other way to expose to the index to the web. Yes, this mea

Re: Rexex Search

2009-04-13 Thread Seid Mohammed
Thanks Erik it helps Seid M. On Mon, Apr 13, 2009 at 1:46 PM, Erik Hatcher wrote: > > On Apr 13, 2009, at 5:41 AM, Seid Mohammed wrote: > > I want to include Regular Expresion based searching to my lucene >> appplication >> Anyone who can help? >> > > There is a RegexQuery and a SpanRegexQuery

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Erdinc Yilmazel
Do you think writing a Directory based on google datastore is going to be useful? Indexing may be done using the cron jobs. I am not sure how the RAMDirectory will fit because the requests can be scattered to very different jvm instances in app engine environment. Erdinc On Mon, Apr 13, 2009 at 1

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Michael McCandless
Yes, I believe so (we have a unit test asserting this). But, there's no guarantee of cross-version compatibility of the serialized form. Mike 2009/4/13 Noble Paul നോബിള്‍ नोब्ळ् : > that is great. > > Is it possible to serialize and deserialize a RAMDirectory? > > --Noble > > > > > On Mon, Apr

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Noble Paul നോബിള്‍ नोब्ळ्
that is great. Is it possible to serialize and deserialize a RAMDirectory? --Noble On Mon, Apr 13, 2009 at 3:29 PM, Michael McCandless wrote: > Lucene's ConcurrentMergeScheduler spawns threads, but you can switch > that to SerialMergeScheduler which does not use threads. > > Some optional cl

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Michael McCandless
Lucene's ConcurrentMergeScheduler spawns threads, but you can switch that to SerialMergeScheduler which does not use threads. Some optional classes (FilterManager, ParallelMultiSearcher, TimeLimitedCollector) spawn threads, but presumably you could avoid them. Otherwise Lucene doesn't create its

Re: Rexex Search

2009-04-13 Thread Erik Hatcher
On Apr 13, 2009, at 5:41 AM, Seid Mohammed wrote: I want to include Regular Expresion based searching to my lucene appplication Anyone who can help? There is a RegexQuery and a SpanRegexQuery available in Lucene's regex contrib:

Rexex Search

2009-04-13 Thread Seid Mohammed
I want to include Regular Expresion based searching to my lucene appplication Anyone who can help? thanks a lot Seid M. -- "RABI ZIDNI ILMA" - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional comm

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Erdinc Yilmazel
I looked at the lucene source code out of curiosity to see if it spawns threads in indexing/searching and saw that it does. Are you sure it is going to work even if the index is read only? Erdinc 2009/4/13 Noble Paul നോബിള്‍ नोब्ळ् : > On Mon, Apr 13, 2009 at 1:10 PM, Chris Lu wrote: >> Surely

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Mon, Apr 13, 2009 at 1:10 PM, Chris Lu wrote: > Surely it's possible, but it has too much limitations to prevent a scalable > Luceen usage. However, it depends on your requirement. > > 1) You can not write index on disk, but you can read files. So theoretically > if the index is read-only and s

Re: Searching a single file

2009-04-13 Thread Shashi Kant
qv, above. Chop up your document into sub-documents (i.e. Lucene documents) in your favorite way, shape or form and it should work.. hth On Sun, Apr 12, 2009 at 2:08 PM, Michael Chan wrote: > I have been trying to use grep, but my file is way too big (~300gb). Could > Lucene search through it mo

Re: Can I run Lucene in google app engine?

2009-04-13 Thread Chris Lu
Surely it's possible, but it has too much limitations to prevent a scalable Luceen usage. However, it depends on your requirement. 1) You can not write index on disk, but you can read files. So theoretically if the index is read-only and small, you can package it with the war file. 2) If you