thanks Suman .
I test my code again in my project.It works,users can search the new index doc
immediately.
In our website,we merge index files every 15 mins from a server to another
server.and we can not stop the search service,so we can not reopen
the index directory,thanks.
2011-10-10
Hi janwen,
Try reopening the index reader and make new instance of searcher .
Regards,
Suman
-Original Message-
From: janwen [mailto:tom.grade1...@163.com]
Sent: Monday, October 10, 2011 7:34 AM
To: java-user
Subject: merge index
HI:
after i add new index directory to exsited
Let's claim you have build indexes in this order (by date).
index1
index2
index3
Now if you addindexes clause has them ordered the same way, then,
in the merged index, the first docID from index 2 will be greater than
the last doc id from index1 in the merged index. The first doc id from
index 3 w
i can not understand about last sentence "So the final index will only ..."
can you write more about this, because i have same question...
thanks
On Mon, Oct 20, 2008 at 2:04 PM, Michael McCandless <
[EMAIL PROTECTED]> wrote:
>
> By merge you mean using addIndexes*, right?
>
> Those methods logic
By merge you mean using addIndexes*, right?
Those methods logically concatenate the indices in order by doc ID.
So the original docs in your index will keep all their docIDs, and the
newly added indices are assigned docIDs after that, in the order they
were added.
So the final index wil
Hello all,
I am planning to merge two or more indexes. Once merged, will the DB
maintain the same index order as before merge?
I am doing sorting on Index Order as sorting on date-time takes more amount
of RAM. If i merge the index DB, will the same index order be maintained or
the indexes wil
Thank you for your reply. :)
You are correct.
I did run addIndexes method after the ramWriter colse.
And It is good working and create correct index file.
Thank you very much.
Jang.
08. 8. 8, Grant Ingersoll <[EMAIL PROTECTED]>님이 작성:
>
> Lucene does this RAM/FS stuff seamlessly for you in the
Lucene does this RAM/FS stuff seamlessly for you in the background.
Just open the FSDirectory and do your indexing. If I had to guess,
though, from a quick glance, I think you should do the addIndexes
after the ramWriter close, but that's just a guess, as I haven't tried
it.
-Grant
On
hi,
I am using RamDirectory and FSDirectory for indexing documents.
I use RamDirectory as Buffer.
For example,
---
String indexDir = "d:/lucene_data/merge_test_index";
Analyzer analyzer = new StopAnalyzer();
RAMDirectory ramDir= new RAMDirectory();
IndexWriter
First, it probably would have been a good thing to start a new thread on
this topic, since it's only vaguely related to disk space ...
That said, sure. Note that there's no requirement in lucene that all
documents in an index have the same fields. Also, there's no reason you
can't use two separat
Hi,
I have another related problem. I am adding news articles for a company
to the lucene index. As of now if the articles are mapped to more than
one company, they are added so many times in the index. As the no. of
companies mapped to each article increases, this will not be a scalable
impl
Harini Raghavan wrote:
Yes I think I got hit IOException. I assumed that the.tmp files are not
required and deleted them manually from the indes directory as they were
more than 10G. Is that ok?
Yes, they are indeed not necessary so deleting them is fine. This
(deleting partially created file
Yes I think I got hit IOException. I assumed that the.tmp files are not
required and deleted them manually from the indes directory as they were
more than 10G. Is that ok?
Michael McCandless wrote:
Harini Raghavan wrote:
Thank you for the response. I don't have readers open on the index,
bu
Harini Raghavan wrote:
Thank you for the response. I don't have readers open on the index, but
while the optimize/merge was running I was searching on the index. Would
that make any difference?
You're welcome! Right, a searcher opens an IndexReader. So this
means you should see peak @ 3X th
A Searcher uses a Reader to read the index for searching.
- Mark
Harini Raghavan wrote:
Hi Mike,
Thank you for the response. I don't have readers open on the index,
but while the optimize/merge was running I was searching on the index.
Would that make any difference?
Also after the optimizin
Hi Mike,
Thank you for the response. I don't have readers open on the index, but
while the optimize/merge was running I was searching on the index. Would
that make any difference?
Also after the optimizing the index I had some .tmp files which were >
10G and did not get merged. Could that also
On 12/21/06, Michael McCandless <[EMAIL PROTECTED]> wrote:
I *think* it's really max 2X even with compound file (if no readers)?
Because, in IndexWriter.mergeSegments we:
1. Create the newly merged segment in non-compound format (brings us
up to 2X, when it's the last merge).
2. Co
Yonik Seeley wrote:
On 12/21/06, Michael McCandless <[EMAIL PROTECTED]> wrote:
Harini Raghavan wrote:
> I am using lucene 1.9.1 for search functionality in my j2ee application
> using JBoss as app server. The lucene index directory size is almost
20G
> right now. There is a Quartz job that is
On 12/21/06, Michael McCandless <[EMAIL PROTECTED]> wrote:
Harini Raghavan wrote:
> I am using lucene 1.9.1 for search functionality in my j2ee application
> using JBoss as app server. The lucene index directory size is almost 20G
> right now. There is a Quartz job that is adding data to the inde
Harini Raghavan wrote:
I am using lucene 1.9.1 for search functionality in my j2ee application
using JBoss as app server. The lucene index directory size is almost 20G
right now. There is a Quartz job that is adding data to the index evey
min and around 2 documents get added to the index e
@lucene.apache.org
Subject: Merge Index Filling up Disk Space
Hi All,
I am using lucene 1.9.1 for search functionality in my j2ee application
using JBoss as app server. The lucene index directory size is almost 20G
right now. There is a Quartz job that is adding data to the index evey min
and arou
When Lucene optimizes the Index (which it semi does naturally as the
index grows) it creates a copy of the index, so you can expect the space
requirements for an index to be double the index at an absolute minimum.
If you are adding 20,000 docs a day and working with an index that is
already 20
Hi All,
I am using lucene 1.9.1 for search functionality in my j2ee application
using JBoss as app server. The lucene index directory size is almost 20G
right now. There is a Quartz job that is adding data to the index evey
min and around 2 documents get added to the index every day.When t
On Jun 27, 2006, at 3:17 PM, Beady Geraghty wrote:
I wasn't very clear in my original note. I just want to make sure
that I
can merge indexes created from differerent platforms/different
OSes without
problem. So I understand from the respond that this can be done.
Yes, this can be done.
Thank you for the response.
I wasn't very clear in my original note. I just want to make sure that I
can merge indexes created from differerent platforms/different OSes without
problem. So I understand from the respond that this can be done.
Thanks
On 6/27/06, Erik Hatcher <[EMAIL PROTECT
On Jun 27, 2006, at 2:02 PM, Daniel Naber wrote:
On Dienstag 27 Juni 2006 17:23, Beady Geraghty wrote:
I tried to look at the segments file, thinking that it points to the
various other
files in the index directory,
Use IndexWriter.addIndexes() to merge two or more indexes.
Or use the Ind
On Dienstag 27 Juni 2006 17:23, Beady Geraghty wrote:
> I tried to look at the segments file, thinking that it points to the
> various other
> files in the index directory,
Use IndexWriter.addIndexes() to merge two or more indexes.
Regards
Daniel
--
http://www.danielnaber.de
Hi,
I am trying to merge in index from a different node and probably different
platform.
I tried some simple cases by copying an index created from a windows
machine,
and bring to a linux server. I seem to be able to search from this index
that
is copied over. I would therefore assume that I c
28 matches
Mail list logo
