Re: manually merging Directories

2014-12-30 Thread Shaun Senecal
No problem at all. Its just good to hear that what I was thinking is actually possible! From: Robert Muir Sent: December 30, 2014 10:27 AM To: java-user Subject: Re: manually merging Directories I will revisit this and look at hardlinks as an

Re: manually merging Directories

2014-12-30 Thread Robert Muir
ood to keep > this in mind for future reference. > > > Thanks! > > Shaun > > > From: Robert Muir > Sent: December 30, 2014 9:36 AM > To: java-user > Subject: Re: manually merging Directories > > FYI there is more d

Re: manually merging Directories

2014-12-30 Thread Shaun Senecal
good to keep this in mind for future reference. Thanks! Shaun From: Robert Muir Sent: December 30, 2014 9:36 AM To: java-user Subject: Re: manually merging Directories FYI there is more discussion on https://issues.apache.org/jira/browse/LUCENE-474

Re: manually merging Directories

2014-12-30 Thread Robert Muir
t: December 30, 2014 5:22 AM > To: java-user@lucene.apache.org > Subject: RE: manually merging Directories > > In addition, use NoMergePolicy to prevent automatic merging once the segments > were added. :-) > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-2

Re: manually merging Directories

2014-12-30 Thread Shaun Senecal
Ya, I already have that set up. Thanks for the heads-up though! From: Uwe Schindler Sent: December 30, 2014 5:22 AM To: java-user@lucene.apache.org Subject: RE: manually merging Directories In addition, use NoMergePolicy to prevent automatic merging

RE: manually merging Directories

2014-12-30 Thread Uwe Schindler
: Tuesday, December 30, 2014 2:20 PM > To: 'java-user@lucene.apache.org' > Subject: RE: manually merging Directories > > Hi Shaun, > > you can actually do this relatively simple. In fact, most of the files are > indeed > copied as-is, so you can theoretically change

RE: manually merging Directories

2014-12-30 Thread Uwe Schindler
essage- > From: Shaun Senecal [mailto:shaun.sene...@lithium.com] > Sent: Tuesday, December 30, 2014 12:37 AM > To: Lucene Users > Subject: Re: manually merging Directories > > Hi Mike > > That's actually what I was looking at doing, I was just hoping there was a way >

Re: manually merging Directories

2014-12-29 Thread Shaun Senecal
chindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > >> -Original Message- >> From: Shaun Senecal [mailto:shaun.sene...@lithium.com] >> Sent: Monday, December 29, 2014 6:34 PM >> To: java-user >> S

Re: manually merging Directories

2014-12-29 Thread Michael McCandless
e 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > >> -Original Message- >> From: Shaun Senecal [mailto:shaun.sene...@lithium.com] >> Sent: Monday, December 29, 2014 6:34 PM >> To: java-user >> Subject: Re: manually merging Directories >

Re: manually merging Directories

2014-12-29 Thread Shaun Senecal
ential room for improvement. At this point, it seems that is not the case, so I will just move on. Thanks for the help Shaun From: Uwe Schindler Sent: December 29, 2014 9:44 AM To: java-user@lucene.apache.org Subject: RE: manually merging Directories Hi,

RE: manually merging Directories

2014-12-29 Thread Uwe Schindler
- Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Shaun Senecal [mailto:shaun.sene...@lithium.com] > Sent: Monday, December 29, 2014 6:34 PM > To: java-user > Subject: Re: manually merging Dire

Re: manually merging Directories

2014-12-29 Thread Shaun Senecal
you're absolutely right about the possibility of complications, so its debatable if doing something like this would be worth it in the end. Thanks for the info Shaun From: Erick Erickson Sent: December 23, 2014 5:55 PM To: java-user Subject:

Re: manually merging Directories

2014-12-23 Thread Erick Erickson
I doubt this is going to work. I have to ask why you're worried about the I/O; this smacks of premature optimization. Not only do the files have to be moved, but the right control structures need to be in place to inform Solr (well, Lucene) exactly what files are current. There's a lot of room for

manually merging Directories

2014-12-23 Thread Shaun Senecal
Hi I have a number of Directories which are stored in various paths on HDFS, and I would like to merge them into a single index. The obvious way to do this is to use IndexWriter.addIndexes(...), however, I'm hoping I can do better. Since I have created each of the separate indexes using Map/R