hmm i tried to create a small reproducer but was not successful to reproduce
this. For less number of files my application also works fine. I tried with
many different individual directories and it runs fine. Only when the
directory structure is huge i get the io error.
So i have no idea what is
Okay let me try if i can create a standalone test which reproduces this issue
and get back.
Regards,
Rishi
Michael McCandless-2 wrote:
>
> But, if you can break out just the Lucene indexing part into a
> standalone test, that shows the exception, that can help us isolate
> it.
>
> At this poi
But, if you can break out just the Lucene indexing part into a
standalone test, that shows the exception, that can help us isolate
it.
At this point it seems likely the issue is something OS/filesystem
specific, because at one time (during optimize), we see a "file not
found" exception, yet at ano
This is a big project having lots of source files. The excerpt of the main
indexer program is:
FileIndexer indexer = new FileIndexer(props);
Analyzer defAnalyzer = new StandardAnalyzer();
FileIndexer.analyzer = defAnalyzer;
IndexWr
Can you post the full sources for the test that hits the exception on
your system?
Mike
On Fri, Aug 14, 2009 at 7:36 AM, rishisinghal wrote:
>
> It is reproducible in my system. If the number of files are small I am not
> able to see the crash.
>
>>>can you turn on infoStream on IndexWriter and p
It is reproducible in my system. If the number of files are small I am not
able to see the crash.
>>can you turn on infoStream on IndexWriter and post the output?
I am not clear on this. If you are talking of
writer.setInfoStream(System.out);
I already have posted the output while raising the iss
If it's easily reproducible, can you please provide a test that reproduces
it, even if on just your FS? And also, can you turn on infoStream on
IndexWriter and post the output?
If CheckIndex succeeds, then I'd compare the output w/ and w/o CheckIndex.
Shai
On Fri, Aug 14, 2009 at 12:17 AM, rishi
I am running this on OpenVMS V8.2-1 on IA64. For a small number of files this
works all fine.
I checked the resources part and i have enough disk and ram available.
Regards,
Rishi
Michael McCandless-2 wrote:
>
> It's very odd that CheckIndex has no trouble opening the segment's
> files, yet
It's very odd that CheckIndex has no trouble opening the segment's
files, yet when you run optimize the OS reports a "file not found"
exception (errno 5). Something odd is happening at the OS/filesystem
level.
What OS are you running on?
Can you boil this down to a smallish standalone test that
I tried creating the index in different disks but still i see the issue :-(
I tried to index documents in other disks also and got the same exception.
I also tried
$ java org.apache.lucene.index.CheckIndex /SYS$SYSDEVICE/RISHI/melon_1600/
-segment _61
NOTE: testing will be more thorough if you
I noticed the exception is "Caused by: java.io.FileNotFoundException:
/SYS$SYSDEVICE/RISHI/melon_1600/_61.cfs (i/o error (errno:5))"
I searched for i/o error (errno:5) and found some information which
associates it w/ a more native IO problem, like corrupt file due to system
crash etc.
Did you ex
It is a local file system.
We are using lucene 2.4 and java 1.5
Regards,
Rishi
Shai Erera wrote:
>
> Is that a local file system, or a network share?
>
> On Thu, Aug 13, 2009 at 1:07 PM, rishisinghal
> wrote:
>
>>
>> >>Is there any chance that two writers are open on this directory?
>> No,
Is that a local file system, or a network share?
On Thu, Aug 13, 2009 at 1:07 PM, rishisinghal wrote:
>
> >>Is there any chance that two writers are open on this directory?
> No, thats not true.
>
> >>something external to Lucene is removing files from the directory.
> No this also has rare chanc
>>Is there any chance that two writers are open on this directory?
No, thats not true.
>>something external to Lucene is removing files from the directory.
No this also has rare chances as I am the owner of these files and other
then me no one can delete the, :-)
Here are all the files in the
Is there any chance that two writers are open on this directory? Or,
something external to Lucene is removing files from the directory.
It looks like there were at least two missing files (_37
On Thu, Aug 13, 2009 at 5:19 AM, rishisinghal wrote:
>
> Hi,
>
> I am trying to index documents and whe
15 matches
Mail list logo
