*assuming* that you've made a typo and aren't
really seeing a 1000X difference in size Did
you create your index fresh each time (or delete
the old FSDIr) before recording your sizes? If
you're appending to the current index, your
numbers are misleading
Erick
On Wed, Feb 3, 2010 at 6:01 A
Are you saying that by using compression your index size goes up by a
factor of more than 1024? From c10 kilobytes to 12 megabytes?
Compressing small fields can cause the index to get bigger rather than
smaller but obviously not by that much.
--
Ian.
On Wed, Feb 3, 2010 at 11:01 AM, Suraj Pari
Ian,
Small correction made ...
Thanks for solving my previous problems.
Now i tested the compression with 100 docs and found:
1. Without Compression size of FS directory (on disk)= 10.8 KB
2. With Compression size of FS directory (on disk) = 12.0 MB
and with 500 docs:
1. Without Compres
Ian,
Thanks for solving my previous problems.
Now i tested the compression with 100 docs and found:
1. With Compression size of FS directory (on disk)= 10.8 KB
2. Without Compression size of FS directory (on disk) = 12.0 MB
and with 500 docs:
1. With Compression size of FS directory (on
Please read Uwe's answers again. I think he has already answered all
your questions.
The javadocs for 2.9.1 are very useful when upgrading to 3.0.0. Read
the entry for Field.Store.COMPRESS.
--
Ian.
On Mon, Feb 1, 2010 at 12:04 PM, Suraj Parida wrote:
>
> Uwe,
>
> Thanks for the reply.
>
>
Uwe,
Thanks for the reply.
I am confused with
document.add(new Field(key, value, Field.Store.COMPRESS,
Field.Index.ANALYZED));
My requirement is also the same, but how can i do it in 3.0 ?
i thought CompressionTools would be used for compression.
Basically i need to compress the text
-Original Message-
> From: Uwe Schindler [mailto:u...@thetaphi.de]
> Sent: Monday, February 01, 2010 12:46 PM
> To: java-user@lucene.apache.org
> Subject: RE: Searching compressed text using CompressionTools
>
> Compression is only used for *stored* fields. For indexing ther
Compression is only used for *stored* fields. For indexing there is no
compression available (how should that work). You must clearly differentiate
between stored and indexed fields!
-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de
> -O
