Compression technique for stored fields

2016-02-23 Thread sandeep das
Hi guys, While running my application I noticed that the lz4 is used as compression technique for stored field. Is there any option by which I can change it to snappy? Regards, Sandeep

Weird ClassCastException running lucene 5.2.1 on Java 1.8.

2016-02-23 Thread Krishnamurthy, Kannan
Greetings, Recently we port our load test environment to Java 1.8 and since then we are seeing a ClassCastException under heavy load after about 2 hours into our load test. Exception StackTrace below. ava.lang.ClassCastException: [J cannot be cast to [B at org.apache.lucene.util.fst

Grouping Lucene result

2016-02-23 Thread Taher Galal
Hi, I was wondering how to extend the grouping lucene functionality as I am not sure how the values of the field are grouped therefore making me group them faster any tutorial or direction would be great Thanks, Taher Galal

Re: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/codecs/lucene50/Lucene50DocValuesFormat

2016-02-23 Thread Taher Galal
Thanks a lot for the quick prompt reply On Tue, Feb 23, 2016 at 12:30 PM, Michael McCandless < luc...@mikemccandless.com> wrote: > Likely you need to add backwards-codecs-5.5.0.jar, which holds the > codec components necessary to read indices created from releases older > than the current one, in

Re: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/codecs/lucene50/Lucene50DocValuesFormat

2016-02-23 Thread Michael McCandless
Likely you need to add backwards-codecs-5.5.0.jar, which holds the codec components necessary to read indices created from releases older than the current one, into your classpath? Mike McCandless http://blog.mikemccandless.com On Tue, Feb 23, 2016 at 6:00 AM, Taher Galal wrote: > Hi, > > > I

Re: Profiling lucene 5.2.0 based tool

2016-02-23 Thread sandeep das
Thanks a lot guys. I really appreciate your response on my query. I'll create multiple threads and checkout that how much I can rate can be increased per thread. Regards, Sandeep On Tue, Feb 23, 2016 at 4:19 PM, Michael McCandless < luc...@mikemccandless.com> wrote: > Your profiler breakdown is

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/codecs/lucene50/Lucene50DocValuesFormat

2016-02-23 Thread Taher Galal
Hi, I get this exception with an update from 5.3.x to 5.5.0 not sure what is causing and how to solve it Best Regards, Taher Galal

Re: Profiling lucene 5.2.0 based tool

2016-02-23 Thread Michael McCandless
Your profiler breakdown is exactly what I'd expect: processing the fields is the heaviest part of indexing. Except, it doesn't have any merges? Did you run it for long enough? Note that by default Lucene runs merges in a background thread (ConcurrentMergeScheduler). If you really must be single

[ANNOUNCE] Apache Solr 5.5.0 released

2016-02-23 Thread Michael McCandless
23 February 2016, Apache Solr™ 5.5.0 available Solr is the popular, blazing fast, open source NoSQL search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting, faceted search, dynamic clustering, database integration, rich document (e.g.,

[ANNOUNCE] Apache Lucene 5.5.0 released

2016-02-23 Thread Michael McCandless
23 February 2016, Apache Lucene™ 5.5.0 available The Lucene PMC is pleased to announce the release of Apache Lucene 5.5.0, expected to be the last 5.x feature release before Lucene 6.0.0. Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java. It is

RE: Profiling lucene 5.2.0 based tool

2016-02-23 Thread Uwe Schindler
Hi, There is nothing you can improve in a single-threaded case. You can only parallelize to get more out of it. Lucene is optimized to do parallel processing while indexing so you should make use of that. > > > Note: After going through the code I found out that addDocument is > > > internally