Changes as we approach v4

2012-09-21 Thread david.w.smi...@gmail.com
Rob, It appears you are in-effect the Release Manager for v4.0 so I'm asking you this question. Clearly v4 is going to be out soon and consequently we're not pushing new features to the v4 branch. Regarding the new spatial codebase, there isn't a backwards compatibility concern to changes until

Re: [JENKINS] Lucene-Solr-trunk-Linux-Java7-64 - Build # 438 - Failure!

2012-06-29 Thread david.w.smi...@gmail.com
I added the missing ASL header. On Thu, Jun 28, 2012 at 4:54 PM, Policeman Jenkins Server < [email protected]> wrote: > Build: > http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Linux-Java7-64/438/ > > All tests passed > > Build Log: > [...truncated 15182 lines...] > BUILD FAILE

BooleanFilter MUST clauses and getDocIdSet(acceptDocs)

2012-11-07 Thread david.w.smi...@gmail.com
I am about to write a Filter that only operates on a set of documents that have already passed other filter(s). It's rather expensive, since it has to use DocValues to examine a value and then determine if its a match. So it scales O(n) where n is the number of documents it must see. The 2nd arg

Re: Welcome back, Wolfgang Hoschek!

2013-09-26 Thread david.w.smi...@gmail.com
Nice! Welcome back Wolfgang! On Thu, Sep 26, 2013 at 6:21 AM, Uwe Schindler wrote: > Hi, > > I'm pleased to announce that after a long abstinence, Wolfgang Hoschek > rejoined the Lucene/Solr committer team. He is working now at Cloudera and > plans to help with the integration of Solr and Hadoo

Fwd: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_45) - Build # 6066 - Still Failing!

2013-06-14 Thread david.w.smi...@gmail.com
Dawid, Could you please take a look at the reproducibility of this test failure in lucene/spatial? I tried to reproduce it but couldn't, and I thought perhaps you might have some insight because I'm using some RandomizedTesting features that aren't as often used, like @Repeat. For example, one t

Re: Solr: Serving Javadoc from Jetty server

2014-04-17 Thread david.w.smi...@gmail.com
Alex, Yes it would be useful (of course)! In addition, the admin UI should have a link to it, in addition to the generic documentation link. Create an issue and I’ll commit it. ~ David On Thu, Apr 17, 2014 at 6:54 AM, Alexandre Rafalovitch wrote: > Hello, > > The binary Solr distribution includ

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_55) - Build # 10106 - Still Failing!

2014-04-18 Thread david.w.smi...@gmail.com
This build started before I fixed the issue; it’s already fixed. On Fri, Apr 18, 2014 at 9:12 AM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10106/ > Java: 64bit/jdk1.7.0_55 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

Re: maximum number of shards per SolrCloud

2014-04-21 Thread david.w.smi...@gmail.com
Zhifeng, Please ask Solr questions on the solr-user list. Thanks. ~ David On Mon, Apr 21, 2014 at 9:54 PM, Zhifeng Wang wrote: > Hi, > > We are facing a high incoming rate of usually small documents (logs). The > incoming rate is initially assumed at 2K/sec but could reach as high as > 20K/sec.

DocumentsWriterPerThread architecture

2014-04-30 Thread david.w.smi...@gmail.com
Is this still up to date?: https://blog.trifork.com/2011/04/01/gimme-all-resources-you-have-i-can-use-them/ I thought at some point subsequently, some significant work was done, and perhaps it was blogged. But I can’t find it. ~ David

Encoding data in terms; UTF8 concerns?

2014-05-10 Thread david.w.smi...@gmail.com
I’m working on an encoding of numbers / data into indexed terms. In the past I limited the encoding to ASCII but now I’m doing it at a more raw/byte level. Do I have to be aware of UTF8 / sorting issues when I do this? I noticed the following code in NumericUtils.java, line 186: while (nChar

Re: Encoding data in terms; UTF8 concerns?

2014-05-11 Thread david.w.smi...@gmail.com
8 bit encoding > already for Collation fields see CollationKeyAttributeFactory, which > encoded terms instead of UTF-8 with their collation key). > > > > Uwe > > > > - > > Uwe Schindler > > H.-H.-Meier-Allee 63, D-28213 Bremen > > http://www.thet

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b15) - Build # 10394 - Still Failing!

2014-05-26 Thread david.w.smi...@gmail.com
I’ll dig. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, May 27, 2014 at 12:04 AM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10394/ > Java: 64bit

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) - Build # 10472 - Failure!

2014-06-04 Thread david.w.smi...@gmail.com
Thanks for fixing, Rob. ~ David On Wed, Jun 4, 2014 at 10:49 PM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10472/ > Java: 32bit/jdk1.8.0_20-ea-b15 -server -XX:+UseG1GC > > 1 tests failed. > FAILED: > > org.apache.luce

Re: Trappy behavior with default search field

2014-06-05 Thread david.w.smi...@gmail.com
In my view, solrconfig.xml shouldn’t refer to any field by name out of the box, except for the /browse handler, and perhaps pre-filling the query form in the admin GUI. That’s it. A couple years ago at about the time I became a committer, I finally did something about a feature I am very opiniona

Re: Extract values from custom function for ValueSource with multiple indexable fields

2014-06-08 Thread david.w.smi...@gmail.com
I suggest investigating this using a known example that does this, such as LatLonType and geodist(). LatLonType registers the field in a custom way too. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Jun 8, 2014 at 7:54 AM

Re: Adding Morphline support to DIH - worth the effort?

2014-06-08 Thread david.w.smi...@gmail.com
> One of the ideas over DIH discussed earlier is making it standalone. Yeah; my beef with the DIH is that it’s tied to Solr. But I’d rather see something other than the DIH outside Solr; it’s not worthy IMO. Why have something Solr specific even? A great pipeline shouldn’t tie itself to any end

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_20-ea-b15) - Build # 10516 - Still Failing!

2014-06-09 Thread david.w.smi...@gmail.com
I’m on it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 9, 2014 at 10:36 AM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10516/ > Java: 64bit

Re: Adding Morphline support to DIH - worth the effort?

2014-06-11 Thread david.w.smi...@gmail.com
LOL I had the very same reaction Alexandre. Most of us don’t have all this big data software sitting around, even if it is free. Complexity. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Jun 12, 2014 at 12:44 AM, Alexand

Re: [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_20-ea-b15) - Build # 4119 - Failure!

2014-06-15 Thread david.w.smi...@gmail.com
I’m on it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Jun 15, 2014 at 10:30 PM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4119/ > Java: 32b

Re: facet.mincount in SolrCloud

2014-06-16 Thread david.w.smi...@gmail.com
That doesn’t make sense to me either, Toke. Have you tried changing it and running tests to see that they pass? ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 16, 2014 at 8:39 AM, Toke Eskildsen wrote: > I am having

Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_51) - Build # 9725 - Still Failing!

2014-03-18 Thread david.w.smi...@gmail.com
I'll look into this one and get it fixed ASAP. On Tue, Mar 18, 2014 at 2:26 AM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9725/ > Java: 32bit/jdk1.7.0_51 -server -XX:+UseSerialGC > > 2 tests failed. > FAILED: > > org.ap

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b10) - Build # 9867 - Failure!

2014-03-21 Thread david.w.smi...@gmail.com
I'm definitely looking at it and I've found the problem. I'm working on a fix right now. On Fri, Mar 21, 2014 at 3:27 PM, Michael McCandless < [email protected]> wrote: > I someone looking at this test failure? Should we @BadApple it, or > revert recent spatial changes, or something? >

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b10) - Build # 9882 - Still Failing!

2014-03-23 Thread david.w.smi...@gmail.com
I'm looking in to this. On Sun, Mar 23, 2014 at 5:45 AM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9882/ > Java: 64bit/jdk1.7.0_60-ea-b10 -XX:-UseCompressedOops -XX:+UseSerialGC > > 1 tests failed. > FAILED: > org.apac

Re: [VOTE] Lucene / Solr 4.7.1 RC1

2014-03-26 Thread david.w.smi...@gmail.com
+1 SUCCESS! [2:13:44.301402] On Tue, Mar 25, 2014 at 6:46 PM, Steve Rowe wrote: > Please vote for the first Release Candidate for Lucene/Solr 4.7.1. > > Download it here: > < > http://people.apache.org/~sarowe/staging_area/lucene-solr-4.7.1-RC1-rev1581444/ > > > > Smoke tester cmdline: > > pyt

Re: [VOTE] Lucene / Solr 4.7.1 RC2

2014-03-31 Thread david.w.smi...@gmail.com
+1 SUCCESS! [1:51:37.952160] On Sat, Mar 29, 2014 at 4:46 AM, Steve Rowe wrote: > Please vote for the second Release Candidate for Lucene/Solr 4.7.1. > > Download it here: > < > https://people.apache.org/~sarowe/staging_area/lucene-solr-4.7.1-RC2-rev1582953/ > > > > Smoke tester cmdline (from

Re: Welcome Alan Woodward to the PMC

2014-04-02 Thread david.w.smi...@gmail.com
Welcome Alan! ~ David On Wed, Apr 2, 2014 at 8:23 AM, Steve Rowe wrote: > I'm pleased to announce that Alan Woodward has accepted the PMC's > invitation to join. > > Welcome Alan! > > - Steve > - > To unsubscribe, e-mail: dev-u

Re: Anticipating a benchmark for direct posting format

2014-04-07 Thread david.w.smi...@gmail.com
Benson, I like your idea. I think your idea can be achieved as a codec, one that wraps another codec that establishes the on-disk format. By default the wrapped codec can be Lucene's default codec. I think, if implemented, this would be a change to DPF instead of an additional DPF-variant codec.

Re: Anticipating a benchmark for direct posting format

2014-04-07 Thread david.w.smi...@gmail.com
e > DirectTermsEnum, DirectFields...), it should be easier to do this. So > perhaps we can think about a DirectAtomicReader which does that? I believe > it can share some code w/ DPF, as long as we don't make these APIs public, > or make them @super.experimental and @super.expert.

Re: Welcome Tim Potter as Lucene/Solr committer

2014-04-07 Thread david.w.smi...@gmail.com
Welcome Tim! On Tue, Apr 8, 2014 at 12:40 AM, Steve Rowe wrote: > I'm pleased to announce that Tim Potter has accepted the PMC's invitation > to become a committer. > > Tim, it's tradition that you introduce yourself with a brief bio. > > Once your account has been created - could take a few da

Re: 4.7.2

2014-04-08 Thread david.w.smi...@gmail.com
LOL indeed ;-) But in all seriousness, that should have no bearing on this conversation. On Tue, Apr 8, 2014 at 3:00 AM, Alexandre Rafalovitch wrote: > Let's hope nobody is trying to finish any books right now. :-) > Personal website: http://www.outerthoughts.com/ > Current project: http://www.so

Blog post: Indexing Polygons In Lucene With Accuracy

2014-04-11 Thread david.w.smi...@gmail.com
FYI I published this blog post today: http://www.opensourceconnections.com/2014/04/11/indexing-polygons-in-lucene-with-accuracy/ There's a strong Spatial4j connection because the SerializedDVStrategy referenced uses the new BinaryCodec from Spatial4j 0.4. ~ David

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) - Build # 10597 - Still Failing!

2014-06-18 Thread david.w.smi...@gmail.com
This is not a spatial bug; it’s another case of: https://issues.apache.org/jira/browse/LUCENE-5713 ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley

Re: [VOTE] 4.9.0

2014-06-21 Thread david.w.smi...@gmail.com
The smoke tester failed for me: *lucene-solr_4x_svn*$ python3.3 -u dev-tools/scripts/smokeTestRelease.py http://people.apache.org/~rmuir/staging_area/lucene_solr_4_9_0_r1604085/ 1604085 4.9.0 /Volumes/RamDisk/tmp JAVA7_HOME is /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home NOTE:

Re: [VOTE] 4.9.0

2014-06-22 Thread david.w.smi...@gmail.com
at, Jun 21, 2014 at 3:16 PM, [email protected] > wrote: > > The smoke tester failed for me: > > > > lucene-solr_4x_svn$ python3.3 -u dev-tools/scripts/smokeTestRelease.py > > http://people.apache.org/~rmuir/staging_area/lucene_solr_4_9_0_r1604085/ > > 1604085 4.9.0

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1682 - Still Failing!

2014-07-01 Thread david.w.smi...@gmail.com
Another case of: https://issues.apache.org/jira/browse/LUCENE-5713 (cause unknown) ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jul 1, 2014 at 6:08 PM, Policeman Jenkins Server < [email protected]> wrote: > Build: http

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1682 - Still Failing!

2014-07-01 Thread david.w.smi...@gmail.com
atial module is doing is wrong? > > On Tue, Jul 1, 2014 at 6:13 PM, [email protected] > wrote: > > Another case of: > > https://issues.apache.org/jira/browse/LUCENE-5713 > > (cause unknown) > > > > ~ David Smiley > > Freela

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1682 - Still Failing!

2014-07-01 Thread david.w.smi...@gmail.com
On Tue, Jul 1, 2014 at 6:54 PM, Robert Muir wrote: > FieldCache is historically lenient, it allows all kinds of nonsense, > such as uninverting a multi-valued field as single-valued (e.g. leaves > gaps in ordinals and other bullshit that will cause this assertion to > fail). > > I can fix fieldcac

Single Field instance for both DocValues and indexed?

2014-07-03 Thread david.w.smi...@gmail.com
I was experimenting with having a user-provided/customized FieldType for indexing code of (mostly) a set of numeric fields that are of a common type. The user/developer might want the type to both be indexed & have docValues, or perhaps just one. Or maybe stored hypothetically for the purposes of

Re: Single Field instance for both DocValues and indexed?

2014-07-03 Thread david.w.smi...@gmail.com
tc. supported more officially? Any way, I’ll go with this for now. FYI this very class is going to show up in spatial BBoxStrategy in a new patch soon. ~ David On Thu, Jul 3, 2014 at 12:48 PM, [email protected] wrote: > I was experimenting with having a user-provided/customized FieldTyp

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/ibm-j9-jdk7) - Build # 10760 - Still Failing!

2014-07-08 Thread david.w.smi...@gmail.com
I’m on it; this’ll get fixed momentarily. Some co-related JIRA issues; one got committed without the other. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jul 8, 2014 at 2:54 PM, Policeman Jenkins Server < jenk...@thetaphi

Re: Using a patch review tool for Lucene / Solr development.

2014-07-10 Thread david.w.smi...@gmail.com
On Wed, Jul 9, 2014 at 1:34 PM, Mark Miller wrote: > A few months ago, I filed INFRA JIRA issue to add the Lucene project to > review board (https://reviews.apache.org) and it was just resolved ( > https://issues.apache.org/jira/browse/INFRA-7630). > Awesome. > I’m not the biggest fan of revie

Re: Hints on constructing/running Solr analyzer chains standalone

2014-07-12 Thread david.w.smi...@gmail.com
That sounds like a wonderful project, Alexandre — I’ve always wanted such a capability! I suggest approaching this very pragmatically based on minimizing the time to get something useful, which means leveraging as much as is available already — that means solr’s existing analysis UI screen. I sug

Re: [JENKINS] Lucene-Solr-SmokeRelease-trunk - Build # 184 - Still Failing

2014-07-18 Thread david.w.smi...@gmail.com
On Fri, Jul 18, 2014 at 10:18 AM, Timothy Potter wrote: > sheisty class LOL that error is funny. Tim, Take a look at the smoke tester like 268 or so. It already makes exceptions for certain Solr contrib modules, and apparently you need to augument it further. ~ David

Re: Distributed spellcheck

2014-07-29 Thread david.w.smi...@gmail.com
Steve, File a bug. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jul 29, 2014 at 9:14 AM, Steve Molloy wrote: > > Hi, > > I'm running into an issue with distributed spellcheck and was wondering if > anyone else faced thi

Re: Welcome Tomás Fernández Löbbe as Lucene/Solr committer!

2014-07-31 Thread david.w.smi...@gmail.com
Welcome Tomas! Will you make it to Lucene/Solr Revolution in November? ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Jul 31, 2014 at 1:16 PM, Tomás Fernández Löbbe < [email protected]> wrote: > Thanks everyone, I’m r

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_11) - Build # 11036 - Still Failing!

2014-08-17 Thread david.w.smi...@gmail.com
I’ll look into it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Aug 16, 2014 at 10:16 AM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11036/ > Ja

Re: [JENKINS] Lucene-4x-Linux-Java7-64-test-only - Build # 29500 - Failure!

2014-08-23 Thread david.w.smi...@gmail.com
Rob, just curious, how did you deduce that? I’m guessing it didn’t reproduce and the logic in question seemed valid and wasn’t recently changed, leaving no sure cause except that G1GC isn’t as stable. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/

Re: Issue with bin/solr script, collection1, and cloud mode

2014-08-28 Thread david.w.smi...@gmail.com
Ok. I wish the router was an explicit option, separate from declaring numShards. And furthermore, that it would never be “implicit” unless you expressly told it to be. People sometimes get this router because they forget numShards, thinking “1 is fine anyway”. — for now. ~ David Smiley Freelanc

Re: VOTE: Solr Reference Guide for 4.10

2014-09-03 Thread david.w.smi...@gmail.com
+1, at least for the spatial part I looked at ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Sep 3, 2014 at 1:20 PM, Chris Hostetter wrote: > > +1 > > : > https://dist.apache.org/repos/dist/dev/lucene/solr/ref-guide/apach

Re: [VOTE] Move trunk to Java 8

2014-09-12 Thread david.w.smi...@gmail.com
Your arguments really resonate with me, Ryan… +1 to Java 8 (FWIW I’m using coding in Java 8 these days already) ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Fri, Sep 12, 2014 at 1:39 PM, Ryan Ernst wrote: > One that is on my

Re: [VOTE] Move trunk to Java 8

2014-09-15 Thread david.w.smi...@gmail.com
Ryan, I’m unclear on what makes a “procedural vote” as such. This seems to me to be about code modifications — in a big way as it’s a large change to the codebase. ~ David

Re: History question: contribution from Solr to Lucene

2014-11-02 Thread david.w.smi...@gmail.com
Alex, You should follow Yonik’s blog (Heliosearch), he has a post on this subject, more or less: http://heliosearch.org/lucene-solr-history/ ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Nov 2, 2014 at 8:36 PM, Alexandre Ra

Re: An experience and some thoughts about solr/example -> solr/server

2014-11-04 Thread david.w.smi...@gmail.com
+1 Yeah, this would be huge. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Nov 4, 2014 at 2:30 AM, Jan Høydahl wrote: > Also a crucial part here is to add a Collection tab in Admin GUI, and a > more intelligent Cores tag,

Multi-valued fields and TokenStream

2014-11-05 Thread david.w.smi...@gmail.com
Several times now, I’ve had to come up with work-arounds for a TokenStream not knowing it’s processing the first value or a subsequent-value of a multi-valued field. Two of these times, the use-case was ensuring the first position of each value started at a multiple of 1000 (or some other configur

Re: Multi-valued fields and TokenStream

2014-11-06 Thread david.w.smi...@gmail.com
ybe the position increment gap would be useful? If set to a value > larger than likely max position for any individual value, it could be used > to infer (non-)first-value-ness. > > > On Nov 5, 2014, at 1:03 PM, [email protected] wrote: > > > > Several times now,

Re: Multi-valued fields and TokenStream

2014-11-06 Thread david.w.smi...@gmail.com
I think I like the other ideas better though. > > On Thu, Nov 6, 2014 at 3:13 PM, [email protected] > wrote: > > Are you suggesting that DefaultIndexingChain.PerField.invert(boolean > > firstValue) would, prior to calling reset(), call > > setPositionIncreme

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_40-ea-b09) - Build # 11586 - Failure!

2014-11-08 Thread david.w.smi...@gmail.com
Weird; I can’t reproduce this given the given Ant invocation given. I used JDK 1.8.0_20. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Nov 8, 2014 at 4:50 PM, Policeman Jenkins Server < [email protected]> wrote: > Build

Re: Welcome Gregory Chanan as Lucene/Solr committer

2014-09-20 Thread david.w.smi...@gmail.com
Welcome! On Friday, September 19, 2014, Steve Rowe wrote: > I'm pleased to announce that Gregory Chanan has accepted the PMC's > invitation to become a committer. > > Gregory, it's tradition that you introduce yourself with a brief bio. > > Mark Miller, the Lucene PMC chair, has already added yo

Re: Lucene Benchmark

2014-09-24 Thread david.w.smi...@gmail.com
I use the benchmark module for spatial and I intend to for highlighting performance next month. On Wednesday, September 24, 2014, Mikhail Khludnev < [email protected]> wrote: > Hi John, > > It's obvious > http://lucene.apache.org/core/4_8_0/benchmark/org/apache/lucene/benchmark/byTask/pa

Re: Question for D. Smiley

2014-08-05 Thread david.w.smi...@gmail.com
Hi Erick, The field type for LatLonType mandates a subFieldSuffix or subFieldType attribute, and so I think there’s clearly a problem if you don’t provide a field type that’s going to match it. The default schema even has a comment on the dynamicField definition for *_coordinate that it’s needed.

Re: Can't assign jiras to myself

2014-08-06 Thread david.w.smi...@gmail.com
Tomás, I put you into the “Committers” role for Lucene & Solr in JIRA just now. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Aug 6, 2014 at 9:51 PM, Tomás Fernández Löbbe wrote: > May I be missing the "committer role" i

Re: how to do auto suggestion using apache lucene?

2014-10-01 Thread david.w.smi...@gmail.com
On Wed, Oct 1, 2014 at 9:19 AM, Alexandre Rafalovitch wrote: > https://github.com/arafalov/Solr-Javadoc/tree/master/SearchServer Pretty cool, Alex! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley

Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-09 Thread david.w.smi...@gmail.com
I’m working on making highlighting both accurate and fast. By “accurate”, I mean the highlights need to accurately reflect a match given the query and various possible query types (to include SpanQueries and MultiTermQueries and obviously phrase queries and the usual suspects). The fastest highli

Re: Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-10 Thread david.w.smi...@gmail.com
On Fri, Oct 10, 2014 at 6:39 AM, Michael McCandless < [email protected]> wrote: > +1 for a "completely accurate" (each snippet shown matches the query) > and fast highlighter, but it's a real challenge because you need a > clean way to recursively iterate all positions for any (even > non-

Re: Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-10 Thread david.w.smi...@gmail.com
On Fri, Oct 10, 2014 at 7:13 AM, Robert Muir wrote: > On Fri, Oct 10, 2014 at 12:38 AM, [email protected] > wrote: > > The fastest > > highlighter we’ve got in Lucene is the PostingsHighlighter but it throws > out > > any positional nature in the query and can

Re: Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-10 Thread david.w.smi...@gmail.com
ment > themselves”. > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: [email protected] > > *From:* [email protected] [mailto:[email protected] > ] > *Sent:* Friday, October 10, 2014 4:46 PM > *To

Re: Solr: very slow custom Query/Weight/Scorer, "post filtering" vs sorting

2014-10-14 Thread david.w.smi...@gmail.com
On Mon, Oct 13, 2014 at 11:04 AM, Patrick Schemitz wrote: > This Query/Weight/Scorer construct is obviously very costly, so I don't > want it to leapfrog with the other - much faster - filters in the query > (especially when using a high threshold). > It’s leap-frogging with filters? That’s str

Re: Change the name of the implicit router in SolrCloud?

2014-10-16 Thread david.w.smi...@gmail.com
+1 for “manual”. Furthermore, I think specifying the router should become mandatory or default to the has based router. For back-compat, we can keep current behavior but output a warning about what choice was made. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://ww

Re: Change the name of the implicit router in SolrCloud?

2014-10-16 Thread david.w.smi...@gmail.com
Not if you don’t specify numShards, and then you can’t shard-split later. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Oct 16, 2014 at 11:18 AM, Yonik Seeley wrote: > On Thu, Oct 16, 2014 at 11:15 AM, david.w.

Re: Inconsistency in the suggester factories

2015-02-28 Thread david.w.smi...@gmail.com
On Sat, Feb 28, 2015 at 2:48 PM, Erick Erickson wrote: > I think this is worth a JIRA, anyone else got an opinion? And what > should we do here? Just use one or the other? Remove the one we decide > against? Allow both as synonyms? Deprecate one? > Standardize on one, the other becomes a depreca

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_40-ea-b22) - Build # 11897 - Still Failing!

2015-02-28 Thread david.w.smi...@gmail.com
Ha! Randomized testing FTW! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Feb 28, 2015 at 10:29 AM, Michael McCandless < [email protected]> wrote: > I committed a fix .. this was a fun one: SimpleText had a bug wh

Re: Welcome Ramkumar Aiyengar as Lucene/Solr committer

2015-03-02 Thread david.w.smi...@gmail.com
Welcome Ram! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Mar 1, 2015 at 11:39 PM, Shalin Shekhar Mangar < [email protected]> wrote: > I'm pleased to announce that Ramkumar Aiyengar has accepted the PMC's > invitatio

Re: DocValues instead of stored values

2015-03-02 Thread david.w.smi...@gmail.com
I have a patch to do this somewhat automatically here: https://issues.apache.org/jira/browse/SOLR-5478 I’m waiting on SOLR-6810 before revisiting the patch. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Mar 2, 2015 at 9:08

Re: DocValues instead of stored values

2015-03-02 Thread david.w.smi...@gmail.com
On Mon, Mar 2, 2015 at 9:13 AM, Shalin Shekhar Mangar < [email protected]> wrote: > The problem with fetching from DocValue automatically is that it may cause > as many number of disk seeks as the number of doc value fields being > retrieved. True in the worst-case (cold disk cache). If yo

Re: svn commit: r1664126 - in /lucene/dev/trunk/solr: core/src/java/org/apache/solr/core/ core/src/java/org/apache/solr/handler/ core/src/test-files/ core/src/test/org/apache/solr/core/ core/src/test/

2015-03-04 Thread david.w.smi...@gmail.com
I use that judgement too — sometimes I don’t bother if it’s internal and I never would for something trivial like a typo. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 4, 2015 at 4:13 PM, Ramkumar R. Aiyengar < andyetit

Re: solr client sdk's/libraries for native platforms

2014-11-24 Thread david.w.smi...@gmail.com
FYI see https://wiki.apache.org/solr/IntegratingSolr for a list. This is a great use of the wiki. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Nov 24, 2014 at 10:35 AM, Alexandre Rafalovitch wrote: > Well, a start would

IntelliJ build

2014-11-24 Thread david.w.smi...@gmail.com
On trunk I cleaned and re-created my IntelliJ based build (ant clean-idea, idea). IntelliJ didn’t get the memo about Java 8 so I changed that (locally). Then I found that the Solr velocity contrib couldn’t resolve a ResourceLoader class in analysis-common. So I simply checked the “export” checkb

Re: Where is the SVN repository only for Lucene project ?

2014-11-26 Thread david.w.smi...@gmail.com
GitHub offers SVN access: svn checkout https://github.com/apache/lucene-solr ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 26, 2014 at 4:19 AM, Yosuke Yamatani < [email protected]> wrote: > Dear sir/madam

Re: IntelliJ build

2014-11-26 Thread david.w.smi...@gmail.com
introduce > misalignments with the Ant build, and because unwanted transitive deps > could improperly influence the IntelliJ build. But if you feel strongly > about it, go ahead: -0. > > Thanks for working on it. > > Steve > > > On Nov 24, 2014, at 10:37 PM, [email protected]

Re: svn commit: r1642294 - in /lucene/dev/trunk/lucene: ./ highlighter/src/java/org/apache/lucene/search/highlight/ highlighter/src/test/org/apache/lucene/search/highlight/ test-framework/src/java/org

2014-11-29 Thread david.w.smi...@gmail.com
Reposting my comment on JIRA: Ouch; so sorry I failed the build! In my checkout I have several pending issues related to highlighting, and apparently the Solr one, SOLR-6680 , is dependent. I should have monitored the dev list closely; I recall gett

Re: solr client sdk's/libraries for native platforms

2014-12-01 Thread david.w.smi...@gmail.com
I meant to reply earlier... On Mon, Nov 24, 2014 at 11:37 AM, Alexandre Rafalovitch wrote: > They are super-stale Yup but it’s a wiki so feel free to freshen it up. I’ll be doing that in a bit. It may also be helpful if these particular pages got more prominence/visibility by being linked fr

Re: solr client sdk's/libraries for native platforms

2014-12-01 Thread david.w.smi...@gmail.com
wrote: > > I think in the vein of a “do-it-tocracy”, getting the Wiki updated is a > perfectly good first step, and then if there is a better approach, > hopefully that occurs.… ;-) > > > > > > > >> On Dec 1, 2014, at 10:51 AM, Alexandre Rafalovitch > wrote:

Re: [JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 2267 - Failure

2014-12-02 Thread david.w.smi...@gmail.com
I’ll dig. On Tue, Dec 2, 2014 at 11:57 AM, Apache Jenkins Server < [email protected]> wrote: > Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2267/ > > 1 tests failed. > FAILED: org.apache.lucene.spatial.prefix.DateNRStrategyTest.testContains > {#9 seed=[801EEB0A7D92DF9

Re: [JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 2267 - Failure

2014-12-04 Thread david.w.smi...@gmail.com
[email protected] < [email protected]> wrote: > I’ll dig. > > On Tue, Dec 2, 2014 at 11:57 AM, Apache Jenkins Server < > [email protected]> wrote: > >> Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2267

Re: solr client sdk's/libraries for native platforms

2014-12-04 Thread david.w.smi...@gmail.com
. Perhaps > >> somebody else can revisit it with a fresh eye now that I cleaned it up > >> a bit. > >> > >> Regards, > >> Alex. > >> Personal: http://www.outerthoughts.com/ and @arafalov > >> Solr resources and newsletter: http://www.solr-st

Re: Give Solr its "own" port number

2015-02-04 Thread david.w.smi...@gmail.com
-0 Hoss’s points are my view as well. 8983 is already pretty well known amongst Solr users. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Feb 4, 2015 at 12:37 PM, Chris Hostetter wrote: > : Until 5.x Solr would start on

Re: Interesting resource for Unix shell script cleanup

2015-02-05 Thread david.w.smi...@gmail.com
Cool! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Feb 5, 2015 at 10:25 AM, Steve Rowe wrote: > > On Feb 5, 2015, at 9:51 AM, Alexandre Rafalovitch > wrote: > > > > Hi, > > > > Just saw a link to http://www.shellcheck.n

Re: Static Analysis Tooling

2015-02-05 Thread david.w.smi...@gmail.com
+1 to this idea. Note this is tracked as https://issues.apache.org/jira/browse/LUCENE-3973 ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Feb 5, 2015 at 12:43 PM, Mike Drob wrote: > Devs, > > I'd like to bring up static a

Re: [VOTE] 5.0.0 RC2

2015-02-11 Thread david.w.smi...@gmail.com
I found two problems, and I’m not sure what to make of them. First, perhaps the simplest. I ran it with Java 8 with this at the command-line (copied from Uwe’s email, inserting my environment variable): python3 -u dev-tools/scripts/smokeTestRelease.py --test-java8 $JAVA8_HOME http://people.apach

Re: [VOTE] 5.0.0 RC2

2015-02-11 Thread david.w.smi...@gmail.com
JAVA_HOME to point to java 8 as well (that's what it > looks like since only jdk is listed in that output)? --test-java8 is meant > to take the java 8 home, but your regular JAVA_HOME should stay java 7. > > > > On Wed, Feb 11, 2015 at 6:13 AM, [email protected] < >

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_31) - Build # 11780 - Failure!

2015-02-11 Thread david.w.smi...@gmail.com
It reproduces; I’m on it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Feb 11, 2015 at 12:30 PM, Policeman Jenkins Server < [email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11780

Re: [VOTE] 5.0.0 RC2

2015-02-13 Thread david.w.smi...@gmail.com
Anshum (and anyone else), How would you feel about getting https://issues.apache.org/jira/browse/LUCENE-6215 in, which is quite simply moving a particular class (new to 5.x) to the correct Java package. If this isn’t done… then I’m forced to consider marking it deprecated at it’s current wrong lo

Re: Welcome Varun Thacker as Lucene/Solr committer

2015-02-23 Thread david.w.smi...@gmail.com
Welcome Varun, and congratulations! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Feb 23, 2015 at 9:51 AM, Grant Ingersoll wrote: > Hi All, > > Please join me in welcoming Varun Thacker as the latest committer on > Lucene

StandardTokenizer, maxTokenLength behavior — likely bug

2015-01-26 Thread david.w.smi...@gmail.com
On one of my other open-source projects (SolrTextTagger) I have a test that deliberately tests the effect of a very long token with the StandardTokenizer, and that project is in turn tested against a wide matrix of Lucene/Solr versions. Before Lucene 4.9, if you had a token that exceeded maxTokenL

Re: StandardTokenizer, maxTokenLength behavior — likely bug

2015-01-26 Thread david.w.smi...@gmail.com
g/jira/browse/LUCENE-5400 > > On Mon, Jan 26, 2015 at 11:17 AM, [email protected] < > [email protected]> wrote: > >> On one of my other open-source projects (SolrTextTagger) I have a test >> that deliberately tests the effect of a very long token with the >&

Re: Potential contribution: Geo 3d package

2015-01-22 Thread david.w.smi...@gmail.com
Nice Karl! I’d love to learn more about this. Does the shapes here implement a Spatial4j Shape and thus would work with SpatialPrefixTree & friends for index & search? If not, what is the search side of the equation here? ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer h

Re: Potential contribution: Geo 3d package

2015-01-22 Thread david.w.smi...@gmail.com
ial; I can contribute that >> separately. >> >> Karl >> >> >> On Thu, Jan 22, 2015 at 3:27 PM, [email protected] < >> [email protected]> wrote: >> >>> Nice Karl! I’d love to learn more about this. Does the shapes here &g

Re: Potential contribution: Geo 3d package

2015-01-22 Thread david.w.smi...@gmail.com
t does this > but which requires a FunctionQuery to be part of the search query. > > If you are in favor, I'll create a ticket and attach the library. > > Karl > > > On Thu, Jan 22, 2015 at 4:01 PM, [email protected] < > [email protected]> wro

Re: Solr geospatial index?

2015-01-10 Thread david.w.smi...@gmail.com
Hello Matteo, Welcome. You are not bothering/me-us; you are asking in the right place. Jack’s right in terms of the field type dictating how it works. LatLonType, simply stores the latitude and longitude internally as separate floating point fields and it does efficient range queries over them f

Re: how to highlight the whole search phrase only?

2015-01-12 Thread david.w.smi...@gmail.com
Hi Meena, Please use the “solr-user” list for user questions. This is the list for development of Lucene & Solr. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jan 12, 2015 at 6:26 PM, [email protected] < meena.sri.

  1   2   3   >