Re: New Solr Admin UI - POC Presentation

2024-10-05 Thread David Smiley
Looking forward to it! On Mon, Sep 30, 2024 at 2:02 AM Christos Malliaridis < c.malliari...@gmail.com> wrote: > Hello everyone, > > I would like to invite you all to the presentation about the proposal for a > new Solr Admin UI. > > The presentation is about the content of the current proof-of-co

Re: SolrException: ByteBuffersDirectory can only be used with the 'single' lock factory type

2024-10-22 Thread David Smiley
Hi, Presumably a previous version worked? What version was that? On Sat, Oct 19, 2024 at 7:10 AM wrote: > Hello, > > > > When starting up Solr Docker Image 9.7.0 I always get the following error > when loading my core 'places': org.apache.solr.common.SolrException: > ByteBuffersDirectory can on

Re: Error when creating collection with Solr 9 data node and Solr 8 overseer node

2024-10-24 Thread David Smiley
Based on the problem description, it seems you might have a work-around of submitting collection admin commands to the Overseer node instead? At least during the upgrade. Also... I wonder if upgrading to 9.0 instead of 9.6 may help. Not that I know of anything specific that's incompatible but I c

Re: org.locationtech.jts.geom.TopologyException with a topology that "looks" valid?

2024-10-24 Thread David Smiley
Something like this (off the top of my head; didn't verify): fq= $fq.p1 $fq.p2 &fq.p1={!.}&fq.p2={!.} Note the leading space after fq= here is important for obscure reasons. ~ David Smiley On Thu, Oct 24, 2024 at 4:12 AM Carlo Ascani wrote: > Hi all, > > I am ge

Sharing a post: "How to fork: Best practices and guide"

2024-11-26 Thread David Smiley
/ Obviously, if you don't need a fork then count yourself lucky! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Unified Highlighter and Fuzzy Searches

2021-03-31 Thread David Smiley
I tried this in tests both at the Lucene layer and Solr layer and I'm not seeing the failure to highlight for the UH. What query parser are you using? ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 31, 2021 at 11:39 AM seez

Re: Unified Highlighter and Fuzzy Searches

2021-04-04 Thread David Smiley
This was a bug that was fixed in 8.7: https://issues.apache.org/jira/browse/LUCENE-9427 I thought perhaps hl.weightMatches=false might work but it doesn't. So you have to upgrade to get this. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley O

Re: [VOTE] Solr Operator Logo

2021-05-02 Thread David Smiley
quot; for Solr. (Binding vote) ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Apr 27, 2021 at 5:00 PM Houston Putman wrote: > Hello Solr users & devs, > > The Solr Operator is the first subproject under Apache Solr and thus needs &g

Re: Solr 8.8.2 childFilter multiple conditions

2021-05-06 Thread David Smiley
!field f=color v=Red}'etc. Disclaimer: I didn't test that; it *may* be necessary to move out some of this into other parameters based on parsing rules/restrictions e.g. childFilter=$theChildFilter and then add a top-level param. But I think it's not needed. ~ David Smiley

Security: Better secure defaults?

2021-05-06 Thread David Smiley
I argue that a env=prod should result in Solr's config APIs being disabled -- equivalent to -Ddisable.configEdit=true. I believe a minority of Solr users actually use these APIs, yet they are frequently a step in exploiting weaknesses in Solr. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Solr and Security; what is CVE worthy?

2021-05-06 Thread David Smiley
and-authorization-plugins.html (RBAC -- Role Based Access Control). The ref guide actually uses the achronym RBAP. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Security: Better secure defaults?

2021-05-07 Thread David Smiley
different default depending on the setting. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, May 6, 2021 at 7:02 PM Eric Pugh wrote: > I think that part of the challenge goes to the deeper issue that > configuring Solr isn’t easy. We

Re: Security: Better secure defaults?

2021-05-07 Thread David Smiley
> Listen on 0.0.0.0 but only accept traffic from private addresses? Respect x-forwarded-for (and its aliases) in that case. +1 ! Feel free to file a JIRA issue; maybe there is one already. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Ma

Re: Security: Better secure defaults?

2021-05-07 Thread David Smiley
r over year. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, May 7, 2021 at 3:39 AM Thomas Corthals wrote: > I would like to be able to define core specific permissions with rule-based > authorization in security.json in the same way you can d

Re: Solr 8.8.2 childFilter multiple conditions

2021-05-07 Thread David Smiley
Subquery is a good idea here too. It's slower but it's also more powerful, more general. I'll try and get SOLR-15156 into 8.9 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, May 6, 2021 at 3:42 PM Jonathan Bridges wrote: >

Re: Solr: Get leaderness status of local node

2021-05-09 Thread David Smiley
r DURP as you please. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Sun, May 9, 2021 at 12:23 PM Shawn Heisey wrote: > On 5/8/2021 8:05 PM, lamine lamine wrote: > > I only want the code be run once per shard. One way to guarantee that &g

Re: childFilter Solr 6.6

2021-05-09 Thread David Smiley
Hi, childFilter is guaranteed to return the documents in the order it was provided to Solr. If you want to sort or do other interesting things, consider [subQuery] ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Apr 29, 2021 at 3:55 PM Roopa

Re: -Ddisable.configEdit=true does not work

2021-05-09 Thread David Smiley
s running in a debugger with breakpoints, which is why it took 10 seconds :-) I was also using main branch (eventual 9.0). I ran Solr 8.8 as well, this time in SolrCloud mode, created a "demo" collection, and I got the same error message as above. ~ David Smiley Apache Lucene/Solr Search

Re: Partial update error for missing _root_ after updating to Solr 8.8.2

2021-06-10 Thread David Smiley
The follow-up here from JIRA is that, as of Solr 8.0, you must not add "_root_" to a schema for an existing collection. Solr uses this field instead of the uniqueKey for certain identity checks. Chaos will ensue if you add it later. I shall update the ref guide to add a warning. ~ David On

Re: Solr Phonetic Search funny

2021-07-09 Thread David Smiley
Using debug=all you can review in what field(s) the match was on. That should give clues. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Jul 7, 2021 at 3:23 PM Flowerday, Matthew J < matthew.flower...@gb.unisys.com> wrote: >

Re: Time Routed Alias

2021-08-11 Thread David Smiley
/update/processor/TimeRoutedAliasUpdateProcessorTest.java#L184 It'd be nice if it would remove itself from the alias. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Aug 10, 2021 at 9:26 PM Matt Kuiper wrote: > I found some helpful inf

Re: Unexpected results while performing a full text search with an asterisk

2021-08-12 Thread David Smiley
Stephen is spot on. Charlie: As nice as Solr's analysis screen is, it doesn't interpret any query syntax and so won't show you the multiterm analysis chain results. The UI ought to clarify this. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidw

Re: Having problem with implicit field "_root_"

2021-09-02 Thread David Smiley
It appears you are not using child documents, thus you should not define _root_. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Aug 31, 2021 at 4:30 PM Ed Yu wrote: > We have a solr setup from a very old version (1.4) and we are upgrading

Re: Encryption at rest

2021-09-11 Thread David Smiley
hings. [3] https://nightlies.apache.org/solr/draft-guides/solr-reference-guide-main/solr-on-hdfs.html [4] https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.0.0/configuring-hdfs-encryption/content/create_an_encryption_zone.html ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.co

Re: Docker Image for Solr 8.10.1

2021-10-29 Thread David Smiley
It's out! https://hub.docker.com/_/solr Thanks for your help Andreas! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Oct 27, 2021 at 2:11 AM Andreas Hubold wrote: > Hi, > > the docker image for the latest Solr release 8

Re: [ANNOUNCE] Apache Solr 8.11.0 released

2021-11-17 Thread David Smiley
I'll start the Docker image release process now; it should be out by the weekend hopefully. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 17, 2021 at 3:54 AM Adrien Grand wrote: > The Solr PMC is pleased to announce the re

[ANNOUNCEMENT] Solr's Docker images were updated to remediate a CVE

2021-12-12 Thread David Smiley
#apache-solr-affected-by-apache-log4j-cve-2021-44228 [2] https://www.docker.com/blog/apache-log4j-2-cve-2021-44228/ ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: solr Help

2021-12-12 Thread David Smiley
my theory. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Sun, Dec 12, 2021 at 4:11 AM Surya R wrote: > hi Solr Devs, > > I need guidance on a problem I am having. We recently upgraded to > solr-8.11. We still use DIH to pull data fr

Re: When will solr 8.11.1 become available?

2021-12-16 Thread David Smiley
https://github.com/docker-solr/docker-solr/pull/401 I would guess perhaps in 12 hours from now maybe. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Dec 16, 2021 at 9:26 AM Carlos Cueto wrote: > Any idea when it will be available on Doc

Re: How to mitigate CVE-2021-45105

2021-12-19 Thread David Smiley
Solr's default logging config isn't vulnerable: https://solr.apache.org/security.html#apache-solr-affected-by-apache-log4j-cve-2021-44228 You'd have to go out of your way to configure logging to use such this vulnerable mechanism, and that isn't likely for Solr users to do

Re: Non equi-joins with streaming expressions

2022-01-04 Thread David Smiley
I'd prefer to use Lucene's "expressions" module and thus do JavaScript. This is more accessible to a wider audience, and I believe makes safety/security easier (though I have not checked). ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsm

Re: Looking for expertise on comparing Solr search to Postgres full-text search

2022-03-04 Thread David Smiley
a Maven repository manager like Nexus or it's competitors (last I checked), they are still stuck in the stone-age -- it's painful when you've been exposed to so much better. On the backend, if all you know is a database, you may not see how to make a faceting UI work because it's r

Re: Retain Data Import Handler In Solr9.0

2022-07-22 Thread David Smiley
The DIH does not yet support Solr 9 but I don't think it'll be long before it does. https://github.com/rohitbemax/dataimporthandler/issues/32 Note the dubious choice of the word "deprecated" was used because it's no longer a part of Solr. Practically speaking, it *moved*

ANN: ApacheCON "BoaF" for Solr

2022-09-19 Thread David Smiley
FYI I arranged for a Solr Birds of a Feather (BoaF) session at ApacheCon, on Wednesday October 5th, 5:50-6:30 pm. You will see it in the Expo Pass app. I expect it'll be relatively informal; a good time to meet 'n greet, and make dinner arrangements with community members. ~ David Smi

Re: Loading solr.xml from zookeeper

2022-09-21 Thread David Smiley
ANNAMANENI: can you clarify what you mean by "multiple repositories"; maybe "repositories" is a word with specific meaning for your system. If this functionality were removed, would something be harder? I'm going to guess you aren't using Docker / containers yet.

Re: How to make /api/cores or /solr/admin/cores wait for all cores to load and then only return?

2022-11-17 Thread David Smiley
I suppose not. The CoreContainer internally knows whether it has completed or not but I don't see that it's exposed. It seems easy to support such a feature. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 16, 2022 at 2:02

Apache Solr is vulnerable to CVE-2022-39135 via /sql handler

2022-11-21 Thread David Smiley
Vendor: The Apache Software Foundation Versions Affected: Solr 6.5 to 8.11.2 Solr 9.0 Description: Apache Calcite has a vulnerability, CVE-2022-39135, that is exploitable in Apache Solr in SolrCloud mode. If an untrusted user can supply SQL queries to Solr’s “/sql” handler (even in

Re: About Using Hadoop in SolrCloud

2023-02-23 Thread David Smiley
. Admittedly I don't have real experience here but this is my thinking. The most annoying thing about Solr's HDFS support is that SolrCloud's replication is quite redundant/wasteful with that at the storage layer, thus adding cost inefficiency. There is potential for improvements

Re: About Using Hadoop in SolrCloud

2023-02-27 Thread David Smiley
AR files and some trivial configuration. The main problem is that such a home-brew concoction of theoretically compatible things is on your shoulders to debug/support. Solr isn't testing its support for this; it will fail for some versions as it did for me. Maybe Solr *should* test/suppor

Re: Donating to Solr

2023-03-02 Thread David Smiley
fund this sort of thing due to ASF's policies to avoid any appearance of pay-for-work. I'm wrapping up an Outreachy project as a mentor but it almost didn't happen due to lack of funding. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Number of Collections in a SolrCloud

2023-03-02 Thread David Smiley
I second Brian's experience. Specific version & numbers reached vary somewhat. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 28, 2021 at 7:23 PM Brian Lininger wrote: > Hi Matt, > We're currently running Solr 6.

Hadoop Auth module / HadoopAuthPlugin; anyone using?

2023-03-02 Thread David Smiley
this included. With this email here, I'm trying to ascertain if anyone would care if it was outright removed. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: [ANNOUNCE] DataImportHandler 9.0.0 released

2023-04-20 Thread David Smiley
Yay, finally! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Apr 20, 2023 at 9:30 AM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Hi all, > > DataImportHandler 9.0.0 has now been released for Solr 9.0.0, thanks

Re: Limiting Backup IO

2023-06-27 Thread David Smiley
Here's a POC: https://github.com/apache/solr/pull/1729 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 26, 2023 at 1:53 PM Jason Gerlowski wrote: > Sounds like something that would be very useful for folks. > > I'

Re: Limiting Backup IO

2023-06-27 Thread David Smiley
Here's a POC: https://github.com/apache/solr/pull/1729 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 19, 2023 at 3:36 PM David Smiley wrote: > Has anyone mitigated the potentially large IO impact of doing a backup of &

Re: Limiting Backup IO

2023-07-07 Thread David Smiley
queue and start the next one if appropriate. > > - This ensures fairness for expensive and non expensive operations. > > Non-expensive ones will always have at least 40 threads to be quickly > > handled. And this works well in distributed mode since the overseer is > not > &g

Re: [ANNOUNCE] Apache Solr 9.3.0 released

2023-07-23 Thread David Smiley
Yes; thanks Houston! This is a notable Solr release. ~ David On Fri, Jul 21, 2023 at 4:08 PM Alessandro Benedetti wrote: > Thanks Houston and everyone involved, for the release! > > > On Fri, 21 Jul 2023, 21:56 Houston Putman, wrote: > > > The Solr PMC is pleased to announce the release of Ap

Re: JSON boolean query syntax with edismax as default QueryParser

2023-07-31 Thread David Smiley
Hi Jane, That change in 7.2 does look like it's correlated, and I'm the one who implemented it in the name of security. Could you walk me through a short series of steps to show the problem with one of Solr's "example" setups like techproducts? Step one is run it, step two is you sending the que

Re: JSON boolean query syntax with edismax as default QueryParser

2023-07-31 Thread David Smiley
t; > Appreciatively, > > -Jane > > From: David Smiley > Date: Monday, July 31, 2023 at 5:58 AM > To: users@solr.apache.org > Subject: Re: JSON boolean query syntax with edismax as default QueryParser > Hi Jane, > > That change in 7.2 does look like it's co

Re: JSON boolean query syntax with edismax as default QueryParser

2023-08-01 Thread David Smiley
ture (an advanced > search form), and are planning to continue using edismax for all the rest. > > -Jane > > From: David Smiley > Date: Monday, July 31, 2023 at 8:53 PM > To: users@solr.apache.org > Subject: Re: JSON boolean query syntax with edismax as default Quer

Re: 8.11.3 release

2023-08-02 Thread David Smiley
Thanks for volunteering, Ishan! I wonder if it's worth it porting the 8x codeline into our build infrastructure for 9x? i.e. use our existing Gradle build instead of Ant. This way subsequent releases would be easier (if needed), would be easier for anyone maintaining a fork of 8x, and we needn't

Re: Help Solr Newsletter October 2023 with links, blogs, articles

2023-11-29 Thread David Smiley
Alejandro, How's the newsletter project going? I see October is still in DRAFT state and I see a new one for November. Perhaps you were discouraged by the Twitter account status matter; I recommend completely ignoring that! When it's time to publish, we'll publish. ~ Davi

Re: ExitableDirectoryReader warning

2024-01-04 Thread David Smiley
This is the ramification of using "timeAllowed" (a request param to a search) ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Jan 4, 2024 at 2:18 PM rajani m wrote: > Hi, > > What scenarios would solr warn about "

Re: Optimize latency of queries with facets

2024-01-07 Thread David Smiley
Enabling docValues on a boolean field is probably not a good idea. If disabling that doesn't help (and I do think it will), then you might want to use a simple string field that a doc either has the name of the boolean (if true) or does not, then facet on that. On Thu, Jan 4, 2024 at 3:18 PM Mikh

Re: [dev help wanted] SOLR-17074: incorrectly escaped quotes in bin/solr script

2024-01-16 Thread David Smiley
Nearby there's https://issues.apache.org/jira/browse/SOLR-17112 as well; rather trivial On Tue, Jan 16, 2024 at 6:57 AM Vincenzo D'Amore wrote: > Hi Christine, I can try it. > > On Tue, Jan 16, 2024 at 12:39 PM Christine Poerschke (BLOOMBERG/ LONDON) < > cpoersc...@bloomberg.net> wrote: > > > Hi

[ANNOUNCE] Apache Solr 9.4.1 released

2024-01-18 Thread David Smiley
The Solr PMC is pleased to announce the release of Apache Solr 9.4.1. Solr is the popular, blazing fast, open source NoSQL search platform from the Apache Solr project. Its major features include powerful full-text search, hit highlighting, faceted search, dynamic clustering, database integration,

Re: highlighting performance

2024-03-14 Thread David Smiley
es are only 200 characters. 2-3M values -- wow that's something. Solr has to pull all that data back per doc that's matched. Good luck, ~ David Smiley On Mon, Mar 11, 2024 at 5:53 PM Maria Muslea wrote: > > Hi, > > I am having trouble with highlighting being very slow. I trie

Re: Migrating from solr8.11.3 to solr 9.5.0

2024-03-14 Thread David Smiley
Also look at the logs for warnings. Use of legacy/deprecated stuff is often logged. On Wed, Mar 13, 2024 at 5:08 AM Isabella Trevisan wrote: > > Hi , > I am plannig to migrate from solr 8.11.3 to 9.5.0 in solrcloud > architecture. > > The idea is to create a new line of solrcloud 9.5 where to

Prometheus metrics, the future

2024-05-23 Thread David Smiley
Exporter isn't necessarily going away... we'll see what happens as time goes on. https://issues.apache.org/jira/browse/SOLR-10654 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Performance Suggestion for Dense Vectors

2024-05-29 Thread David Smiley
There *is* a Solr blog site that just launched: https://solr.apache.org/blog.html On Thu, Mar 28, 2024 at 3:49 PM rajani m wrote: > > @Alessandro, > Is there a solr blog site where we can submit work/articles or are you > suggesting to post on my own site and share a link here? I prefer the > fo

Using CloudSolrClient without ZooKeeper access?

2024-07-19 Thread David Smiley
see fixing the performance problems piecemeal with breaking support for certain things (perhaps aliases or cluster properties... we'll see). The recourse for any hypothetical user is of course to use the ZK connection or to use plain (non-Cloud) SolrClient. ~ David Smiley Apache Lucene/Solr S

Re: classNotFound for sql handler

2024-07-23 Thread David Smiley
Please also need to read release notes :-). (this is not an obscure thing being discussed) On Mon, Jul 15, 2024 at 6:25 AM Eric Pugh wrote: > > It would be nice if the exception that was raised had some sort of hint to > what you need to do to fix it! I suspect we see this question more and mo

Re: classNotFound for sql handler

2024-07-23 Thread David Smiley
Users also need to read the release notes :-). (this is not an obscure thing being discussed) > On Mon, Jul 15, 2024 at 6:25 AM Eric Pugh > wrote: > > > > It would be nice if the exception that was raised had some sort of hint to > > what you need to do to fix it! I suspect we see this questio

FYI for those trying Java 21

2024-08-21 Thread David Smiley
regression if done: https://issues.apache.org/jira/browse/SOLR-17375 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: CustomBreakIterator Performance Issues

2021-03-08 Thread David Smiley
. It was just a special character. Perhaps use a "vertical tab"? On the Solr side, it then became a very trivial char based iterator which is already in Lucene/Solr. You might do this as well. You could add a custom Solr UpdateRequestProcessor (URP) that inserts these characters. ~ Da

Re: Conflict between atomic update and highlighting constraints

2021-03-13 Thread David Smiley
Good point. Using a different stored field for highlights has been asked for; there's a JIRA issue & a patch: https://issues.apache.org/jira/browse/SOLR-1105 I'm too busy to push this forward by myself but if you can take over there, I can work with you (or anyone) to get it in.

Re: Increase in response time in case of collapse queries.

2021-03-17 Thread David Smiley
the collapse because it's redundant work. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 17, 2021 at 11:19 AM Florin Babes wrote: > Yes. It seems that if you specify sort="score desc" the collapser > recomputes the

Re: Disable commits during a REINDEXCOLLECTION

2021-03-17 Thread David Smiley
Hi Karl, Look into the "config apI". Let us know how it goes! Ideally, this feature would do this automatically. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 17, 2021 at 2:02 PM Karl Stoney wrote: > Hi all, > We&#

Re: NRT Real time Get with documentCache

2021-03-17 Thread David Smiley
I agree with Erick that it shouldn't matter at all. The freshness is indifferent to the presence of that cache, since Solr is smart enough to know when it's dirty. The document cache is used by RTG and thus will play a role in performance of it. ~ David Smiley Apache Lucene/Solr Search

Re: Conflict between atomic update and highlighting constraints

2021-03-19 Thread David Smiley
x27;m imagining a feature where the UH might see that a particular hl.fl field is not "stored" yet accommodate this by automatically detecting that this field is the destination of one copyField declaration whose source is "stored", or the reverse -- is copied to some other field

Deprecation of QueryElevationComponent's support for elevate.xml in data directories

2021-03-19 Thread David Smiley
et me know. SOLR-15274 - QueryElevationComponent: auto-load file changes; remove data dir support <https://issues.apache.org/jira/browse/SOLR-15274> ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: How to set maxExpansions parameter for fuzzy search

2021-03-20 Thread David Smiley
It appears this setter needs to be called: org.apache.solr.parser.SolrQueryParserBase#setFuzzyMinSim and it could be done by edismax. PR welcome! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Mar 18, 2021 at 12:28 PM Olivier Tavard wrote

Re: REINDEXCOLLECTION unknown field

2021-03-22 Thread David Smiley
https://solr.apache.org/guide/8_8/collection-management.html#reindexcollection See the "fl" param ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Mar 22, 2021 at 9:01 AM Karl Stoney wrote: > Hi, > Sorry for all the questions

Re: Deprecation of QueryElevationComponent's support for elevate.xml in data directories

2021-03-22 Thread David Smiley
so I could see a need for either forcing it or for Solr to somehow "watch" the configs to do a commit on that basis. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Mar 22, 2021 at 4:28 AM Mónica Marrero wrote: > It seems to be

Re: I may fork nutch. Is it a good plan?

2025-01-07 Thread David Smiley
Forking anything is a burden on you to maintain your fork. You didn't say *why* you want to fork something instead of simply use something. You mentioned adding features but search engine platforms like Solr are designed to be highly pluggable/extensible without forking. It's a platform not a pr

Deprecating ExternalFileField

2025-02-05 Thread David Smiley
FYI I plan to deprecate ExternalFileField for removal in Solr 10 https://issues.apache.org/jira/browse/SOLR-17655 It's been obsolete for many years. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Admin UI Review Meeting - Feedback Requested

2024-11-22 Thread David Smiley
26thor 27th with a slight preference to the 27th. BTW I suggest ruling out 28th as it's a major US holiday (Thanksgiving). On Fri, Nov 22, 2024 at 10:57 AM Jason Gerlowski wrote: > Hey Christos, > > The 26th works best for me personally. > > Though you and I have talked a good bit about the UI

Re: Seeing "Negative" Overseer ID

2024-12-21 Thread David Smiley
Patrick (or Ilan), can you please file a JIRA issue to describe the problem. Ideally also mention the work-around and possible solution ideas. On Wed, Dec 18, 2024 at 12:27 PM Patrick Lok wrote: > Hi Ilan, thank you so much for the pointers! That's exactly the problem. We > updated our system to

Re: LTS, UserManaged Mode

2024-12-21 Thread David Smiley
I highly doubt "user managed" (aka "standalone") mode will go away completely. It *may* become considered so advanced/expert that we might decide to reduce documentation support around it. But the vast majority of Solr tests that work with a Solr instance do it in this mode or an even lesser mode

Re: Creating a Solr Core in Gradle?

2024-12-21 Thread David Smiley
Creating a core is nothing more than a core.properties file on disk. After you stop/start Solr with creating a core, see for yourself. There's nothing magic there. The data directory can be empty of the index. On Thu, Dec 12, 2024 at 1:50 PM John Whelan wrote: > All, > > I've been trying to

Re: Solr performance much worse in SolrCloud mode ?!

2024-12-21 Thread David Smiley
If the schema is no different in the comparison then the problem isn't SOLR-11078. You had a question earlier about QTime. QTime ends once Solr identifies what documents to return, and all the search components have completed (e.g. faceting, highlighting). After this time, Solr still has to fetc

Re: Solr Saved Search Module

2024-12-21 Thread David Smiley
A huge feature! Can you please remind me of the historical pedigree of the underlying functionality? You point to "lucene-monitor" but that in turn came from somewhere. If I'm not mistaken, there was (is?) a Solr plugin out there from which this started, built by Alan Woodward. On Sun, Dec 8, 2

Re: Merge Policy Max Segment Size + Reindexing

2024-12-21 Thread David Smiley
Lucene (and thus Solr) does not split segments. The only closest maybe sorta kinda does situation would be a shard split with the "rewrite" method. On Tue, Dec 10, 2024 at 11:18 AM ufuk yılmaz wrote: > Correct me if I’m wrong, I don’t know if there is an upside of splitting > an already merged

Re: Solr in write-only mode?

2024-12-21 Thread David Smiley
I agree with ufuk. Don't commit until the end. Commits are only about visibility of changes, not about durability (in SolrCloud and sometimes standalone mode). Thus there's no point in sending explicit commits from the client until the end. In solrconfig.xml, it may help to disable auto soft co

Re: Re: Vector search problems SolR 9.6 (Lucene 9.10) vs. SolR 9.7 (Lucene 9.11)

2025-01-23 Thread David Smiley
Hi Andreas, The test org.apache.solr.CursorPagingTest is a single-core test for cursorMark. Alternatively, perhaps you might want to modify a KNN query test like org.apache.solr.search.neural.KnnQParserTest. BTW, the correct capitalization of "Solr" is as I typed it, not as you are typing it. ~

Deprecating "collection" parameter for routing

2025-01-08 Thread David Smiley
ly earlier when SolrCloud collection aliases first appeared. [2] SolrJ side is SolrRequest.getCollection's default implementation and is consulted by CloudSolrClient. [3] Solr server side is HttpSolrCall (also in a V2 subclass) [4] Distributed-search reference is in CloudReplicaSource

Re: Performance Degradation in Solr When Using OR with frange in fq

2025-03-19 Thread David Smiley
Ideally, after the user created the JIRA issue, it would be shared in this thread. Here it is: https://issues.apache.org/jira/browse/SOLR-17699 (fix for 9.9) Nice response Hoss, particularly sharing the "filter" trick, which may be useful here. On Wed, Mar 19, 2025 at 2:18 PM Chris Hostetter wr