Re: Solr core is getting deleted on system reboot.

2022-01-26 Thread Modassar Ather
Hi, The Solr cluster is running on a large ec2 instance. Some more details on the environment. Server : AWS-EC2 instance Zookeeper : Standalone external zookeeper. Solr index : On AWS - EFS Zookeeper data directory : Pointing to a folder on ec2 instance The core deletion is not happening on Solr

Re: Quantile of the field as pseudo field

2022-01-26 Thread govind nitk
Hello All, Can I get to listen whether it's possible or not ? Am I asking something about computationally expensive operations ? On Thu, Jan 20, 2022 at 7:03 AM govind nitk wrote: > Hello to everyone, > > Question: Find a quantile for a field ( say price) as a pseudo field. > > Workaround: Wit

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread Vinay Rajput
It also looks like from your requirement that you want to disable solr search and activate DB search in case of zookeeper cluster failure. That is NOT needed. Solr search is not impacted when zk cluster is down, only indexing is impacted. We have had a situation when our all zk nodes were down for

Re: SolrJ 8.11.1 upgrade - Invalid version (expected 2, but 31) or the data in not in 'javabin' format

2022-01-26 Thread Anshum Gupta
>From what I understand, all solr server instances as well as the 'client' code that talks to the servers have been upgraded to 8.11? Can you please confirm that? Users generally get this response when there's a version compatibility issue in Solr/SolrClient versions. On Wed, Jan 26, 2022 at 5:26

Re: SolrJ 8.11.1 upgrade - Invalid version (expected 2, but 31) or the data in not in 'javabin' format

2022-01-26 Thread Jeremy Buckley - IQ-C
Yes, there was nothing relevant in the solr.log. Here is the full stack trace. 20:00:45,856 ERROR [gov.gsa.advantage.advsearch.solr.SearcherImpl] (default task-2) Error executing request: qt=/products/consolidated&timeAllowed=3&f.cat.facet .prefix=ADV&f.cat.facet.limit=50&q=(pencil)&fq=sas:(3

Re: SolrJ 8.11.1 upgrade - Invalid version (expected 2, but 31) or the data in not in 'javabin' format

2022-01-26 Thread Shawn Heisey
On 1/26/2022 6:06 PM, Jeremy Buckley - IQ-C wrote: Thanks. That's what I thought too, but the logs seem to be clean. Can you give us the *entire* error log? I am mostly interested in the "caused by" parts of the exception. The solr.log entries you shared appear to be requests made by the ad

Re: SolrJ 8.11.1 upgrade - Invalid version (expected 2, but 31) or the data in not in 'javabin' format

2022-01-26 Thread Jeremy Buckley - IQ-C
On Wed, Jan 26, 2022 at 6:35 PM Shawn Heisey wrote: > It is likely that the response is an error, not a valid response. > Errors are typically in html or text format, not javabin. > > If there was an error, the server's solr.log file should indicate what > the problem is. Can you share that file

Re: Solr custom file types

2022-01-26 Thread Mike Drob
I suspect the missing libraries are somehow related to https://github.com/Unidata/netcdf-java Mike On Wed, Jan 26, 2022 at 6:32 PM Shawn Heisey wrote: > On 1/26/2022 5:10 PM, Mike Domzalski wrote: > > Server ErrorCaused > by:java.lang.NoClassDefFoundError: ucar/nc2/NetcdfFile > > a

Re: Solr custom file types

2022-01-26 Thread Shawn Heisey
On 1/26/2022 5:10 PM, Mike Domzalski wrote: Server ErrorCaused by:java.lang.NoClassDefFoundError: ucar/nc2/NetcdfFile at org.apache.tika.parser.hdf.HDFParser.parse(HDFParser.java:88) at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:280) The extracting

Solr custom file types

2022-01-26 Thread Mike Domzalski
Hi all Basically, I am a Solr newbie and have had 0 experience with this as our Solr expert left the company. We are receiving a file from a client that is a proprietary file (.gnet). I don't have access to the application in which it was generated from. When uploading to Solr we receive the f

Re: SolrJ 8.11.1 upgrade - Invalid version (expected 2, but 31) or the data in not in 'javabin' format

2022-01-26 Thread Shawn Heisey
On 1/26/2022 4:22 PM, Jeremy Buckley - IQ-C wrote: java.lang.RuntimeException: Invalid version (expected 2, but 31) or the data in not in 'javabin' format It is likely that the response is an error, not a valid response. Errors are typically in html or text format, not javabin. If there was

SolrJ 8.11.1 upgrade - Invalid version (expected 2, but 31) or the data in not in 'javabin' format

2022-01-26 Thread Jeremy Buckley - IQ-C
I am in the process of upgrading my application from Solr 8.7.0 to Solr 8.11.1. Both the server and solr-solrj-8.11.1.jar have been updated to the same version. Solr servers are on RHEL 7. When I run my client app in JBoss 7 on Windows, all of the SolrJ calls fail with: java.lang.RuntimeException:

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread Walter Underwood
You can check the status of each Zookeeper node with the “ruok” command. This is one of the “four lettter words” admin commands. https://zookeeper.apache.org/doc/r3.4.8/zookeeperAdmin.html#sc_zkCommands This is how it works from a command line. $ echo ruok | nc zoo-shared-1.test.search.cheggnet.

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread Reej Nayagam
Thank you Shawn, I will try this way and see if it helps. *Thanks,* *Reej* On Wed, Jan 26, 2022 at 10:59 PM Shawn Heisey wrote: > On 1/26/22 06:53, Reej Nayagam wrote: > > The scenario is solr servers are up, but majority of the zk is down, > > so we need to tell the issue is with the zookeepe

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread Reej Nayagam
Thanks Matthew, got some idea now. Either this way or with Shawn's approach of passing zkconnection timeout will workout for me *Thanks,* *Reej* On Wed, Jan 26, 2022 at 10:37 PM matthew sporleder wrote: > Check this out: > curl 'localhost:8983/solr/admin/zookeeper/status' > > On Wed, Jan 26,

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread Shawn Heisey
On 1/26/22 06:53, Reej Nayagam wrote: The scenario is solr servers are up, but majority of the zk is down, so we need to tell the issue is with the zookeeper. I don’t find a way on how to identify the zookeeper status without waiting for the timeout to happen after 30 seconds. I think the issue

Re: Auto generated _root_ field in manual schema.xml

2022-01-26 Thread Eric Pugh
That’s an interesting point….The _root_ stuff has evolved over time and this is kind of an example of it! I think it does make sense that some of these special fields like _root_ have some smarts around the interactions with other types of field mappings. > On Jan 26, 2022, at 9:49 AM,

Re: Auto generated _root_ field in manual schema.xml

2022-01-26 Thread Shawn Heisey
On 1/26/22 07:24, Eric Pugh wrote: Shawn, should having a dynamic field called “*” trigger either a warning in the logs or maybe even be forbidden? Is there a use case for having “*”? While I think that it's a bad idea to have a dynamic field entry that matches everything, I don't want to l

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread matthew sporleder
Check this out: curl 'localhost:8983/solr/admin/zookeeper/status' On Wed, Jan 26, 2022 at 8:54 AM Reej Nayagam wrote: > > The scenario is solr servers are up, but majority of the zk is down, > so we need to tell the issue is with the zookeeper. I don’t find a way on > how to identify the zookeepe

Re: Auto generated _root_ field in manual schema.xml

2022-01-26 Thread Eric Pugh
Shawn, should having a dynamic field called “*” trigger either a warning in the logs or maybe even be forbidden? Is there a use case for having “*”? > On Jan 25, 2022, at 6:30 PM, Shawn Heisey wrote: > > On 1/25/2022 9:42 AM, LaFrance, Jason wrote: >> I can recreate the issue in the Solr

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread Reej Nayagam
The scenario is solr servers are up, but majority of the zk is down, so we need to tell the issue is with the zookeeper. I don’t find a way on how to identify the zookeeper status without waiting for the timeout to happen after 30 seconds. On Wed, 26 Jan 2022 at 9:39 PM, matthew sporleder wrote:

Re: Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread matthew sporleder
I don't understand your approach -- For checking solr health I would probably use the ping endpoint or a very fast query with a low timeout (q=*:*&timeAllowed=100&rows=0). IIRC zookeeper health (as seen by solr) is in the CLUSTERSTATUS admin api command? It's somewhere near there if not in CLUST

Zookeeper client Timeout - takes the default 30000 ms

2022-01-26 Thread Reej Nayagam
Hi All, I need to handle zk failure and so monitoring the zk ensemble, and if the majority of the zk fails we'll activate the HA to point to a DB search. So to check if each of the zk is alive , we are connecting as below, *zkClient = solrZkClient(zkaddress,1),* *return zkclient.getSolrZooke

SpellCheck - no suggestions if there are similar documents

2022-01-26 Thread Ludányi András
Hi All, I have been looking for the solution to the following problem for days. I'm using the Solr's SpellCheck component. The used version of Solr is 8.11.1. I have prepared a minimal example for demonstrate my issue: I have created a new core. The relevant part of this core's config is: