Re: Is there a way to shape a query response from SOLR similar to the way the Script Update Processor can transform an update payload/document?

2022-12-08 Thread Thomas Corthals
Hi Matthew Do you mean you want to relabel the field names in the reply? They can be aliased. https://solr.apache.org/guide/solr/latest/query-guide/common-query-parameters.html#field-name-aliases IIRC, there's no way to guarantee the order of the fields in the response. It's probably the order i

Duplicate docs with same unique id on update

2022-12-08 Thread Eduardo Gomez
Hi All, I'm in the process of porting our Solr 7.5 to 8.11.1. I'm using our legacy schema.xml with ClassicIndexSchemaFactory in solrconfig.xml. I have seen there have been some changes introduced to how child docs are updated ( https://solr.apache.org/guide/8_0/major-changes-in-solr-8.html#nested

Requests taking hours on solr cloud

2022-12-08 Thread Satya Nand
Hi, Greetings for the day, We are facing a strange problem in Solr cloud where a few requests are taking hours to complete. Some requests return with a 0 status code and some with a 500 status code. The recent request took more than 5 hours to complete with only a 9k results count. These querie

Re: Requests taking hours on solr cloud

2022-12-08 Thread Satya Nand
++ GC report https://gceasy.io/my-gc-report.jsp?p=c2hhcmVkLzIwMjIvMTIvOC9zb2xyX2djLmxvZy0tMTEtMzktMzE=&channel=WEB On Thu, Dec 8, 2022 at 4:57 PM Satya Nand wrote: > Hi, > > Greetings for the day, > > We are facing a strange problem in Solr cloud where a few requests are > taking hours to compl

Re: Requests taking hours on solr cloud

2022-12-08 Thread Mikhail Khludnev
Hi Satya. This instance mostly idling, at that time it were coordinating one request and awaits shard request to complete see https://fastthread.io/same-state-threads.jsp?state=non-daemon&dumpId=1#panel111 https://fastthread.io/same-state-threads.jsp?state=non-daemon&dumpId=1#panel118 that another

Re: Duplicate docs with same unique id on update

2022-12-08 Thread Shawn Heisey
On 12/8/22 02:43, Eduardo Gomez wrote: I have seen there have been some changes introduced to how child docs are updated ( https://solr.apache.org/guide/8_0/major-changes-in-solr-8.html#nested-documents). From the docs: *" ... an attempt to update a child document by providing a new document wi

Re: Duplicate docs with same unique id on update

2022-12-08 Thread Shawn Heisey
On 12/8/22 05:58, Shawn Heisey wrote: So you can't just update a child document, you have to update all the children and all the parents at the same time, so the new documents are all in the same segment. That's a little unclear and sounds like a draconian requirement. :)  I meant that all ch

Re: Duplicate docs with same unique id on update

2022-12-08 Thread Mikhail Khludnev
Right, Shawn. That's how it works https://lucene.apache.org/core/7_4_0/core/org/apache/lucene/index/IndexWriter.html#updateDocuments-org.apache.lucene.index.Term-java.lang.Iterable- And it's really fast in query time. On Thu, Dec 8, 2022 at 4:06 PM Shawn Heisey wrote: > On 12/8/22 05:58, Shawn H

Re: Is there a way to shape a query response from SOLR similar to the way the Script Update Processor can transform an update payload/document?

2022-12-08 Thread Eric Pugh
I’ve long wished that Solr had a query pipeline similar to it’s update pipeline. It’s a common feature of other search engines, and it gives a natural home for things like this to occur. Today, I think your best route would be to make your own response writer…. Solr is Super pluggable that wa

Re: Question regarding Replica placement

2022-12-08 Thread Aurélien MAZOYER
Hi community, I'll answer myself in case somebody would share my concern. When I do *not *run all the nodes on the same host (here I am using docker instead), I eventually get the replica placement that I was expecting: [image: image.png] On my first try, I guess the AffinityPlacementFactory was

Re: Duplicate docs with same unique id on update

2022-12-08 Thread Eduardo Gomez
> At first it wasn't clear to me what the problem you're having actually > is. Then I glanced back at the message subject ... it is the only place > you mention it. Sorry Shawn, you are right, I didn't explain very clearly. So basically, in Solr 8.11.1, I can see that updating an existing docume

Re: Duplicate docs with same unique id on update

2022-12-08 Thread David Hastings
Interesting, this is kind of bizarre behavior. is: defaulted in the schema for 8.x? On Thu, Dec 8, 2022 at 9:31 AM Eduardo Gomez wrote: > > At first it wasn't clear to me what the problem you're having actually > > is. Then I glanced back at the message subject ... it is the only place > > you

Re: Duplicate docs with same unique id on update

2022-12-08 Thread Eduardo Gomez
The default managed_schema in solr 8.11 says: On Thu, Dec 8, 2022 at 2:40 PM David Hastings wrote: > Interesting, this is kind of bizarre behavior. > is: > > defaulted in the schema for 8.x? > > On Thu, Dec 8, 2022 at 9:31 AM Eduardo Gomez > wrote: > > > > At first

Re: Near Real Time not working as expected

2022-12-08 Thread Matias Laino
Hi Tomas! Yes! I saw that message, my original setting for auto warm searchers was 2, I increased it to 6 and I was still seeing the message, now it's at to 16 and I don't see that ( I went from 6 to 16), but the issue still persists. I havent seen post commit events, where can I look for that ?

Re: group=true solrcloud 8.11

2022-12-08 Thread James Greene
Yes, same exception when attempting to use group.main/query. Error from server at null: java.lang.NullPointerException\n\tat org.apache.solr.schema.FieldType.toExternal(FieldType.java:361) On Wed, Dec 7, 2022 at 5:32 PM Mike Drob wrote: > Have you tried the group.main and group.query options

Re: Is there a way to shape a query response from SOLR similar to the way the Script Update Processor can transform an update payload/document?

2022-12-08 Thread Matthew Castrigno
Thanks Eric, I will research what it takes to create my own response writer. I was trying to understand this feature: https://solr.apache.org/guide/solr/latest/query-guide/response-writers.html#json-wrf When using this, does the script get run by SOLR? Thanks. Fro

Re: Is there a way to shape a query response from SOLR similar to the way the Script Update Processor can transform an update payload/document?

2022-12-08 Thread Matthew Castrigno
Hi Thomas, Thank you for this suggestion, it will help make some changes that I need to the response. Thanks. From: Eric Pugh Sent: Thursday, December 8, 2022 6:12 AM To: users@solr.apache.org Subject: Re: Is there a way to shape a query response from SOLR simi

Re: Is there a way to shape a query response from SOLR similar to the way the Script Update Processor can transform an update payload/document?

2022-12-08 Thread Eric Pugh
Json.wrf is actually how you implement JSONP. (https://en.wikipedia.org/wiki/JSONP) It’s a slightly tacky way to avoid implementing CORS…. It lets you load a solr response as if it was a javascript file so the browser will load it.. For example, this is how Quepid, a browser based app, talk

Re: Is there a way to shape a query response from SOLR similar to the way the Script Update Processor can transform an update payload/document?

2022-12-08 Thread Chris Hostetter
: Thank you for this suggestion, it will help make some changes that I need to the response. If you are not comfortable with java, but you are comfortable with XSLT, the XSLT ResponseWriter is the easiest way to transform solr's response in any way you want "server side" w/o needing to compil

Re: Near Real Time not working as expected

2022-12-08 Thread Tomás Fernández Löbbe
If you see this warning, then the issue is that your warming is taking too long. Consider: Reducing/Removing auto-warm[1]. You may also have static warming with query listeners[2]? If you have INFO logging enabled in SolrCore it should be printing something like: "Registered new searcher autowarm

Tokyo Lucene/Solr Meetup - 9 December 2022

2022-12-08 Thread Alessandro Benedetti
Hi guys, sorry for the spam but I wanted to let you know that tonight in Tokyo there's going to be the first Lucene/Solr in-person free meetup after a long time! https://lnkd.in/eDCXjdiX I am visiting Japan so it would be a pleasure to meet any member of the community that's around! This messag

Re: Requests taking hours on solr cloud

2022-12-08 Thread Satya Nand
Hi Mikhail, Thanks for the response. This instance mostly idling, at that time it was coordinating one request > and awaits shard's request to complete see The shard is waiting on itself. 10.128.193.11 is the private IP of the same node where I have taken this stack trace. in the below request,