Re: The logging of Solr queries

2022-09-23 Thread Markus Jelsma
No, Solr can't do that unless you patch it to only log top-level queries. As said, sharded queries are easy to filter, look for isShard=true parameters to distinguish them. They usually also contain more parameters than the original top-level query. Op vr 23 sep. 2022 om 10:42 schreef Anjali Ma

Re: The logging of Solr queries

2022-09-23 Thread Anjali Maurya
So, we are searching for any solution to log only top level queries. Is there any way at logging level to log only top level query? On Fri, Sep 23, 2022 at 2:09 PM Anjali Maurya wrote: > We have a way to distinguish which query is a top level query. > We are using an 8-node cluster of solr clou

Re: The logging of Solr queries

2022-09-23 Thread Anjali Maurya
We have a way to distinguish which query is a top level query. We are using an 8-node cluster of solr cloud, when any request is hit then min 9 and max 17 queries are being logged. It is consuming huge disk space. When we used to use solr standalone , log files used to be generated of ~30GB per day

Re: The logging of Solr queries

2022-09-22 Thread Walter Underwood
I’ve always used the HTTP (access) log. In that, queries to shards are POST requests, so if the external requests are all GET, they are easy to sort out. wunder Walter Underwood https://observer.wunderwood.org/ > On Sep 22, 2022, at 7:02 PM, Shawn Heisey wrote: > > On 9/22/22 09:17, Anjali

Re: The logging of Solr queries

2022-09-22 Thread Shawn Heisey
On 9/22/22 09:17, Anjali Maurya wrote: Thanks Shawn for the suggestion. Can we make any change for the logging of only top level query not the shard level? I just tried doing a query on my tiny 9.1.0-SNAPSHOT SolrCloud install that consists of one node, one shard, and one core, with ZK embedde

Re: The logging of Solr queries

2022-09-22 Thread Anjali Maurya
> > If you have left the logging at the default level of INFO, then every > query should be logged, both top level and shard. If you turned down the logging level to WARN or ERROR, then no queries > will be logged, because they are logged at INFO. Logging in 6.5 used a destination of log4j 1.2,

Re: The logging of Solr queries

2022-09-22 Thread Shawn Heisey
On 9/22/22 03:29, Anjali Maurya wrote: We have moved from Solr 6.5 to Solr cloud 8.10 . Due to distributed search, multiple queries (complete query and sub-query) are being generated and get logged. So, I want to know, is there any way to control the logging of sub-query or how can we make chang