Solr memory issue- Solr version 8.11.2

2025-03-21 Thread Anuj Bhargava
Got the following message from my server people. Need help with the solr memory issue. Solr version 8.11.2 *Solr is using the next highest CPU and is the highest memory user on the server.Solr is using more than 3 times the memory of MySQL.Solr and MySQL are the highest memory users by a wid

Out of memory Error - Solr version 8.11.2

2024-04-24 Thread Anuj Bhargava
Out of memory Error - Solr version 8.11.2 *java -server -Xms32g -Xmx32g -XX:+UseG1GC -XX:+PerfDisableSharedMem -XX:+ParallelRefProcEnabled -XX:MaxGCPauseMillis=250 -XX:+UseLargePages -XX:+AlwaysPreTouch -XX:+ExplicitGCInvokesConcurrent -Xlog:gc*:file=/var/solr/logs/solr_gc.log:time,uptime:filecoun

Re: Dataimport - Optimize (Solr Version 8.11.2)

2024-02-01 Thread Anuj Bhargava
Thanks Shawn, This works - http://localhost:8983/solr/XXX/update?optimize=true&maxSegments=1 Regards, Anuj On Thu, 1 Feb 2024 at 21:04, Shawn Heisey wrote: > On 2/1/24 08:09, Shawn Heisey wrote: > > To verify that what I say is true, manually kick an optimize off when > > you're NOT doing an

Dataimport - Optimize (Solr Version 8.11.2)

2024-01-31 Thread Anuj Bhargava
Why does *Optimize* in the *dataimport* section of solr Admin UI duplicate the records. A new copy is created of each record. "*id*" and "_*version*_" are different, everything else is the exact copy. Each time I run Optimize, the initial number of records get added again. Initial number - *Num Doc

Limiting Query Result - Solr Version 8.11.2

2024-01-30 Thread Anuj Bhargava
Need to show limited rows, even if someone specifies more rows. http://xxx.xx.xx.xx:8983/solr/regions/select?q=*:*&start=0&*rows=100* In the above a person can specify any number of rows and can download all the records. Anyway to restrict the search result to say 50 Regards, Anuj

Solr-8.11.2 Import of Large Data Issue

2024-01-11 Thread Anuj Bhargava
I am using solr-8.11.2. My MySql table has 13001335 which is around 259.9 GB. solr.in.sh has the following entry - SOLR_JAVA_MEM="-Xms15g -Xmx15g" SOLR_OPTS="$SOLR_OPTS -Dsolr.disable.shardsWhitelist=true" Whenever I import the MySql stops after sometime and then restarts. Not all record

Re: Solr connection refused error

2023-12-13 Thread Anuj Bhargava
023 at 10:56, Deepak Goel wrote: > On Thu, 14 Dec 2023, 10:11 Anuj Bhargava, wrote: > > > There are some files in /var/solr/logs. For example - > > solr_oom_killer-8983-2023-12-14_05_30_42.log > > > > and this contains - > > > > Running OOM killer scrip

Re: Solr connection refused error

2023-12-13 Thread Anuj Bhargava
There are some files in /var/solr/logs. For example - solr_oom_killer-8983-2023-12-14_05_30_42.log and this contains - Running OOM killer script for process 2861377 for Solr on port 8983 Killed process 2861377 On Wed, 13 Dec 2023 at 17:36, Anuj Bhargava wrote: > Last Modified:about 7 ho

Solr Indexing cronjob

2023-12-13 Thread Anuj Bhargava
Which of the following is correct or is there a better way? curl -q http://user:passw...@xxx.xxx.xx.xxx:8983/solr/korea/dataimport?command=full-import&clean=true&commit=true >/dev/null 2>&1 curl -qsS -u user:password " http://xxx.xxx.xx.xxx:8983/solr/korea/dataimport?command=full-import&clean=tr

Re: Solr connection refused error

2023-12-13 Thread Anuj Bhargava
Impl:org.apache.solr.core.NRTCachingDirectoryFactory On Wed, 13 Dec 2023 at 16:31, Deepak Goel wrote: > On Wed, Dec 13, 2023 at 1:51 PM Anuj Bhargava wrote: > > > 12/13/2023, 11:04:12 AM ERROR false x:gt128_dga UpdateLog > > java.io.EOFException > > > > You are trying t

Re: Solr connection refused error

2023-12-13 Thread Anuj Bhargava
: > On Wed, Dec 13, 2023 at 1:35 PM Anuj Bhargava wrote: > > > Noticed that whenever large amount of data is being indexed it stops. > > > > > What is the error it spits out? > > > > Configuration is - > > > > > driver

Re: Solr connection refused error

2023-12-13 Thread Anuj Bhargava
Noticed that whenever large amount of data is being indexed it stops. Configuration is - *My jetty.xml file is* - https <$

Re: Solr connection refused error

2023-12-12 Thread Anuj Bhargava
The solr stops too often and I have to restart it. Is there a script which checks if solr is running and if not it starts automatically. Regards, Anuj On Tue, 12 Dec 2023 at 23:29, Shawn Heisey wrote: > On 12/11/23 21:25, Anuj Bhargava wrote: > > http://xxx.xxx.xx.xxx:8983/solr/#/

Solr connection refused error

2023-12-11 Thread Anuj Bhargava
http://xxx.xxx.xx.xxx:8983/solr/#/ I often get the following error - This site can’t be reached xxx.xxx.xx.xxx refused to connect. Try: Checking the connection Checking the proxy and the firewall ERR_CONNECTION_REFUSED 8983 port is open

Re: Solr 8.11.2 Admin Panel

2023-10-18 Thread Anuj Bhargava
Solved. The server provider had blocked port 8983. Regards, Anuj On Wed, 18 Oct 2023 at 19:15, Shawn Heisey wrote: > On 10/18/23 06:25, Anuj Bhargava wrote: > > Hi Jan, > > > > Using the following to access - http://xxx.xxx.xx.xx:8983/solr/#/ > > > > Getting

Re: Solr 8.11.2 Admin Panel

2023-10-18 Thread Anuj Bhargava
/var/solr/logs/solr.log) ? > What do you see in your browser when attempting to open Admin UI? > I would use Java 17 if I were you but looks like Solr is up.. > > Jan > > > 18. okt. 2023 kl. 11:02 skrev Anuj Bhargava : > > > > Admin Panel is not opening > > > &g

Solr 8.11.2 Admin Panel

2023-10-18 Thread Anuj Bhargava
Admin Panel is not opening [root@ded659 default]# */etc/init.d/solr status* Found 1 Solr nodes: Solr process 598380 running on port 8983 { "solr_home":"/var/solr/data", "version":"8.11.2 17dee71932c683e345508113523e764c3e4c80fa - mdrob - 2022-06-13 11:27:54", "startTime":"2023-10-18T08:43:00

Solr and MySQL DB

2023-10-16 Thread Anuj Bhargava
Which was the last Apache Solr version that supported Data Import Handler for importing data from MySql Table? In the latest version how do we import data from MySql Table. Please provide a solution step by step that a layman can implement. Regards, Anuj

Re: Importing Data from MySql

2023-01-13 Thread Anuj Bhargava
emoved in Solr 9.x. You can either build your own importer, or use > the, now 3rd party, DIH [1] that is available as a package. > > Regards, > Markus > > [1] https://github.com/rohitbemax/dataimporthandler > > Op vr 13 jan. 2023 om 14:47 schreef Anuj Bhargava : > > >

Importing Data from MySql

2023-01-13 Thread Anuj Bhargava
How do I import data from MySql database in Solr 9.1 Earlier I was using DIH in version 8.6.2 Regards, Anuj

Re: Uninstall Solr 9.1

2023-01-13 Thread Anuj Bhargava
Thanks. Got Solr 9.1 working Regards, Anuj On Fri, 13 Jan 2023 at 19:32, Shawn Heisey wrote: > On 1/13/23 06:44, Anuj Bhargava wrote: > > Installed java - sudo dnf install java-11-openjdk > > > > *$java -versionopenjdk version "11.0.17" 2022-10-18 LTSOpenJDK R

Re: Uninstall Solr 9.1

2023-01-13 Thread Anuj Bhargava
[\]Started Solr server on port 8983 (pid=11859). Happy searching!* On Fri, 13 Jan 2023 at 18:37, Shawn Heisey wrote: > On 1/13/23 01:05, Anuj Bhargava wrote: > > On Centos > > > > wget https://dlcdn.apache.org/solr/solr/9.1.0/solr-9.1.0.tgz > > I accidentally replied d

Uninstall Solr 9.1

2023-01-12 Thread Anuj Bhargava
How to uninstall solr 9.1? Regards, Anuj

Re: Solr 9.1 Admin page not opening

2023-01-12 Thread Anuj Bhargava
Same error. Tried in an incognito window also. On Fri, 13 Jan 2023 at 11:22, Satya Nand wrote: > Hi, > > Try force reloading the page, ctrl+f5. > > It happened when we upgraded the solr. > > On Fri, Jan 13, 2023 at 9:36 AM Anuj Bhargava wrote: > > > Already ad

Re: Solr 9.1 Admin page not opening

2023-01-12 Thread Anuj Bhargava
var/solr/data"LOG4J_PROPS="/var/solr/log4j2.xml"SOLR_LOGS_DIR="/var/solr/logs"SOLR_PORT="8983"SOLR_TIMEZONE="UTC"SOLR_JETTY_HOST="0.0.0.0"* On Fri, 13 Jan 2023 at 07:07, Shawn Heisey wrote: > On 1/12/23 05:48, Anuj Bhargava wrote: &g

Re: Solr 9.1 Admin page not opening

2023-01-12 Thread Anuj Bhargava
Also ran the following- [root@76 etc]# sudo ss -tulpn | grep 8983 tcpLISTEN 0 50 [::]:8983 [::]:* users:(("java",pid=17280,fd=134)) I think [::]:8983 should be *:8983 How to get it? On Thu, 12 Jan 2023 at 18:13, Anuj Bhargava wrote: &g

Re: Solr 9.1 Admin page not opening

2023-01-12 Thread Anuj Bhargava
x.xxx.xxx.76, and if it can, > if you can reach port 8983. > > One possible reason could be that you have not changed the SOLR_JETTY_HOST > variable for Solr. See: > > > https://solr.apache.org/guide/solr/latest/deployment-guide/taking-solr-to-production.html#security-consi

Re: Solr 9.1 Admin page not opening

2023-01-12 Thread Anuj Bhargava
roduction.html#security-considerations > > Jan > > > 12. jan. 2023 kl. 08:53 skrev Anuj Bhargava : > > > > Sorry using the following > > > > http://xxx.xxx.xxx.76:8983/solr/admin > > http://xxx.xxx.xxx.76:8983/solr/ > > > > and not as mentioned earl

Re: Solr 9.1 Admin page not opening

2023-01-11 Thread Anuj Bhargava
Sorry using the following http://xxx.xxx.xxx.76:8983/solr/admin http://xxx.xxx.xxx.76:8983/solr/ and not as mentioned earlier - http://xxx.xxx.xxx.76:8293/solr/admin http://xxx.xxx.xxx.76:8293/solr/ On Thu, 12 Jan 2023 at 13:16, Anuj Bhargava wrote: > Solr 9.1 has been installed. And java

Solr 9.1 Admin page not opening

2023-01-11 Thread Anuj Bhargava
Solr 9.1 has been installed. And java is running [root@76 ~]# /etc/init.d/solr status Found 1 Solr nodes: Solr process 2858 running on port 8983 [root@76 ~]# java -version openjdk version "11.0.17" 2022-10-18 LTS OpenJDK Runtime Environment (Red_Hat-11.0.17.0.8-2.el7_9) (build 11.0.17+8-LTS) Open

Re: Solr 8.6.2 - download full data

2022-02-26 Thread Anuj Bhargava
Thanks Shawn, it worked. At present I am uploading the data from my MySql table to solr. Since the Mysql table has got corrupted can I directly load data from solr to my MySql table. Regards, Anuj On Sat, 26 Feb 2022 at 13:43, Shawn Heisey wrote: > On 2/25/2022 11:36 PM, Anuj Bhargava wr

Re: Solr 8.6.2 - download full data

2022-02-25 Thread Anuj Bhargava
01-01T18:30:00Z", "cpv":["29124000"], "_version_":1693668431515090947}, { "country":["PT"], "date_c":"2018-03-14T18:30:00Z", On Fri, 25 Feb 2022 at 21:46, Andy Lester wrote: > &

Solr 8.6.2 - download full data

2022-02-25 Thread Anuj Bhargava
I need to download the data in solr on my laptop. The data has around 950 records The following command shows the result in the browser. As the file is very large I want to download it. I tried with 1 records. Need to download all http://xx.xxx.xxx.xxx:8983/solr/data_2019/select?q=*%3A*&r

Re: Solr 8.6.2 - single query on 2 cores ?

2021-05-02 Thread Anuj Bhargava
> > Can you run this very simple expression: echo("Hello World") > > > > Sent from Mail for Windows 10 > > From: Anuj Bhargava > Sent: 02 May 2021 14:21 > To: users@solr.apache.org > Subject: Re: Solr 8.6.2 - single query on 2 cores ? > > Hi, >

Re: Solr 8.6.2 - single query on 2 cores ?

2021-05-02 Thread Anuj Bhargava
e, q="posting_id:41009261", qt="/select", fl="posting_id", > sort="posting_id asc"),on="posting_id") > > Also don’t forget to urlencode special chars if your http client is not > doing it automatically for you. > > Sent from Mail

Re: Solr 8.6.2 - single query on 2 cores ?

2021-05-01 Thread Anuj Bhargava
arch(live, q="posting_id:41009261", qt="/select", fl="posting_id", sort="posting_id asc"),on="posting_id"* *Result -5* *{* * "result-set":{* *"docs":[{* *"EXCEPTION":"'leftOuterJoin(search(arch

Solr 8.6.2 - single query on 2 cores ?

2021-04-30 Thread Anuj Bhargava
I have 2 cores '*live*' and '*archive*' with exactly the same fields. I want to query on a unique id - '*posting_id*'. First it should check *live* and if not found then in *archive* and show the results. The following is doing a search on *live* and not on *archive* http://xxx:8983/solr/live/sel

Re: Solr 8.6 Indexing Issue

2021-04-30 Thread Anuj Bhargava
Just added the following line and it started indexing again. *useSSL="false"* On Thu, 29 Apr 2021 at 21:40, Charlie Hull wrote: > I meant can you run it on the database directly, without Solr, and what > happens? > > Best > > Charlie > > On 29/

Re: Solr 8.6 Indexing Issue

2021-04-29 Thread Anuj Bhargava
Without solr, directly is also working. Only it is not indexing any longer On Thu, 29 Apr 2021 at 21:40, Charlie Hull wrote: > I meant can you run it on the database directly, without Solr, and what > happens? > > Best > > Charlie > > On 29/04/2021 14

Re: Solr 8.6 Indexing Issue

2021-04-29 Thread Anuj Bhargava
It is not fetching Requests: 1 , Fetched: 0 , Skipped: 0 , Processed: 0 On Thu, 29 Apr 2021 at 18:35, Anuj Bhargava wrote: > Saw the following in the logs - > > *2021-04-29 11:19:58.330 INFO (main) [ ] o.e.j.s.Server > jetty-9.4.27.v20200227; built: 2020-02-27T18:37:

Re: Solr 8.6 Indexing Issue

2021-04-29 Thread Anuj Bhargava
ocs":[ { "country":["AU"], "date_c":"2019-03-14T18:30:00Z", > > On Thu, 29 Apr 2021 at 17:18, Charlie Hull < > ch...@opensourceconnections.com> wrote: > >> What happens if you run exactly that SELECT query on your source database? >

Re: Solr 8.6 Indexing Issue

2021-04-29 Thread Anuj Bhargava
"country":["AU"], "date_c":"2019-03-14T18:30:00Z", On Thu, 29 Apr 2021 at 17:18, Charlie Hull wrote: > What happens if you run exactly that SELECT query on your source database? > > Charlie > > On 29/04/2021 12:08, Anuj Bhargava wrote

Solr 8.6 Indexing Issue

2021-04-29 Thread Anuj Bhargava
Ever since installing 8.6 a couple of months ago, the indexing was working fine. All of a sudden getting the following error - 4/29/2021, 12:01:59 PM ERROR false DocBuilder Exception while processing: hotels document : SolrInputDocument(fields: []):org.apache.solr.handler.dataimport.DataImportHand

Importing Data - Solr 8.0

2021-03-06 Thread Anuj Bhargava
I am having some problem importing data via dataimporter. I have a database (data_archive) containing records for the last 9 years. I am unable to import all the data via dataimporter. The solr stops. However, I can import data for the last 12 months and it takes around 20 minutes. How can I add al