Hello
>From the page:
https://lucene.apache.org/core/2_9_4/demo.html#:~:text=First%2C%20you%20should%20download%20the,when%20you%20extracted%20the%20archive.
I am trying to run the following command "java
org.apache.lucene.demo.IndexFiles {full-path-to-lucene}/src":
*java -cp
/home/kali/lucene/l
ld go away.
>
> I do see an IntField class in the contrib section of Solr code, but it
> doesn't seem to be a "FieldType" as such. So in all likelihood this seems
> to be a mistake in the schema. Was this schema created from scratch ?
>
> -Rahul
>
> On Wed, Jul
Hello
I am getting the following error when I create a new core in Solr-Windows.
Any help would be appreciated, thank you.
- *new_core:*
org.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
Could not load conf for core new_core: Can't load schema
D:\Deepak\Solr\sol
*Answer from Copilot:*
Ah, the intricate dance of Solr shards and their cosmic collisions! Let’s
unravel this like a digital detective, shall we? 🕵️♂️
When it comes to Solr and its distributed architecture, handling duplicate
documents across shards can be as tricky as juggling flaming torches
Hello,
The attachments did not come through (of top and iotop). Also please post
GC configurations and the results of GC pauses?
Thanks.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
LinkedIn: www.linkedi
Can you please tell me about the hardware details (Server type, CPU speed
and type, Disk Speed and type) and GC configuration? Also please post
results of top, iotop if you can?
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
d
On Tue, Feb 13, 2024 at 5:48 AM Arun Sudhir wrote:
> Hello,
> We use solr for our search needs and we have documents indexed on a core in
> multiple machines. Over time, the index on some machines has grown from 30
> GB to 60 GB now to a giant 133 GB. While others are still hovering around
> 80GB
ofile your application (possibly with a Memory-Debugger)
>
> In which file should I define SOLR_HEAP and what should be the ideal value.
> My server has 128GB Ram and 2TB SSD
>
> Regards,
>
> Anuj
>
> On Thu, 14 Dec 2023 at 10:56, Deepak Goel wrote:
>
> > O
t; Version:3789
> > Segment Count:25
> > Current:
> >
> > Instance
> > CWD:/opt/solr-8.11.2/server
> > Instance:/var/solr/data/gt128_dga
> > Data:/var/solr/data/gt128_dga/data
> > Index:/var/solr/data/gt128_dga/data/index
> > Impl:org.apache.solr.co
4:13 AM WARN false x:gt128_dga UpdateLog Log replay
> finished. recoveryInfo=RecoveryInfo{adds=82717 deletes=0 deleteByQuery=0
> errors=0 positionOfStart=0}
>
> On Wed, 13 Dec 2023 at 13:38, Deepak Goel wrote:
>
> > On Wed, Dec 13, 2023 at 1:35 PM Anuj Bhargava
> wrote:
&
On Wed, Dec 13, 2023 at 1:35 PM Anuj Bhargava wrote:
> Noticed that whenever large amount of data is being indexed it stops.
>
>
What is the error it spits out?
> Configuration is -
>
> driver="com.mysql.jdbc.Driver"
> batchSize="-1"
> autoReconnect="true"
>
On Wed, Dec 13, 2023 at 11:03 AM Anuj Bhargava wrote:
> The solr stops too often and I have to restart it. Is there a script which
> checks if solr is running and if not it starts automatically.
>
You need to find why Solr is stopping too often. Restarting it is not a
graceful option.
>
> Reg
On Tue, Dec 12, 2023 at 9:56 AM Anuj Bhargava wrote:
> http://xxx.xxx.xx.xxx:8983/solr/#/
>
> I often get the following error -
>
> This site can’t be reached xxx.xxx.xx.xxx refused to connect.
> Try:
>
> Checking the connection
> Checking the proxy and the firewall
> ERR_CONNECTION_REFUSED
>
>
T
How long are the cpu spikes?
On Thu, 12 Oct 2023, 16:47 Sergio García Maroto, wrote:
> Hi everyone,
>
> I have at the moment a SolrCloud cluster with 3 servers and few different
> collections with all of them replicated to the 3 servers without sharding.
> I am using streaming expressions retrie
What are the kind of queries you have? Are they the same 80% of the time?
If yes, they will hit a few nodes all the time.
On Sat, 30 Sept 2023, 15:07 Vincenzo D'Amore, wrote:
> Hi Rajani,
>
> how many documents do you have in your collection?
> The nodes that consistently display high latency, d
On Thu, Jul 13, 2023 at 1:41 AM Matthew Roth wrote:
> Hi Group,
>
> I am trying to size and create my ec2 cluster. My index size across all
> cores is approximately 25gb. I have experimented with configurations using
> as little as 512M and as high as 32gb. My problem is that when I keep all
> th
Ron,
please post actual figures:
1. Cpu, mem, disk, network utilisation
2. Response times
3. Load
4. Hardware config of server
5. Software config of server
On Thu, 25 May 2023, 18:51 Joel Bernstein, wrote:
> One thing to understand about the topLevelDv approach is you'll need to
> warm both s
>
>
>
>
>
> On Sun, Mar 26, 2023 at 3:07 PM Vivaldi
> wrote:
>
> > Are you using tlog replicas? Is that node the leader doing a lot of
> > indexing?
> >
> > > On 25 Mar 2023, at 16:52, Deepak Goel wrote:
> > >
> > > It is quite po
t 3:41 PM HariBabu kuruva >
> wrote:
>
> > It's the solr process consuming the 95% CPU. I want to know how to
> > troubleshoot this from the solr end.
> >
> > On Fri, Mar 24, 2023 at 5:03 PM Deepak Goel wrote:
> >
> > > can you check which process is
can you check which process is eating up the CPU using top command
On Fri, 24 Mar 2023, 15:54 HariBabu kuruva,
wrote:
> Hi All,
>
> We have 4 solr nodes, only one of the nodes is consuming almost High CPU
> from yesterday. We don't see any errors in the logs. Restart dint resolve
> the issue. Co
The max heap could be the max heap used by the process uptill now. And not
the max value you have set. I would suggest you increase the load by at
least 20 times to see the max heap to go to 32 gb.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi
Can you try 'Network Load Balancer" in aws?
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
Make In
What would the iops look like?
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
Make In India : http:
There is something from Google:
https://stackoverflow.com/questions/67207332/solr-not-backing-up-core
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.
Can you please also post the iotop? You had mentioned you were seeing some
writes io.
On Wed, 21 Sep 2022, 20:01 Derek C, wrote:
> Thanks Deepak,
>
> I'm going to do more testing and check my queries more carefully (I dumped
> a pile of different queries - all different
> searches and I made JMe
h matches
> me not seeing the disk reads in iotop.
>
> So that made me think the problem isn't around a disk I/O bottleneck.
>
> Derek
>
> On Wed, Sep 21, 2022 at 2:27 PM Deepak Goel wrote:
>
> > what is the iops allocated to your aws instance?
> >
> &g
what is the iops allocated to your aws instance?
On Wed, 21 Sep 2022, 17:36 Derek C, wrote:
> Hi all,
>
> I'm trying to identify a SOLR query performance issue (or rather how to
> size [AWS EC2] hardware to support many users).
>
> Right now I'm testing on a single SOLR node (with distrib=false
Are the response times the same for the 2 machines? Or is Solr8 faster than
Solr6?
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deic
Can't see the error.
On Tue, 9 Aug 2022, 18:22 Naresh Lunavath,
wrote:
> Hello Team,
>
> Recently, we have upgraded solr from 7.7 to 8.9. But are facing collection
> backup. please refer to below error and help on the same.
>
> *Note*: We are running three solr instances.
>
> *NFS Path*: /solr-b
On Thu, Jul 7, 2022 at 3:31 AM Christopher Schultz <
ch...@christopherschultz.net> wrote:
> Deepak,
>
> On 7/5/22 09:30, Deepak Goel wrote:
> > Do you mind telling us which java version are you using?
>
> It doesn't matter. Xms == Xmx is always a good idea for
On Jul 5, 2022, at 7:52 AM, Ritvik Sharma wrote:
> >
> > Just Add java memory parameters in solr config which should not be more
> > than 75% of total RAM. and use G1GC.
> >
> >
> >> On Tue, 5 Jul 2022 at 4:59 PM, Deepak Goel wrote:
> >>
> >&
or hosting is necessary, you run the risk of losing the people
> that make your search engine work (even if they stay they could also be
> doing something more useful to your business).
> >
> > Charlie
> >
> >> On 05/07/2022 10:49, Deepak Goel wrote:
> >>
burn engineering hours
> trying to optimise performance to avoid spending (often much less) money
> on sufficient hardware to do the job. I've seen this happen many times,
> sadly.
>
> Charlie
>
> On 05/07/2022 10:33, Deepak Goel wrote:
> > Not a good software engineering
Not a good software engineering practice to beef up the hardware blindly.
Of Course when you have tuned the software to a point where you can't tune
anymore, you can then turn your eyes to hardware.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi
I wonder if this would be helpful:
https://solr.apache.org/guide/6_6/indexconfig-in-solrconfig.html
https://solr.apache.org/guide/6_6/jvm-settings.html
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebo
Is the iops the same on both machines?
On Thu, 2 Jun 2022, 22:02 Dave, wrote:
> What are you doing to warm up the new server? Need to get that index into
> memory with roughly the same queries you have on the other machine, for a
> bit.
>
> > On Jun 2, 2022, at 11:32 AM, Chang Wang wrote:
> >
>
all AJPs are
> blocked waiting for Solr-resonses 😉
>
> -----Ursprüngliche Nachricht-
> Von: Deepak Goel
> Gesendet: Montag, 30. Mai 2022 13:16
> An: users@solr.apache.org
> Betreff: Re: SolrJ connection handling, best practice(s)?
>
> Could you please share your
Could you please share your Tomcat web server configuration? Are the JVM
parameters good enough?
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedi
eciate any input :)
>
> Cheers,
> Henrik
>
> On Mon, May 16, 2022 at 10:41 AM Deepak Goel wrote:
>
>> Looks like *MultiplexConnectionPool *is getting maxed out.
>>
>> Could you please tell us the server configuration of dev and prod? Looks
>> like the dev env
Looks like *MultiplexConnectionPool *is getting maxed out.
Could you please tell us the server configuration of dev and prod? Looks
like the dev environment is getting maxed out.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
My guess is (please note it is not a benchmark): you would need a lot of
tuning to make Solr use 32 cpu cores per node. After 4 cpu cores, you would
have to start tuning Solr, JVM, your app (requirement), IOP'S.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- M
mpty completely removes the post-replication performance problem we
> >> were
> >> >> seeing.
> >> >>
> >> >> So now my question becomes "Why is boosting taking so much longer for
> >> the
> >> >> upgrade?"
> &g
There could be some testing and cooling happening post-replication. will
have to dig a bit more into the code.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedI
That's a good one. I will have to check the post-replication code of Solr
to answer your question (I can give it a shot on the weekend if I get the
time, sorry for sounding snobbish)
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 128
Hey
It might be possible *allText* does not consider them *()* as text. You
might have to try something else (possibly String)
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.c
Hello
I think you need to use "org.hsqldb.jdbc.jdbcDriver" instead of "
org.hsqldb.jdbcDriver".
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedi
vice,
> replayed on our test instances. They're purely read-only, so there should
> be no contention in terms of writing updates - we update solr via a
> completely separate mechanism.
>
> On Mon, 18 Oct 2021 at 17:30, Deepak Goel wrote:
>
> > One thing concerns me is
so many more requests than 8.3.1 unless
> we fall back to the "threads aren't terminstaing when they should"
> possibility. I haven't found a way to set the threshold for the timed
> threads, so if there is a way I'd be happy to try it?
>
> Thanks
>
> Dom
the very least 1Mb (or so it says
> here
> <
> https://github.com/openjdk/jdk11u/blob/master/src/hotspot/os_cpu/linux_x86/globals_linux_x86.hpp#L34
> >
> )
>
> Maybe removing that parameter or setting it to 1024Kb may change your
> results
>
> On Wed, Oct 13, 202
clipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882)
> ~[jetty-util-9.4.41.v20210516.jar:9.4.41.v20210516]
> at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036)
> ~[jetty-util-9.4.41.v20210516.jar:9.4.41.v20210516]
>
trying to create ever-more new
> ones rather than re-use old ones, it seems there must be a bug
>
> On Wed, 13 Oct 2021 at 15:03, Deepak Goel wrote:
>
> > We will have to check the solr logic. Threads waiting might get reused in
> > the future, so might be good for all you
upload: ./890_tests_results.bin to
> s3://adzuna-files-stage/test_framework/solr/tests/2021-10-13:12:28:03
> Requests [total, rate, throughput] 6000, 100.02, 40.46
> Duration [total, attack, wait] 1m29.540373624s, 59.990568262s,
> 29.549805362s
> Latencies [mean, 50, 95, 99
ceInFastThrow
> -XX:MaxGCPauseMillis=250
> -XX:OnOutOfMemoryError=/usr/local/solr/bin/oom_solr.sh 8983 /srv/solr/logs
>
> -Xlog:gc*:file=/srv/solr/logs/solr_gc.log:time,uptime:filecount=9,filesize=20M
> -Xmx7913m
> -Xss256k
>
> Xmx values are based on the instance RAM
Hello
Can you please tell us the JVM Heap Setting for both the versions: 8.3.1,
8.9.0?
I will also have to look into the following code: FileFloatSource.java:210.
(will do it tonite-IST and update)
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandh
Hello
If the insert/delete are done with two different threads (and with no
synchronization), it could be possible that the new records are getting
deleted. We might have to dig a bit into Solr code I guess.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Maha
This looks more like a memoryleak rather than a thread issue.
On Wed, 13 Oct 2021, 04:33 Joel Bernstein, wrote:
> There is a thread dump on the Solr admin. You can use that to determine
> what all those threads are doing and where they are getting stuck. You can
> post parts of the thread dump b
Hi
Can you please share more info about the load test? How many errors are you
getting of this type? This more or less looks like that the Zookeeper is
busy or down.
Cheers.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic
to solr 8.7, keeping everything same.
> We are facing an increase of 100-150 ms.
>
>
> On Wed, Aug 11, 2021 at 11:55 AM Deepak Goel wrote:
>
> > If I were you, then I would stick to the 128 GB machine. And then look at
> > other parameters to tune...
> >
> >
&
B.
>
> On Tue, Aug 3, 2021 at 2:11 PM Deepak Goel wrote:
>
> > I am confused a bit about the maths:
> >
> > Heap-30 GB & Index Size-95 GB is equal to 125GB. And the RAM is 96GB.
> >
> >
> >
> >
> > Deepak
> > "The greatness
> Dominique
>
>
> Le lun. 9 août 2021 à 07:16, Deepak Goel a écrit :
>
> > Looks like your SolrCloud is running in a single-threaded mode. So adding
> > CPU's might not help!
> >
> >
> > Deepak
> > "The greatness of a nation can be judged
Looks like your SolrCloud is running in a single-threaded mode. So adding
CPU's might not help!
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedi
I am confused a bit about the maths:
Heap-30 GB & Index Size-95 GB is equal to 125GB. And the RAM is 96GB.
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedI
62 matches
Mail list logo
