Create a small Java utility to loop through the cores and use SolrJ to
turn replication on/off for each core in turn?
On 2/3/23 08:30, Paul Ryder wrote:
HI Shawn
We are on 8.1.1 but upgrading soon... shame Solr doesn't have a master command
to turn replication off for all cores at once...
Ch
We use the zero-width space trick here to ensure links break properly
when formatting them for PDF and HTML display in our articles with extra
long URLs. Inserting a regular space would work, but also would display
incorrectly for human parsing.
On 12/1/22 11:12, dmitri maziuk wrote:
On 2022-
In my experience, you need to index to a new collection, then use the
alias command to point the connection endpoint to the new collection.
Not sure how this works in non-cloud mode.
We've tried reindexing to an existing collection, but, the created
LUCENE version stamp doesn't get updated, an
The restore process allows restoring to a collection with a different
name than the original. So I would expect the requirement to have a
collection already existing to be legit.
The documentation does say (or at least implies) that to restore the
number of shards in the destination collection
Have you tried running the query using a web browser from the offending
client machine so you can capture the server's response?
On 1/27/22 06:42, Jeremy Buckley - IQ-C wrote:
On Wed, Jan 26, 2022 at 10:44 PM Anshum Gupta
wrote:
From what I understand, all solr server instances as well as th
Did you create *both* the bucket and the backup destination folder in
the bucket?
On 1/14/22 04:10, Sergio García Maroto wrote:
Hi. thanks for replies.
1) Yes I have tried both things.
I created bucket manually and still same issue.
2) I added required jars and section to solr.xml
I am runni
I presume this also needs fixing for zookeeper nodes?
On 12/10/21 13:44, Walter Underwood wrote:
Does all Solr logging go through slf4j? If so, that should protect against this
vulnerability.
If not, who has tested Solr with log4j 2.15.1?
We are running 8.8.2.
wunder
Walter Underwood
wun...@
A conversation has been started on Slack in reference to this if you
would like to participate.
A community maintained/unofficial Slack organization that relays
messages bi-directionally to/from the official IRC channels. Link:
https://s.apache.org/solr-slack
On 12/4/21 02:35, Ricardo Ruiz w
r.xml file.
More information can be found here:
https://solr.apache.org/guide/8_5/format-of-solr-xml.html#the-solr-element
- Houston
On Mon, Nov 29, 2021 at 7:42 AM Michael Conrad wrote:
Hello all,
Solr 8.11.0
java -version
openjdk version "11.0.11" 2021-04-20
OpenJDK Runtime Envi
Hello all,
Solr 8.11.0
java -version
openjdk version "11.0.11" 2021-04-20
OpenJDK Runtime Environment AdoptOpenJDK-11.0.11+9 (build 11.0.11+9)
I'm trying to enable S3 backup repository on a collection but I'm getting:
"error":{
"metadata":[
"error-class","org.apache.solr.common.SolrE
Since our upgrade to 8.11.0 we've been getting a lot of warnings with
"likely server has closed socket" as part of the description. What do I
need to look for in our system configs that would be causing this?
WARN - 2021-11-23 09:47:49.997; org.apache.zookeeper.ClientCnxn; An
exception was th
Hello all,
I'm trying to setup backup to S3, and see that the plugin must be enabled.
The example XML fragments appears to be collection level specific, but I
want to enable the plugin globally across all nodes at once.
What do I need to specify where?
So far, I've only found information whi
I am using SolrJ to create collections. SolrCloud 8.10.1, SolrJ 8.10.1.
I specified this as my nodeset for the creation.
private static final String SOLR_NODESET =
"solr-0001:8983_solr,solr-0003:8983_solr,solr-0002:8983_solr,solr-0004:8983_solr";
But the solrcloud assignments show to be:
sha
I'm trying to add a replica but it is failing with "No node can satisfy
the rules" and the diagnostics log entry shows violaitions as []
How can I determine what the issue is and correct it?
DIAGNOSTICS AND STACKTRACE FROM solr.log:
2021-11-08 00:43:38.285 ERROR
(OverseerThreadFactory-38-thre
ok, found instructons on creating this in blob store info page
On 11/5/21 10:23, Michael Conrad wrote:
Apparently my upgrade path to Solr 7.7.3 didn't create a ".system"
collection?
Can I create this collection and then will Solr use it correctly?
Apparently my upgrade path to Solr 7.7.3 didn't create a ".system"
collection?
Can I create this collection and then will Solr use it correctly?
Hello fellow SolrCloud users,
Hopefully someone can point me in the right direction as I can't figure
out what is wrong.
I have 4 nodes. I just finished reindexing a very large collection and
now I'm trying to add replicas.
nodes 1 and 2 contain the collection and I'm trying to replicate th
has taken effect after the reload as the cause,
I've not seen any indications of the prior slow downs we were
experiencing. IO Wait is now near or at 0 a good portion of the time
with occasional spikes.
On 11/4/21 10:03, Shawn Heisey wrote:
On 11/4/21 7:43 AM, Michael Conrad wrote:
ok,
nodes by tomorrow sometime.
On 11/4/21 09:40, Shawn Heisey wrote:
On 11/4/21 6:27 AM, Michael Conrad wrote:
When there is a high segment count processes on the systems start
showing very high "i/o wait" with associated idle CPU time according
to top. Which indicates to me that CPU core
n the index.
3) Use more shards.
Joel Bernstein
http://joelsolr.blogspot.com/
On Thu, Nov 4, 2021 at 8:35 AM Michael Conrad wrote:
Would either of these two settings possibly help, at least during full
reindexes?
On 11/4/21 08:27, Michael Conrad wrote:
When se
Would either of these two settings possibly help, at least during full
reindexes?
On 11/4/21 08:27, Michael Conrad wrote:
When segment count is around 16 to 20, performance seems OK.
Here is our config:
Solr 7.7.3.
java -version
openjdk version "11.0.11" 2021-04-20
O
1.0G
Swap: 15G 0B 15G
On 11/3/21 23:19, Shawn Heisey wrote:
On 11/3/2021 1:44 PM, Michael Conrad wrote:
Is there a way to set max segment count for builtin merge policy?
I'm having a serious issue where I'm trying to reindex 75 million
documents and
I recommend using the SolrJ client libs for the client war.
On 11/3/21 15:50, cmarkwood wrote:
I see, thanks. So I need to write a query client, and (JSON) parser for the
response.
On Wednesday, November 3, 2021, 03:23:44 PM EDT, Furkan
KAMACI wrote:
On Wednesday, November 3, 202
Is there a way to set max segment count for builtin merge policy?
I'm having a serious issue where I'm trying to reindex 75 million
documents and the segment count skyrockets with associated significant
drop in performance. To the point we start getting lots of timeouts.
Is there a way to set
Update:
It removed replica solr-0001 and now I have the leader and replica on
the same node?
-Mike/NewsRx
On 11/1/21 10:04, Michael Conrad wrote:
Is there a particular reason a cluster would start adding replicas
over and over, some times multiple ones on the same node?
As I have as an
Is there a particular reason a cluster would start adding replicas over
and over, some times multiple ones on the same node?
As I have as an example:
I have a shard on node solr-0002 [leader] with a replica at node
solr-0001 which just had a replica auto added at node solr-0002.
So it now ha
What does the following man?
null:org.apache.solr.common.SolrException: Error getting replica
locations : No node can satisfy the rules "[] More details from logs in
node : solr-0002:8983_solr, errorId :
AutoScaling.error.diagnostics.1127421982273365"
2:12 PM Michael Conrad wrote:
We have run across an issue where certain searches result in a vague
NPE. Any help into pointing into a correct direction would be appreciated.
### Example Log Entries:
2021-10-25 18:08:21.683 ERROR (qtp1659840424-39975) [c:alldata s:shard1
r:core_n
We have run across an issue where certain searches result in a vague
NPE. Any help into pointing into a correct direction would be appreciated.
### Example Log Entries:
2021-10-25 18:08:21.683 ERROR (qtp1659840424-39975) [c:alldata s:shard1
r:core_node64 x:alldata_shard1_replica_n63] o.a.s.h.R
constraints that can't be alleviated, or the size of
collection make it unrealistic in time...
On 10/12/21 9:44 AM, Michael Conrad wrote:
Attempting to use the merge policy "UpgradeIndexMergePolicy" via the
"UpgradeIndexMergePolicyFactory" seems to result in no mer
Attempting to use the merge policy "UpgradeIndexMergePolicy" via the
"UpgradeIndexMergePolicyFactory" seems to result in no merging.
Here is my config fragment:
class="org.apache.solr.index.UpgradeIndexMergePolicyFactory">
mergePolicy
name="mergePolicy.class">org.apache.solr.i
I gave up on log4j and switched to slf4j-simple. Now it is only logging
WARN and above.
implementation 'org.slf4j:slf4j-simple:1.7.+'
On 10/7/21 11:39 AM, Shawn Heisey wrote:
On 10/7/21 7:37 AM, Michael Conrad wrote:
There is so much useless logging happening I
proved wrong if this works.
On Fri, Oct 8, 2021 at 8:48 AM Michael Conrad wrote:
Would this help?
UpgradeIndexMergePolicy
This |MergePolicy|
<
https://lucene.apache.org/core/8_2_0//core/org/apache/lucene/index/MergePolicy.html>
is used for upgrading all existing segments of an index when
this seamlessly since reindexing
will take several weeks given the size of indexes for many of our customers.
-Rahul
On Thu, Oct 7, 2021 at 8:35 AM Michael Conrad wrote:
No, worst case is it closes the index writer and leaves the drive full.
20k free space remaining.
On 10/6/21 1:56 PM, Dave
SolrJ Logging in 8.x - how to get it to turn OFF ?
I have the following dependencies in my project:
api 'org.apache.logging.log4j:log4j-api:2.14.+'
api 'org.apache.logging.log4j:log4j-core:2.14.+'
api 'org.apache.logging.log4j:log4j-1.2-api:2.14.+' // redirect
log4j-v1 to log4j-v2
On 10/7/21 8:46 AM, Rahul Goswami wrote:
Won’t work. I have tried optimize on 7.7.2 to 8.x where several segments
were originally written in 5.x and 6.x.
We are scratching our heads to achieve this seamlessly since reindexing
will take several weeks given the size of indexes for many of our cus
full reindex is always the best bet if you can destroy original and it
doesn’t effect anything
On Oct 6, 2021, at 1:53 PM, Michael Conrad wrote:
too late it's in progress.
On 10/6/21 9:11 AM, Dave wrote:
Hold on that idea then. An optimize will use three times your index size
pos
temporary index after you run
out of space. Really optimize is almost not even supported (it still works) but
a full reindex is always the best bet if you can destroy original and it
doesn’t effect anything
On Oct 6, 2021, at 1:53 PM, Michael Conrad wrote:
too late it's in progress.
too late it's in progress.
On 10/6/21 9:11 AM, Dave wrote:
Hold on that idea then. An optimize will use three times your index size
possibly.
On Oct 6, 2021, at 9:02 AM, Michael Conrad wrote:
Thanks,
I think we'll try the full optimize route as we don't have stora
rmine Lucene versions for segments?
Hold on that idea then. An optimize will use three times your index size
possibly.
On Oct 6, 2021, at 9:02 AM, Michael Conrad wrote:
Thanks,
I think we'll try the full optimize route as we don't have storage to spare for
second copies, etc.
-Mike
However if you got the
time to spare you can do an optimize and it will force the segments all into
the current version
On Oct 6, 2021, at 8:46 AM, Michael Conrad wrote:
Hello all,
Is there an easy way to determine Lucene versions for segments?
If we were to do a full reindex, rewriting al
Hello all,
Is there an easy way to determine Lucene versions for segments?
If we were to do a full reindex, rewriting all segments, would that
update the segment version to match the current Lucene version in use?
We are working on upgrading from Solr 7.7.3 to Solr 8.x but have
discovered th
42 matches
Mail list logo
