And effectively I do several AtomicUpdate.... Message from the link : https://stackoverflow.com/questions/51896397/losing-the-indexed-data-on-upda ting-in-solr ***** As per the doc on Atomic Updates:
"The core functionality of atomically updating a document requires that all fields in your schema must be configured as stored (stored="true") or docValues (docValues="true") except for fields which are destinations, which must be configured as stored="false"." Are you sure your body field has stored or docValues to true? The reason for that is that internally Solr is reindexing the whole doc, so those fields for which it has no way to recover the original data, are lost. ******* Cordialement, Best Regards Bruno Mannina www.matheo-software.com www.patent-pulse.com Mob. +33 0 634 421 817 -----Message d'origine----- De : Bruno Mannina [mailto:bmann...@matheo-software.com] Envoyé : jeudi 10 octobre 2024 09:46 À : users@solr.apache.org Objet : RE: Field disappears sometimes ?! May be : https://stackoverflow.com/questions/51896397/losing-the-indexed-data-on-upda ting-in-solr Cordialement, Best Regards Bruno Mannina www.matheo-software.com www.patent-pulse.com Mob. +33 0 634 421 817 -----Message d'origine----- De : Bruno Mannina [mailto:bmann...@matheo-software.com] Envoyé : jeudi 10 octobre 2024 09:35 À : users@solr.apache.org Objet : RE: Field disappears sometimes ?! Hi Hitendra, Do you remember the version of Solr ? Mine is 8.11.3. Cordialement, Best Regards Bruno Mannina www.matheo-software.com www.patent-pulse.com Mob. +33 0 634 421 817 -----Message d'origine----- De : Hitendra Talluri [mailto:hitendra.tall...@hitachivantara.com.INVALID] Envoyé : jeudi 10 octobre 2024 08:15 À : users@solr.apache.org Objet : RE: Field disappears sometimes ?! We have noticed similar behaviour. Some of the documents drop fields in a collection. This is visible when we facet on a Boolean field ,the values show different and they never go back to what it was. Yes there are updates but not effecting those fields. i.e. the facet values should have stayed the same. I did a IndexCheck on the shards and they are all healthy( no corruption). Nothing obvious in the logs. Hitendra Talluri Senior Consultant , Managed Services Hitachi Vantara m: +44 7717347192 | t: +44 7717347192 e: hitendra.tall...@hitachivantara.com 7th Floor, 1 Appold Street, London, EC2A 2UT, UK Registered Company Address: Hitachi Vantara Limited (Registered Company No: 02332239), Sefton Park, Stoke Poges, Buckinghamshire, SL2 4HD, United Kingdom Meet Hitachi Vantara http://www.hitachivantara.com/ | community.HitachiVantara.com -----Original Message----- From: Bruno Mannina <bmann...@matheo-software.com> Sent: 09 October 2024 15:37 To: solr-u...@lucene.apache.org Subject: Field disappears sometimes ?! ***** EXTERNAL EMAIL ***** Dear all, I'm facing on a strange issue. I'm using Solr 8.11.3 under Ubuntu with 1.5To RAM, SSD NVme My collection is around 8To with ~159M docs with 30 fields. I index XML documents twice a week. Around 200 000 docs for size = 15~20Go. All work fine. But with some indexed documents there is data missing. It concerns mainly 2 fields : title and description. Title, generally is just a sentence and description can be a long text (several pages of text). Documents, where there are missing fields, are in the collection but these 2 fields sometimes is missing. Of cours, these fields are presents in XML source file. and I don't know why because if I re-index the same documents these 2 fields appear ?! During the first indexing I have no error and the commit is ok also. Do you have any idea why I have this problem ? Cordialement, Best Regards Bruno Mannina <http://www.matheo-software.com/> http://www.matheo-software.com/ <http://www.patent-pulse.com/> http://www.patent-pulse.com/ Mob. +33 0 634 421 817 -- Cet e-mail a été vérifié par le logiciel antivirus d'Avast. http://www.avast.com/ -- Cet e-mail a été vérifié par le logiciel antivirus d'Avast. www.avast.com -- Cet e-mail a été vérifié par le logiciel antivirus d'Avast. www.avast.com -- Cet e-mail a été vérifié par le logiciel antivirus d'Avast. www.avast.com
