[Query] [Solr 8.11.1] Retrieving non stored fields data

[Nagarajan Muthupandian]

Hi,

I am working on POC of Re-Indexing for Solr Upgrade ( 8 to 9 ).
Idea is to query the existing index data and re-index it to the new version.


3 Important field attributes when we query “q=*:*’ to retrieve the data.

stored
docValues

useDocValuesAsStored





I tried different combinations of 3 important field attributes as below.. And I 
found I was able to retrieve all the fields data in all combinations, which 
contradicts the definition of the fields.

Wanted to understand if I am missing out something.. Can you help me understand 
the below behaviour. Sharing the test example which I tried in my local setup.

Examples…

Field Types :
<fieldType name="test_field_1" class="solr.TextField"
                 indexed="true"
                 stored="false"
                 docValues="true"
                 useDocValuesAsStored="true"
                 omitNorms="true"
                 positionIncrementGap="100">
      <analyzer type="index">
          <tokenizer class="solr.KeywordTokenizerFactory"/>
          <filter class="solr.LowerCaseFilterFactory"/>
      </analyzer>
      <analyzer type="query">
          <tokenizer class="solr.KeywordTokenizerFactory"/>
          <filter class="solr.LowerCaseFilterFactory"/>
      </analyzer>
    </fieldType>
   <fieldType name="test_field_2" class="solr.TextField"
                 indexed="true"
                 stored="false"
                 docValues="true"
                 useDocValuesAsStored="false"
                 omitNorms="true"
                 positionIncrementGap="100">
      <analyzer type="index">
          <tokenizer class="solr.KeywordTokenizerFactory"/>
          <filter class="solr.LowerCaseFilterFactory"/>
      </analyzer>
      <analyzer type="query">
          <tokenizer class="solr.KeywordTokenizerFactory"/>
          <filter class="solr.LowerCaseFilterFactory"/>
      </analyzer>
    </fieldType>
   <fieldType name="test_field_3" class="solr.TextField"
                 indexed="true"
                 stored="false"
                 docValues="false"
                 useDocValuesAsStored="false"
                 omitNorms="true"
                 positionIncrementGap="100">
      <analyzer type="index">
          <tokenizer class="solr.KeywordTokenizerFactory"/>
          <filter class="solr.LowerCaseFilterFactory"/>
      </analyzer>
      <analyzer type="query">
          <tokenizer class="solr.KeywordTokenizerFactory"/>
          <filter class="solr.LowerCaseFilterFactory"/>
      </analyzer>
    </fieldType>

Fields
<field name="test_field_1" type="test_field_1" />
<field name="test_field_2" type="test_field_2" />
<field name="test_field_3" type="test_field_3" />



Upload



curl -X POST -H 'Content-Type: application/json' 
'http://localhost:8983/solr/TestCore_1/update/json/docs' --data-binary '
{
 "id": "1",
  "title": "Test 1"
  "test_field_1": "test_field_1_1"
  "test_field_2": "test_field_2_1"
  "test_field_3": "test_field_3_1"
}
{
  "id": "2",
  "title": "Test 2"
  "test_field_1": "test_field_1_2"
  "test_field_2": "test_field_2_2"
  "test_field_3": "test_field_3_2"
}
{
  "id": "3",
  "title": "Test 3"
  "test_field_1": "test_field_1_3"
  "test_field_2": "test_field_2_3"
  "test_field_3": "test_field_3_3"
}'


Query..

[cid:image001.png@01D8EED7.BB792E10]



Thanks

Rajan