[
https://issues.apache.org/jira/browse/SOLR-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893693#action_12893693
]
Russell Teabeault commented on SOLR-1352:
-----------------------------------------
Ok. The package of SolrQueryResponse changed from org.apache.solr.request to
org.apache.solr.response. Because org.apache.solr.response.SolrQueryResponse
does not exist in 1.4 I changed the necessary code in the trunk to use
org.apache.solr.request.SolrQueryResponse so that I could get everything to
compile. I then replaced the dataimporthandler jar file in the 1.4 version of
the solr war.
So with one thread everything works fine. I then set the root entity to use 4
threads. I often get the following exception almost immediately after starting:
org.apache.solr.handler.dataimport.DataImportHandlerException:
java.sql.SQLRecoverableException: Closed Connection: next
at
org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:64)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasnext(JdbcDataSource.java:337)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.access$600(JdbcDataSource.java:226)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.hasNext(JdbcDataSource.java:260)
at
org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityProcessorBase.java:75)
at
org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:73)
...
However after 5 to 10 attempts it runs without problem. This is being run
against an Oracle 10g database using the 11g driver. Also we have 4
sub-entities. Not sure if I should open a new defect for this or if this has
been seen by other people? Thoughts?
> DIH: MultiThreaded
> ------------------
>
> Key: SOLR-1352
> URL: https://issues.apache.org/jira/browse/SOLR-1352
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Reporter: Noble Paul
> Assignee: Noble Paul
> Fix For: 1.5
>
> Attachments: SOLR-1352.patch, SOLR-1352.patch, SOLR-1352.patch
>
>
> It has been a long pending request to make DIH multithreaded. Now that we
> have implemented most of the features , the next best thing we can aim for is
> performance. DIH should be able to take advantage of multiple cores in a box
> .I expect the configuration to be as follows
> {code:xml}
> <entity name="foo" threads="4">
> <!--more stuff goes here-->
> </entity>
> {code}
> at the entity where the threads is specified it should fork into multiple
> threads. If the threads<2 it executes w/o forking. In debug mode it
> automatically becomes singlethreaded.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
