Re: Multiple document types

2012-01-25 Thread Simon Willnauer
On Thu, Jan 26, 2012 at 12:05 AM, Frank DeRose wrote: > Hi Simon, > > No, not different entity types, but actually different document types (I > think). What would be ideal is if we could have multiple elements > in the data-config.xml file and some way of mapping each different > element to

Re: Cluster Resizing question

2012-01-25 Thread Jamie Johnson
I think I need to provide a few more details here. I need the ability to add a shard to the cluster, in doing this I'd like to split an existing index and spin up this new shard with 1/2 (or there abouts) of this and allow the original to continue serving the pieces it has now. In our application

Re: phrase auto-complete with suggester component

2012-01-25 Thread Tommy Chheng
Thanks for link, that's the approach I'm going to try. On Wed, Jan 25, 2012 at 2:39 PM, O. Klein wrote: > > O. Klein wrote >> >> I agree. Suggester could use some attention. Looking at Wiki there were >> some features planned, but not much has happened lately. >> > > Or check out this post > http

Query for documents that have ONLY a certain value in a multivalued field

2012-01-25 Thread Garrett Conaty
Does anyone know if there's a way using the SOLR query syntax to filter documents that have only a certain value in a multivalued field? As an example if I have some field "country" that's multivalued and I want q=id:[* TO *]&fq=country:brazil where 'brazil' is the only value present. I've

RE: Multiple document types

2012-01-25 Thread Frank DeRose
Hi Simon, No, not different entity types, but actually different document types (I think). What would be ideal is if we could have multiple elements in the data-config.xml file and some way of mapping each different element to a different sets of field in the schema.xml file, and to a differe

Re: phrase auto-complete with suggester component

2012-01-25 Thread O. Klein
O. Klein wrote > > I agree. Suggester could use some attention. Looking at Wiki there were > some features planned, but not much has happened lately. > Or check out this post http://www.cominvent.com/2012/01/25/super-flexible-autocomplete-with-solr/ looking very promising as an alternative. --

Advice - evaluating Solr for categorization & keyword search

2012-01-25 Thread Becky Neil
Hi all, I've been tasked with evaluating whether Solr is the right solution for my company's search needs. If this isn't the right forum for this kind of question, please let me know where to go instead! We are currently using sql queries to find mysql db results that match a single keyword in on

WARNING: Unable to read: dataimport.properties DHI issue

2012-01-25 Thread Egonsith
I have tried to search for my specific problem but have not found solution. I have also read the wiki on the DHI and seem to have everything set up right but my Query still fails. Thank you for your help I am running Solr 3.1 with Tomcat 6.0 Windows server 2003 r2 and SQL 2008 I have the sqljd

Re: JSON response truncated

2012-01-25 Thread Erick Erickson
Two things: 1> I suspect it's your servelet container rather than Solr since your JSON isn't well formatted. I have no clue where to set that up, but that's where I'd look. 2> A side note. You may run into the default of 10,000 tokens that are indexed, see the in solrconfig.xml. This is

Re: full import is not working and still not showing any errors

2012-01-25 Thread scabra4
Erick, Thanks for your input, but I've solved the problem which was caused by the jdbc driver. This is my first time using solr, and i doing some search over internet just to get familiar with it, and see how flexible it is. Do you know whether i can specify complex Search, Filtration and Ranking

Re: What is the most basic schema.xml you can have for indexing a simple database?

2012-01-25 Thread Erick Erickson
Fergus: I have to ask what's driving the push for compactness? General tidiness (of which I actually approve) or something else? What is the redundancy you're seeing? Just the fact that some fieldTypes will contain *almost* the same set of analyzers? Posting your schema and asking "can we make t

Re: Indexing failover and replication

2012-01-25 Thread Anderson vasconcelos
Thanks for the Reply Erick I will make the replication to both master manually. Thanks 2012/1/25, Erick Erickson : > No, there no good ways to have a single slave know about > two masters and just use the right one. It sounds like you've > got each machine being both a master and a slave? This is

Re: Cluster Resizing question

2012-01-25 Thread Jamie Johnson
Thanks Otis. I have been following the SolrCloud development, but I was wondering specifically about elastically expanding the cloud by adding shards. I'm following the distributed indexing JIRA, but I'm having difficulty finding a JIRA which specifically references the issues with elasticity. A

Re: What is the most basic schema.xml you can have for indexing a simple database?

2012-01-25 Thread Fergus McDowall
Hi Param Yes, refactoring the various example schema.xml's is what i have been doing up to now. The end results is usually quite verbose with a lot of redundancy. What is the most compact possible schema.xml? Thanks for the link! F On 25. jan. 2012, at 17:31, "Sethi, Parampreet" wrote: >

Re: Indexing Using XML Message

2012-01-25 Thread Erick Erickson
So you can't even communicate with the remote Solr process by HTTP? Because if you can, SolrJ would work. Otherwise, you're stuck with creating a bunch of Solr-style XML documents, they have a simple format. See the example/exampleDocs directory in the standard distribution. You'll have to parse t

Re: Cluster Resizing question

2012-01-25 Thread Otis Gospodnetic
Jamie, depending on how quickly you need this, it may be better to follow SolrCloud development because cluster resizing will work differently there. Otis  Performance Monitoring SaaS for Solr - http://sematext.com/spm/solr-performance-monitoring/index.html >_

Re: Using SOLR Autocomplete for addresses (i.e. multiple terms)

2012-01-25 Thread Jan Høydahl
Hi, I don't think that the suggester can output multiple fields. You would have to encode your data in a special way with separators. Using the separate Solr core approach, you may return whatever fields you choose to the suggest Ajax component. I've written up a blog post and uploaded an examp

Using multiple DirectSolrSpellcheckers for a query

2012-01-25 Thread Nalini Kartha
Hi, We are trying to use the DirectSolrSpellChecker to get corrections for mis-spelled query terms directly from fields in the Solr index. However, we need to use multiple fields for spellchecking a query. It looks looks like you can only use one spellchecker for a request and so the workaround f

Re: HTMLStripCharFilterFactory not working in Solr4?

2012-01-25 Thread Mike Hugo
Thanks guys! I'll grab the latest build from the solr4 jenkins server when those commits get picked up and try it out. Thanks for the quick turnaround! Mike On Wed, Jan 25, 2012 at 11:01 AM, Steven A Rowe wrote: > Hi Mike, > > Yonik committed a fix to Solr trunk - your test on LUCENE-3721 suc

RE: HTMLStripCharFilterFactory not working in Solr4?

2012-01-25 Thread Steven A Rowe
Hi Mike, Yonik committed a fix to Solr trunk - your test on LUCENE-3721 succeeds for me now. (On Solr trunk, *all* CharFilters have been non-functional since LUCENE-3396 was committed in r1175297 on 25 Sept 2011, until Yonik's fix today in r1235810; Solr 3.x was not affected - CharFilters have

Re: Indexing failover and replication

2012-01-25 Thread Erick Erickson
No, there no good ways to have a single slave know about two masters and just use the right one. It sounds like you've got each machine being both a master and a slave? This is not supported. What you probably want to do is either set up a repeater or just index to the two masters and manually chan

Re: SolrCell maximum file size

2012-01-25 Thread Erick Erickson
Mostly it depends on your container settings, quite often that's where the limits are. I don't think Solr imposes any restrictions. What size are we talking about anyway? There are implicit issues with how much memory parsing the file requires, but you can allocate lots of memory to the JVM to han

Re: Not getting the expected search results

2012-01-25 Thread Erick Erickson
First thing is that there's a helpful page for debuging this called dataimport.jsp, see: http://wiki.apache.org/solr/DataImportHandler Second, and this is just a guess, what is your defined in your schema? When Solr adds documents, a document with the same value in the field defined in as a docu

Re: What is the most basic schema.xml you can have for indexing a simple database?

2012-01-25 Thread Sethi, Parampreet
Hi Fergus, The schema.xml has declaration of fields as well as analyzers/tokenizers which are required as per the application demand. The easiest way is to modify the schema.xml file which is delivered with /example/solr/conf. In case you are looking for setting up Solr in front of database with

Re: full import is not working and still not showing any errors

2012-01-25 Thread Erick Erickson
please review: http://wiki.apache.org/solr/UsingMailingLists I infer you're using DIH, but you've never really stated that. What page are you refreshing? What commands have you issued? Have you looked at dataimport.jsp (the DIH debugging page)? Best Erick On Tue, Jan 24, 2012 at 6:01 AM, scabr

Re: Currency field type

2012-01-25 Thread Erick Erickson
There's really no "roadmap". If you have big enough need you can work on this patch and submit of for someone to commit but it looks like Greg had other priorities get in the way so you can't count on anyone else carrying this forward.. If you want to integrate the patch, you check out the source

Re: Problem in Accessing DIH

2012-01-25 Thread Erick Erickson
You need to follow the instructions here: http://wiki.apache.org/solr/DataImportHandler In particular setting up the request handler in solrconfig.xml and creating a data-config.xml file that's referenced in the request handler. When this is done correctly, you should see the request handler you d

What is the most basic schema.xml you can have for indexing a simple database?

2012-01-25 Thread Fergus McDowall
Is it do-able/sensible to build a schema.xml from the ground up? Say that you are feeding the results of a database query into solr containing the fields id(int), title(varchar), description(varchar), pub_date(date) and tags(varchar) What would be the simplest schema.xml that could support this s

Indexing Using XML Message

2012-01-25 Thread Tod
I have a local data store containing a host of different document types. This data store is separate from a remote Solr install making streaming not an option. Instead I'd like to generate an XML file that contains all of the documents including content and metadata. What would be the most a

Re: Difference between #indexed documents and #results in *:* query

2012-01-25 Thread m0rt0n
BINGO!! Yep, I actually was assuming that the ID field was unique; and after your response I went to my DBA and he told me that it wasn't. Then, I made up a unique key by concattening three fields and that works. Thanks a lot for your very helpful answer! -- View this message in context: http:

Re: SpellCheck Help

2012-01-25 Thread Erick Erickson
You have to give us a lot more detail about exactly what you've done and what your results are. Please review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Tue, Jan 24, 2012 at 7:42 PM, vishal_asc wrote: > I have installed the same solr 3.5 with jetty and integrating it magento 1.

Query for exact part of sentence

2012-01-25 Thread Arkadi Colson
Hi I'm using the pecl PHP class to query SOLR and was wondering how to query for a part of a sentence exactly. There are 2 data items index in SOLR 1327497476: 123 456 789 1327497521. 1234 5678 9011 However when running the query, both data items are returned as you can see below. Any idea w

Re: Do Hignlighting + proximity using surround query parser

2012-01-25 Thread Ahmet Arslan
> > I got this working the way you > > describe it (in the getHighlightQuery() > > method). The span queries were tripping it up, so I > > extracted the query > > terms and created a DisMax query from them. There'll be > a > > loss of accuracy > > in the highlighting, but in my case that's better t

Re: highlighter not supporting surround parser

2012-01-25 Thread Ahmet Arslan
> i want performing span queries using > surround parser and i want tos how the > results with highlighter, but the problem is highlighter is > not working > properly with surround query parser.Are their any plugins or > updates > available to do it. Hi Manyu, You can use https://issues.apache.o

Re: Difference between #indexed documents and #results in *:* query

2012-01-25 Thread Sami Siren
Does all your 913 documents contain a unique key?  The uniqueKey field is "id" by default. --  Sami Siren On Wed, Jan 25, 2012 at 3:16 PM, m0rt0n wrote: > Thanks a lot for your answer; really appreciated. > > Unfortunately, I am still getting the same number of results: > - I tried by refreshing

Re: Difference between #indexed documents and #results in *:* query

2012-01-25 Thread m0rt0n
Thanks a lot for your answer; really appreciated. Unfortunately, I am still getting the same number of results: - I tried by refreshing the browser cache. - I tried another search by the ID:* - And went to the http://localhost:8983/solr/browse?q= ... and got the same number of results. (383 resu

Re: Need help

2012-01-25 Thread gabriel shen
Treat one solr schema as a database table, one solr core contains only one schema. So in your case you should define 4 solr cores, each contains a schema matching the database table you have. /shen On Wed, Jan 25, 2012 at 1:08 PM, Shambhu Kumar wrote: > I want to create One search. > > The im

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Hi Anderson, Thank you for your effort.I will try this. Hope it will solve my problem. Regards On Wed, Jan 25, 2012 at 2:27 PM, Anderson vasconcelos < anderson.v...@gmail.com> wrote: > Hi Parvin > > I did something that may help you. I set up apache (with mod_proxy and mode > balance) like a fr

Re: Difference between #indexed documents and #results in *:* query

2012-01-25 Thread Jan Høydahl
Hi, No, it's not normal :) Have you tried to hit SHIFT-F5 to make sure you're not getting tricked by browser caching? Or try a slightly different query like id:* You can also visit the "Schema browser" page of Solr admin and check the stats on how many docs are in the index. -- Jan Høydahl, sea

Re: solr replication

2012-01-25 Thread Anderson vasconcelos
Hi Parvin I did something that may help you. I set up apache (with mod_proxy and mode balance) like a front-end and use this to distruted the request of my aplication. Request for /update or /optmize, i'm redirect to master (or masters) server and requests /search i redirect to slaves. Example:

Need help

2012-01-25 Thread Shambhu Kumar
I want to create One search. The implementation is like this I have 4 table in database (Suppose profiles, clients, requirement and case) and having 4 entity in java code. Now I created one jsp which is having one drop down (Which contains all 4 options that's are entity name) one search box and

Re: phrase auto-complete with suggester component

2012-01-25 Thread O. Klein
Tommy Chheng-2 wrote > > Thanks, I'll try out the custom class file. Any possibilities this > class can be merged into solr? It seems like an expected behavior. > > > On Tue, Jan 24, 2012 at 11:29 AM, O. Klein wrote: >> You might wanna read >> http://lucene.472066.n3.nabble.com/suggest

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Ok thank you for your response. On Wed, Jan 25, 2012 at 12:24 PM, darul wrote: > I mean by grid the list of your instances : > > String masterUrl = "http://masterUrl/core/..."; > String[] slaveUrls = {"http://slaveUrl/core/...";, > "http://slaveUrl/core/..."} > > Then use your business logic to

Re: solr replication

2012-01-25 Thread darul
I mean by grid the list of your instances : String masterUrl = "http://masterUrl/core/..."; String[] slaveUrls = {"http://slaveUrl/core/...";, "http://slaveUrl/core/..."} Then use your business logic to use the correct one with Http solrJ facade. -- View this message in context: http://lucene.4

solr FieldCollapsing, label and locale parameter

2012-01-25 Thread Ralf Matulat
Hi, I'm using FieldCollapsing to group the results. Example: I search for /:/ and group by names, like: |http://localhost:/solr/select/?q=*:* &group=true &group.limit=200 &group.query=Jim

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Thank you for your response. What you mean by Grid? Can you please send me any example or any link? On Wed, Jan 25, 2012 at 11:30 AM, darul wrote: > You may define your specific configuration as a Grid with all your solr > instances and then using SolrJ and CommonsHttpSolrServer choose the righ

Difference between #indexed documents and #results in *:* query

2012-01-25 Thread m0rt0n
Hello, I have seen that I am getting 913 documents indexed: 1 913 0 2012-01-25 10:22:39 Indexing completed. Added/Updated: 913 documents. Deleted 0 documents. 2012-01-25 10:22:44 2012-01-25 10:22:44 913 0:0:5.10 ... and, when I do a search for *:* (all documents) I get 383 results Is this norm

Re: solr replication

2012-01-25 Thread darul
You may define your specific configuration as a Grid with all your solr instances and then using SolrJ and CommonsHttpSolrServer choose the right url depending on indexation or search task. -- View this message in context: http://lucene.472066.n3.nabble.com/solr-replication-tp3687106p3687208.html

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Then as you say , shouldn't i define three SolrServer() using SolrJ? For indexing call solrMasterServer, and for querying call solrSlaveServer1 or solrSlaveServer2? On Wed, Jan 25, 2012 at 11:09 AM, darul wrote: > Here is the way I see it (and implemented it), while using SolrJ api you > have >

Re: "index-time" over boosted

2012-01-25 Thread remi tassing
Hi, it worked (I'm using Solr-3.4.0, not that it matters)!! I'll try to figure out what went wrong ...with my limited skills. The solution omitNorms="true" works for now but it's not a long term solution in my opinion. I also need to figure out how to make all that work. Thanks again Jan!! Rem

Re: solr replication

2012-01-25 Thread darul
Here is the way I see it (and implemented it), while using SolrJ api you have to fire : - Indexation commands to your /indexation solr instance/ (master) example : http://myMaster:80/myCore/ - Query commands to your /search solr instance/ (slave). You may have several slaves, and also find alterna

solr replication

2012-01-25 Thread Parvin Gasimzade
Hi all, I try to setup solr replication by following http://wiki.apache.org/solr/SolrReplication tutorial.Everything is working ok. My question is, should i define two SolrServer in Solrj (one for master and one for slave) in order to redirect indexes into master and queries into slave? In the f