I've seen users actually attempt to switch a Solr application to a Snowflake application. There two reasons they typically want to do this:
1) They don't want to transfer data from a system of record to the analytics engine. 2) They feel that Snowflake is a more appropriate analytics engine because of its more traditional data warehousing design. But, these users have not been able to switch from Solr to Snowflake because Snowflake simply can't do the things that their Solr applications is doing. Performance with high QPS, large datasets, many aggregation etc... is going to be faster in Solr. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 22, 2022 at 11:07 AM David Hastings < hastings.recurs...@gmail.com> wrote: > Those features are not database situations, no one goes from a search > engine to a DB, sometimes you go from a DB to search if you're brave to use > it as a datastore, but not the other way > > On Fri, Apr 22, 2022 at 11:02 AM Balanathagiri Ayyasamypalanivel < > bala.cit...@gmail.com> wrote: > > > Hi Amit. > > > > I have to search on the list of documents, I am using stats, facet and > > complex queries like pivots and collapse as well for grouping. > > > > Regards, > > Bala. > > > > On Thu, Apr 21, 2022, 5:08 PM Amit Aggarwal <amit.aggarwa...@gmail.com> > > wrote: > > > > > Hi , > > > > > > Before I can answer your question, can you help me to understand what > > kind > > > of data do you have ? And what kind of queries you would fire to fetch > > data > > > ? > > > > > > > > > Thanks & Regards > > > > > > On Fri, 22 Apr 2022, 01:22 Balanathagiri Ayyasamypalanivel, < > > > bala.cit...@gmail.com> wrote: > > > > > > > Thanks Amit, currently we are running our application with Solr. We > > > > sourcing data from Hadoop to Solr. > > > > > > > > Now we have to switch to cloud and all the data in Hadoop is > switching > > to > > > > Snowflake. > > > > > > > > So now from the Solr perspective I have 2 options > > > > > > > > 1) source data from snowflake to Solr. > > > > 2) or directly query in Snow flake for my application. > > > > > > > > May I know which one is perfect here in the performance perspective. > > > > > > > > Regards, > > > > Bala. > > > > > > > > On Thu, Apr 21, 2022, 11:22 AM Amit Aggarwal < > > amit.aggarwa...@gmail.com> > > > > wrote: > > > > > > > > > Hi, > > > > > > > > > > I think the comparison is wrong, because in snowflake data is > > organized > > > > in > > > > > fact and dimension tables while solr is search engine. > > > > > > > > > > Solr is optimized for full text search while snowflake like dB are > > used > > > > to > > > > > run joins, analytic queries. > > > > > > > > > > To answer your question - no if you are on snowflake , solr is not > > > right > > > > > choice at all. > > > > > > > > > > > > > > > > > > > > On Thu, 21 Apr 2022, 20:34 Balanathagiri Ayyasamypalanivel, < > > > > > bala.cit...@gmail.com> wrote: > > > > > > > > > > > Thanks David, for your quick response. From the overall article > in > > > the > > > > > > system, it seems like snowflake little faster than the normal > > > Database > > > > > > system, so instead of sourcing the data from snowflake to Solr. > > > > > > > > > > > > Can we directly query from snowflake via snow sql? > > > > > > > > > > > > Regards, > > > > > > Bala. > > > > > > > > > > > > On Thu, Apr 21, 2022, 10:36 AM David Hastings < > > > > > > hastings.recurs...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > I dont see how they are comparable. One is a DB, the other is > a > > > > search > > > > > > > engine. There is no overlap aside from Solr indexing data fro > > > > > Snowflake > > > > > > to > > > > > > > search it > > > > > > > > > > > > > > On Thu, Apr 21, 2022 at 10:21 AM Balanathagiri > Ayyasamypalanivel > > < > > > > > > > bala.cit...@gmail.com> wrote: > > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > > > Any one recently switched from Solr to Snowflake? Or can we > > have > > > > any > > > > > > > > comparison chart between the snowflake vs Solr. > > > > > > > > > > > > > > > > Regards, > > > > > > > > Bala. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
