Use Python and Beautiful Soup for scraping in an external program. Then send
the results to your Django app using the Django Rest Framework JSON API. If you
need your scraping program to get candidate sites from your app, then use the
DRF API to get those.
hth
- Tom
> On Sep 13, 2020, at 1:39
Hi Raheel,
On 13/09/2020 10.39, Raheel Asghar wrote:
I am working on a project where i require to search for data related to
shopping, save it to my DB and show it to my users. But I cant find a
way to do so. PLEASE HELP
That is extremely vague to put it mildly. You'll have a much better
c
I am working on a project where i require to search for data related to
shopping, save it to my DB and show it to my users. But I cant find a way
to do so. PLEASE HELP
--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To unsubscribe from this gr
To: django-users@googlegroups.com
Subject: Search Engine using Django-Python
Hi All,
I am planning to create a search engine for my city. Can you please suggest
me Which technology I should prefer? I am new with Django, before that I
have work with some web application using Java Spring. But now,
File "/usr/local/lib/python2.7/dist-packages/haystack/fields.py", line
> 100, in prepare
> return current_object()
> File
> "/usr/local/lib/python2.7/dist-packages/django/db/models/fields/related.py",
> line 843, in __call__
> manager = getattr(self
r/local/lib/python2.7/dist-packages/django/db/models/fields/related.py",
line 843, in __call__
manager = getattr(self.model, kwargs.pop('manager'))
KeyError: u'manager'
On Monday, 6 July 2015 21:36:43 UTC+5:30, daniel.franca wrote:
>
> Hi Manoj, have you tried Haystack? h
Hi Manoj, have you tried Haystack? http://haystacksearch.org/
It's a simple API to make a search engine using Django, and you can attach
any of the available backends (Solr, Elasticsearch, Whoosh or Xapian).
Best,
Daniel
Em seg, 6 de jul de 2015 às 18:01, Manoj Bawane
escreveu:
>
Hi All,
I am planning to create a search engine for my city. Can you please suggest
me Which technology I should prefer? I am new with Django, before that I
have work with some web application using Java Spring. But now, I recently
working in one project where I found Django is also nice
o do a project in Python
> and I've chosen Django as the Web Framework. My project is a 'Smart' Search
> Engine that retrieves results most relevant to user's query. This website
> will:
>
>1. Index all the web pages available
>2. Use Page Ranking algor
am required to do a project in Python
> and I've chosen Django as the Web Framework. My project is a 'Smart' Search
> Engine that retrieves results most relevant to user's query. This website
> will:
>
>1. Index all the web pages available
>2. Use Page Rankin
Hello, I am a newbie in Django. I am required to do a project in Python and
I've chosen Django as the Web Framework. My project is a 'Smart' Search
Engine that retrieves results most relevant to user's query. This website
will:
1. Index all the web pages available
Yeah, i'll be taking the best out of every hint!
The big problem is that the user has a lot of freedom. If he just
wants to search for "barber" he can and urls will be /barber/
/... Every parameter is optional, they're just bound to an
order, if they're all present... So i don't have a "special" ca
On 10-08-11 15:50, samuele.mattiuzzo wrote:
I was considering the option/country/italy/city/milan/job/engineer/,
it wasn't that bat, but i'm risking very long urls if 4-5 parameters
are set...
If /italy/milan/barber is the normal url, by all means use that.
The other scenarios can then get a l
Well, i don't understand it plenty, since i never spoke with them
directly. Btw, our "seo consultants" said that /london/designer/ is
SEO-OK while ?city=london&job=designer is SEO-BAD. I really don't
think there's much difference between the two, but i cannot discuss
too much with them :)
On Aug 1
On Wed, Aug 10, 2011 at 2:50 PM, samuele.mattiuzzo wrote:
> my boss told me to use get requests instead of post, so i could
> explicit the parameters, but SEO experts said "NO WAY!". i don't like
> get method either, but the reason is different :P
>
I dont understand SEO reason, can you explain.
Yeah, it was just a shorthand to let you understand my problem, it
wasn't my actual url definition :)
I was considering the option /country/italy/city/milan/job/engineer/,
it wasn't that bat, but i'm risking very long urls if 4-5 parameters
are set...
On Aug 10, 12:18 pm, Reinout van Rees wrot
On 10-08-11 11:20, samuele.mattiuzzo wrote:
url(//, search_view),
url(//, search_view),
url(///, search_view)
as you can see, case 1 and case 2 are a trouble: country and city are
both strings, how's the url supposed to know if a link pointed to one
url or another? Should i use named views in t
ity to do so.
>
> On Wed, Aug 10, 2011 at 2:50 PM, samuele.mattiuzzo wrote:
>
>
>
>
>
>
>
> > Hi all, i'm developing a search-engine-like application using django
> > 1.3 and apache-solr as "database"
>
> > I'm now stuck with urls
opportunity to do so.
On Wed, Aug 10, 2011 at 2:50 PM, samuele.mattiuzzo wrote:
> Hi all, i'm developing a search-engine-like application using django
> 1.3 and apache-solr as "database"
>
> I'm now stuck with urls handling. Basically, i need to compose urls
>
Hi all, i'm developing a search-engine-like application using django
1.3 and apache-solr as "database"
I'm now stuck with urls handling. Basically, i need to compose urls
with the parameters used to query solr. Fair enough, but i faced a
problem.
Basically, you can fi
On Dec 15, 2010, at 5:57 PM, Sam Lai wrote:
> If you're using MySQL, Django can interface with its FTS component -
> http://docs.djangoproject.com/en/dev/ref/models/querysets/#search
PostgreSQL also has a very good built-in full text search function. You'll
need to write a tiny bit of raw SQL,
On 16 December 2010 08:56, marcoarreguin wrote:
> I'm trying to make a search engine with my database, parsing de text
> that the user write in the textbox to make a list with the cleaned
> words, in just one table of the DB in the fields: title, descripcion
> and tags, I have so
I'm trying to make a search engine with my database, parsing de text
that the user write in the textbox to make a list with the cleaned
words, in just one table of the DB in the fields: title, descripcion
and tags, I have something like this but I don't know how to finish
it:
from d
I'm trying to make a search engine with my database, parsing de text
that the user write in the textbox to make a list with the cleaned
words, in just one table of the DB in the fields: title, descripcion
and tags, I have something like this but I don't know how to finish
it:
from d
cool.
Glad to hear it solved your problem.
On Jun 30, 12:07 pm, Olivier wrote:
> I've integrated it and it seems to work fine.
> If people are interested in an example of localeurl, you can
> checkwww.spiderchallenge.com(just switch language at the bottom of the
> sidebar)
> We will see if goog
I've integrated it and it seems to work fine.
If people are interested in an example of localeurl, you can check
www.spiderchallenge.com (just switch language at the bottom of the
sidebar)
We will see if google like it, it mights take some time but my
sitemap.xml is ready ;)
Thanks for the help,
Thanks Miguel,
It seems that it does what I want, I will try it !
I'm using django on Google App Engine (with app engine patch) which
use differents data models, do you think it will still work ?
Cheers,
Olivier
On 24 juin, 12:30, Kenneth Gonsalves wrote:
> On Wednesday 24 June 2009 13:56:49 M
On Wednesday 24 June 2009 13:56:49 Miguel Rodriguez wrote:
> You can check an example of how your urls will look once is
> implemented in here: http:\\jaratech.com
the '\\' did not get converted to '//' ;-)
--
regards
kg
http://lawgon.livejournal.com
--~--~-~--~~~---
m, Olivier wrote:
> Thanks yml.
> The middleware part interests me a lot but I don't understand how the
> code work in your post.
> Do you use Django's LocaleMiddleware ? Where do you add the
> language_code in the url ?
> Finally, does it work with search engine indexin
Thanks yml.
The middleware part interests me a lot but I don't understand how the
code work in your post.
Do you use Django's LocaleMiddleware ? Where do you add the
language_code in the url ?
Finally, does it work with search engine indexing ? Because you still
need to change langu
This is the motivation for me to write this piece of middleware :
http://yml-blog.blogspot.com/search/label/Internationalisation
--yml
On Jun 22, 5:52 pm, Olivier wrote:
> Hello everyone,
>
> I'm currently using django localization on my site to manage both
> english and french. I'm using templa
Hello everyone,
I'm currently using django localization on my site to manage both
english and french. I'm using template tags blocktrans and block but
both the french & english pages have the same url. I'm wondering if
the search engines can work with this configuration and index the two
versions
from spelling mistakes?
will methods of django-tagging (like the one used for retrieving
related objects based on shared tags) have to be reimplemented with
the syntax of the search engine?
and last, if I have two fields to be indexed by the search engine (say
"tags" and "description&q
On 2 май, 05:40, Eric <[EMAIL PROTECTED]> wrote:
> The beauty for using a search engine is you can do tag unions as easy
> as tag:python OR tag:django
>
> or a tag intercection as:
> tag:python AND tag:django
>
> and you can do:
> tag:python AND tag:django A
I was experimenting with that very thing just now. Doing tagging in a
sql database can get pretty expensive quick.
I was experimenting with pysolr and solr. Solr is a enterprise search
engine server . Solr is a little more work than to get set up than us
pythonistas are used to, but it's
of implementing what is basically the search engine
via the tagging application
2. the weakness which derives from having to spell correctly a tag or
a set of tags in order to find the right products.
On the other hand the django-tagging application gives me the
possibility of, for example, getting
Better would mean something beyond full-text features that are built
in mysql (MATCH AGAINST or LIKE). Perhaps an engine that also supports
logical operators (in, or, without...), one-line searches etc.
As for Sphenix, real time indexing is a big issue and a drawback. But
I think that it should b
Malcolm Tredinnick napisał(a):
>> Is there any
>> other way to implement advanced searching (better than Q search that
>> is) that is better documented?
>
> What does "better" mean here? There are lots of ways to search over
> database tables, but they all carry trade-offs. Either the API if mo
On Sun, 2007-12-23 at 05:37 -0800, maco wrote:
> Yes, I've seen that, thanks anyway.
>
> I've been googling for the past few days on this topic and I'm amazed
> that there is so little info about Sphenix on Django.
Why are you amazed? It's not something that everybody is going to want
to do and
rs
m
On 22 dec., 05:47, Malcolm Tredinnick <[EMAIL PROTECTED]>
wrote:
> On Fri, 2007-12-21 at 14:36 -0800, maco wrote:
> > Can someone please write a quick-start for this search engine on
> > Django. I've already set up django app and sphinix search engine in a
> >
On Fri, 2007-12-21 at 14:36 -0800, maco wrote:
> Can someone please write a quick-start for this search engine on
> Django. I've already set up django app and sphinix search engine in a
> shell. There are some basic instructions in the snippets, but are not
> that self explanato
Can someone please write a quick-start for this search engine on
Django. I've already set up django app and sphinix search engine in a
shell. There are some basic instructions in the snippets, but are not
that self explanatory to a noob like me :(
I got lost with how to implement this i
I am Only Search Engine Optimizations (SEO) Expert/Specialist at
Karachi in Pakistan that put your Business Profile with your Website
link (URL) and/or Business Ad on TOP-10 Ranking/Positions in Google,
Yahoo and/or MSN in 1-to-3 Months. For more Details and ORDER Now
Please Call/SMS at 0333
http://www.freemp3sky.com
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send email to django-users@googlegroups.com
To unsubscribe from this group, send email to [EMAIL
http://www.freemp3sky.com
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send email to django-users@googlegroups.com
To unsubscribe from this group, send email to [EMAIL
http://www.teenwag.com/search?q=%09+Antonella+Barba&btn=Search
http://www.teenwag.com/search?q=%09+Anna+Nicole+smith&btn=Search
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this
Using the brand spanking new Google Co-op Custom Search Engine tool,
I've created a Django-specific search engine.
http://www.google.com/coop/cse?cx=014511893357231986968%3Agstwyqkcqj0
It prioritises a bunch of Django sites, the main site, the code site
and all of the sites mentioned o
PROTECTED]
> wrote:> Hi Enquest,Enquest wrote:>
> How hard is it to set up a search engine with
Django?Easy! Just search the model documentation for
'search_fields'. That> is, the admin interface has this feature built in, you just need to tell> it which fields you want
For www.paradondevamos.com (in construction!) I integrate PyLucene... I
test in local machine for 3000+ pages and is good enough for me. None
of the integrated full-text on any Sql server in town can match the
performance and in the case of Lucene, flexibility of a dedicate tool
for the task.
The
am, Eric Walstad <[EMAIL PROTECTED]> wrote:
> Hi Enquest,Enquest wrote:
> > How hard is it to set up a search engine with Django?Easy! Just search the
> > model documentation for 'search_fields'. That
> is, the admin interface has this feature built in, you j
Hi Enquest,
Enquest wrote:
> How hard is it to set up a search engine with Django?
Easy! Just search the model documentation for 'search_fields'. That
is, the admin interface has this feature built in, you just need to tell
it which fields you want searched.
> In PHP I
How hard is it to set up a search engine with Django?
In PHP I used to explode, implode all words of an insert, update. Each
word I would put in to a table words and an other tabel that referred to
the words and id of where it came. You know the drill.
In my own little failed framework in php I
I've been using the SOAP way in PHP. This web_search module is so
simple so I've used it to make some tutorials. It can search in few
engines and dmoz so it could be usefull sometimes.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to t
On 8/14/06, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
>
> I've just finished a tutorial about a simple google front end in
> Django.
> read it on the wiki: http://code.djangoproject.com/wiki/searchengine
Hi. Interesting stuff.
I've done a bit of Google hacking myself and I'd caution against
I've just finished a tutorial about a simple google front end in
Django.
read it on the wiki: http://code.djangoproject.com/wiki/searchengine
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To
Kevin, that's great, thanks for the explanation.
as an aside, I'm running under OSX so no idea about Windows I'm afraid.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group,
I run django (and Swish-E) under linux so I can't provide any advise on
how to compile it for windows.
I do run swish-e with the -S prog option and I wrote a python script
that reads all of the models from the database and writes out xml
(actually html) that corresponds with the values that I'm i
Antonio Cavedoni wrote:
> > I'm about to release a pure-Python full-text indexer and search
> > engine called Dolphy.
> Well, I would cast a decided +1 for the Unicode/UTF-8 support. Care
> to elaborate on why it's going to be so hard to have it in the 1.0
> r
Hi Tom,
On 26 Jul 2006, at 1:22, Tom Dyson wrote:
> I'm about to release a pure-Python full-text indexer and search
> engine called Dolphy.
I think your message got kind of lost in the thread, but wow, I’m
*so* looking forward to see Dolphy!
> If you're interested in t
Hello Kevin:
The environment used is Windows? If yes, how did you compiled to use
with python?
Thanks!!!
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send email to dja
Hi Kevin (great name!),
Are you able to share more about how you create the index in the first
place? I'm assuming you used swish-e's -S prog option and perhaps a
custom python script? I'm quite new to python and django, so any hints
gratefully received..
--~--~-~--~~~--
I'm about to release a pure-Python full-text indexer and search engine
called Dolphy. My main goals for Dolphy are query performance and
convenient integration with Django and other Python web applications.
The current feature set includes:
* Stemming ('societies' matches 'so
On the recommendation that ljworld uses swish-e [1], I incorporated
that into my django powered site. The Python interface I use is [2].
Here's the code my search view uses:
handle = SwishE.new(SEARCH_INDEX_FILE)
results = handle.query(terms)
ids = [int(x.getproperty('swishdocpath')) for x in
Wade Leftwich wrote:
> Solr does look good. I'm checking it out along with NXLucene
> (http://www.cps-project.org/sections/projects/nxlucene) , which is a
> similar architecture (search server with an XML API), built with
> pyLucene and Twisted.
From A Zope World Perspective NXLucene looks good
[EMAIL PROTECTED] wrote:
> pyLucene: no docs, SWIG/Java like api (not nice)
quote from pylucene's page:
As of release 2.0, SWIG is no longer used. The Python wrapper objects
are implemented by hand using the Python C Type System for better
integration with Python and for faster C++/Java access.
It would be nice if it could be more native, but a qick solution would
be to use pdf2html and wvHtml and then parse the results. That's what
most other people do.
Alan Trick
On Mon, 2006-07-24 at 06:14 -0700, Vizcayno wrote:
> It was the third I explored also, I made a question in the mailing
>
Rik
But Xapwrap depends on pyLucene to work. I really would like an
integrated solution, such as Django is.
I continue with my pilgrimage.
Many thanks really.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django
Hi Wade:
Thanks for the information. Do not have the sensation that nxlucene is
an isolated effort? isn't it better to join forces with pyLucene?
Do you think this solution would apply to Django?
Thanks again!!
--~--~-~--~~~---~--~~
You received this message becau
Solr does look good. I'm checking it out along with NXLucene
(http://www.cps-project.org/sections/projects/nxlucene) , which is a
similar architecture (search server with an XML API), built with
pyLucene and Twisted.
-- Wade Leftwich
Ithaca, NY
--~--~-~--~~~---~--~--
pyLucene: no docs, SWIG/Java like api (not nice)
divmod Xapwrap: pythonish api for Xapian -> Lucene, pooor docs
hype: SVN only, no docs (?)
postgresql: tsearch2, open-fts: old releases
I'm testing Xapwrap now :)
--~--~-~--~~~---~--~~
You received this message bec
Nkeric:
I am evaluating this option now. It seems to be the only one and good
alternative for pyhton.
Best regards.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send e
It was the third I explored also, I made a question in the mailing
list, it is pending of answer. I want to know if the tool can index and
search over .doc files and .pdf files. By now, seems it only works on
.txt, .html and other format that is characteristic of hyperestraier.
Thanks for your att
gt; I was looking for some good open software Search Engine API (index and
> search) for Python in Win32. I could see some promising ones but, as
> always in the open soft. community, many atomised and incomplete
> efforts. The last I looked was Swish-e which does not have a .dll API,
> its A
what about pylucene?
http://pylucene.osafoundation.org/
we're using it for indexing our site & searching :)
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send email t
SolR http://incubator.apache.org/projects/solrmight be worth a look.. I think there is a python interface for it.regardsIan.On 24/07/2006, at 1:08 PM, Vizcayno wrote:Hi:Do your have news about the promising MerQuery?I was looking for some good open software Search Engine API (index andsearch) for
Hi:
Do your have news about the promising MerQuery?
I was looking for some good open software Search Engine API (index and
search) for Python in Win32. I could see some promising ones but, as
always in the open soft. community, many atomised and incomplete
efforts. The last I looked was Swish-e
Seekpire earn money searching
Earn $0.01 for each search !!!
How can I make money searching?
Want to make easy money? Well this is how. Seekpire pays you to search!
For each
search that you do you get 1 cent. This may not seem like much. But
think of all
the times you search a day! If you use t
>Thanx for the link!!! However, it seems like I cannot search across
>different models even if they have the same attributes that I want
>to search.
My abstract searching stuff (Ian gave the link) does allow searching
over different models - you just add multiple search definitions. The
model
On 9/1/05, Rachel Willmer <[EMAIL PROTECTED]> wrote:
> To help me get to grips with Django quickly, I created a search engine
> of the documentation.
>
> On the off-chance this is useful to others, I've made it available at
> <http://www.hobthross.com/docs/djan
To help me get to grips with Django quickly, I created a search engine
of the documentation.
On the off-chance this is useful to others, I've made it available at
<http://www.hobthross.com/docs/django/phpdig/search.php>
Comments, brickbats, etc welcome...
Rachel
80 matches
Mail list logo
