Re: crawlers in python with graphing?

2006-06-20 Thread gene tani
bryan rasmussen wrote: > Hi, > > Sorry, was imprecise, I meant not save the downloaded page locally. > There probably isn't one though, so I should build one myself. > Probably just need a good crawler that can be set to dump all links > into dataset that I can analyse with R. > > Cheers, > Bryan

Re: search engine

2006-06-24 Thread gene tani
George Sakkis wrote: > vinodh kumar wrote: > > hai all, > > i am student of computer science dept. i have planned to > > design a search engine in python. i am seeking info about how to > > proceed further. > > i need to know what r the modules that can be used. > > There is not

Re: python guru in the Bay Area

2006-07-01 Thread gene tani
bruce wrote: > hi... > > is there someone in the Bay Area who knows python, that I can talk to ... I > have the shell of a real basic app, and I'd like someone who can walk me > through how to set it up. > > i'm talking about passing arrays, setting up global data, etc... basically, > if i can cre

Re: first book about python

2006-07-09 Thread gene tani
IOANNIS MANOLOUDIS wrote: > I want to learn python. > I plan to buy a book. I always find printed material more convenient than > reading on-line tutorials. > I don't know PERL or any other scripting language. I only know some BASH > programming. I am looking for a book which will help me get star

Re: RegexBuddy (anyone use this?)

2006-09-16 Thread gene tani
[EMAIL PROTECTED] wrote: > vbgunz wrote: > > > > Has anyone tried this thing.. > > > > http://www.regular-expressions.info/regexbuddy.html > > > > I use kodos http://kodos.sourceforge.net/. I firmly agree using a tool > > like this to learn regular expressions will not only save you a > > ridiculo

Re: Sort by domain name?

2006-10-02 Thread gene tani
Paul Rubin wrote: > "js " <[EMAIL PROTECTED]> writes: > > Here, domain name doesn't contain subdomain, > > or should I say, domain's part of 'www', mail, news and en should be > > excluded. > > It's a little more complicated, you have to treat co.uk about > the same way as .com, and similarly for

Re: Find directory name of file?

2006-01-30 Thread gene tani
ngw wrote: > > Try os.path.dirname (__file__) > what O/S and python release are you using? I get NameError: '__file__' not defined in win32 and OS X (both are 2.4.x, installed from ActiveState installers) -- http://mail.python.org/mailman/listinfo/python-list

Re: Fuzzy Lookups

2006-01-30 Thread gene tani
BBands wrote: > Diez B. Roggisch wrote: > > I did a levenshtein-fuzzy-search myself, however I enhanced my version by > > normalizing the distance the following way: > > Thanks for the snippet. I agree that normalizing is important. A > distance of three is one thing when your strings are long, bu

Re: Compiling

2006-02-05 Thread gene tani
Simon Faulkner wrote: > Pardon me if this has been done to death but I can't find a simple > explanation. > > I love Python for it's ease and speed of development especially for the > "Programming Challenged" like me but why hasn't someone written a > compiler for Python? > > I guess it's not that

Re: Twisted book opinions?

2006-02-09 Thread gene tani
Matt Goodall wrote: > Jay Parlar wrote: > > I was hoping to get some c.l.p. opinions on O'Reilly's new Twisted book. > > I think it's a good book to get. I know a fair amount about Twisted but > it still made for interesting reading. > > Tommi Virtanen (aka tv) posted a great review of the book sh

Re: Test indexers...how do they work?

2006-02-09 Thread gene tani
Raja Raman Sundararajan wrote: > Hello guys, > I was investigating how one can use the "text indexers" in python > and I stumbled across several ones. eg., pylucene > > I wanted to know how the algorithm of indexers look like. I have heard > people talking about B-Trees. But this info. is simp

Re: Is Python good for web crawlers?

2006-02-10 Thread gene tani
Paul Rubin wrote: > Xavier Morel <[EMAIL PROTECTED]> writes: > > BeautifulSoup... > > The API of the package is extremely simple, straightforward and... obvious. > > I did not find that. I spent a few minutes looking at the > documentation and it wasn't obvious at all how to use it. Maybe I 1.

Re: Is there any books such as 'effective python' or else about the performance?

2006-02-12 Thread gene tani
Kenneth Xie wrote: > att, thx. Start here. http://www.python.org/moin/PythonSpeed/PerformanceTips http://trific.ath.cx/resources/python/optimization/ -- http://mail.python.org/mailman/listinfo/python-list

Re: Tracking down memory leaks?

2006-02-12 Thread gene tani
[EMAIL PROTECTED] wrote: > MKoool wrote: > > I have an application with one function called "compute", which given a > > filename, goes through that file and performs various statistical > > analyses. It uses arrays extensively and loops alot. it prints the > > results of it's statistical signif

Re: hard disk activity

2006-02-13 Thread gene tani
VSmirk wrote: > I'm working primarily on Windows XP, but my solution needs to be cross > platform. > > The problem is that I need more than the fact that a file has been > modified. I need to know what has been modified in that file. > > I am needing to synchronize the file on a remote folder, an

Re: web crawler in python or C?

2006-02-16 Thread gene tani
Paul Rubin wrote: > "abhinav" <[EMAIL PROTECTED]> writes: > > maintaining huge data structures.What should be the language so as > > not to compromise that much on speed.What is the performance of > > python based crawlers vs C based crawlers.Should I use both the > > languages(partly C and pytho

Re: web crawler in python or C?

2006-02-16 Thread gene tani
abhinav wrote: > Hi guys.I have to implement a topical crawler as a part of my > project.What language should i implement Oh, and there's some really good books out there, besides the Orilly Spidering Hacks. Springer Verlag has a couple books on "Text Mining" and at least a couple books with "we

Re: Safe Python Execution

2006-02-16 Thread gene tani
Jean-Paul Calderone wrote: > On Thu, 16 Feb 2006 07:59:03 -0800, Alex Martelli <[EMAIL PROTECTED]> wrote: > >Graham <[EMAIL PROTECTED]> wrote: > > > >> I've been messing around with trying to get a small sandbox like > >> environment where i could execute python code in a "safe" way. > >> Basicall

Re: Python vs. Lisp -- please explain

2006-02-18 Thread gene tani
[EMAIL PROTECTED] wrote: > > I'm wondering if someone can explain to me please what it is about > Python that is so different from Lisp that it can't be compiled into > something as fast as compiled Lisp? From this above website and > others, I've learned that compiled Lisp can be nearly as fast

Re: Augmented assignment

2006-02-21 Thread gene tani
Terry Hancock wrote: > On Tue, 21 Feb 2006 10:55:42 +0530 > Suresh Jeevanandam <[EMAIL PROTECTED]> wrote: > Seriously, > I think they are usually equivalent internally, > at least for immutable objects. > yah, but when you do augmented assigns on lists, or mix immutable an dmutable: http://zeph

Re: deriving from float or int

2006-02-21 Thread gene tani
Russ wrote: > Does it ever make sense to derive a class from a basic type such as > float or int? Suppose, for example, that I want to create a class for > physical scalars with units. I thought about deriving from float, then > adding the units. I played around with it a bit, but it doesn't seem

Re: That's really high-level: bits of beautiful python

2006-02-22 Thread gene tani
Jeffrey Schwab wrote: > Max wrote: > > I was just thinking perhaps we should create some kind of collection of > > bits of "impressive" code like this. > > Do you mean something like the ASPN Cookbooks? > > http://aspn.activestate.com/ASPN/Cookbook/ > repositories, indexes and search engine

Re: regular expresson for Unix and Dos Lineendings wanted

2006-02-23 Thread gene tani
Franz Steinhaeusler wrote: > Hello, I need a regularexpression, which trims trailing whitespaces. > > While with unix line endings, it works; > but not with Window (Dos) CRLF's: > > >>> import re > >>> retrailingwhitespace = re.compile('(?<=\S)[ \t]+$', re.MULTILINE) > > 1) Windows > >>> r="erewr

Re: regular expresson for Unix and Dos Lineendings wanted

2006-02-23 Thread gene tani
gene tani wrote: > Franz Steinhaeusler wrote: > > > > Who can help me (regular expression, which works for both cases). > > universal newlines: > http://www.python.org/doc/2.3.3/whatsnew/node7.html > http://mail.python.org/pipermail/python-list/2006-February/324410.ht

Re: Python Indentation Problems

2006-02-26 Thread gene tani
[EMAIL PROTECTED] wrote: > I am a newbie to Python. I am mainly using Eric as the IDE for coding. > Also, using VIM and gedit sometimes. > > I had this wierd problem of indentation. My code was 100% right but it > wont run because indentation was not right. I checked time and again > but still no

Re: do design patterns still apply with Python?

2006-03-02 Thread gene tani
Terry Hancock wrote: > > This sounds like an article crying out to be written, > "(Learning) Design Patterns with Python". > > Has it been written already? > > Cheers, > Terry > > -- > Terry Hancock ([EMAIL PROTECTED]) > Anansi Spaceworks http://www.AnansiSpaceworks.com There's a couple Alex M sl

Re: Papers on Dynamic Languages

2006-03-05 Thread gene tani
Jay Parlar wrote: > > All that looks fantastic, and I'd forgotten there was a paper on > Shedskin. > > Thanks a bunch, > Jay P. lots of spirited discussion at artima http://www.artima.com/forums/flat.jsp?forum=106&thread=7590 http://c2.com/cgi/wiki?DuckTyping http://lambda-the-ultimate.org/node/

Re: Simulation Programming Skills and Python

2006-03-06 Thread gene tani
Richard Blackwood wrote: > Hello all. I have a few questions about simulation programming. One, do > all programmers know to how to code a simulation? By simulation I mean a > model of real world relationships (i.e. like Civilization which is a > simulation of ruling nations through various histor

Re: automatic referencing for variables?

2006-03-06 Thread gene tani
[EMAIL PROTECTED] wrote: > i am SURE i am using the wrong terminology... > > but what i would like to do is something like this: > > pageContent=''' > {toc} > h1. Header Section > h2. Date: > {metadata:date}'''+date+'''{metatdata} > h2. Author: > {metadata:author}Len Sweet{metadata} > h1.

Re: Fetch info from website and write to txt file.

2006-03-06 Thread gene tani
Pitmairen wrote: > I want to make a program that get info from a website and prints it out > in a txt file. > > I made this: > > import urllib > f = urllib.urlopen("http://www.imdb.com/title/tt0407304/";) > s = f.read() > k = open("test.txt","w") > k.write(s) > k.close() > f.close() > > That saves

Re: Fetch info from website and write to txt file.

2006-03-06 Thread gene tani
Pitmairen wrote: > I want to make a program that get info from a website and prints it out > in a txt file. > > I made this: > > import urllib > f = urllib.urlopen("http://www.imdb.com/title/tt0407304/";) path of even less resistance http://imdbpy.sourceforge.net/ -- http://mail.python.org/mail

Re: OOPS concept

2005-05-05 Thread gene . tani
Chapter 5, Python in Nutshell: concise explanations of everythin' you need to know about inheritance, instantiation, method resolution, namespaces, class/instance methods, getting under the hood with special methods, whatever. I couldn't code without it: http://www.oreilly.com/catalog/pythonian/

Re: A Faster Way...

2005-05-10 Thread gene . tani
hmm, there's lots of ways, huh? you can use itertools.zip instead of builtin zip, or do: map(None, list1, list2) , which will pad the shorter one to match the longer one. -- http://mail.python.org/mailman/listinfo/python-list

Re: Parsing text into dates?

2005-05-16 Thread gene . tani
The beautiful brand new cookbook2 has "Fuzzy parsing of Dates" using dateutil.parser, which you run once you have a decent guess at locale (page 127 of cookbook) John Roth wrote: > "Thomas W" <[EMAIL PROTECTED]> wrote in message > news:[EMAIL PROTECTED] > > I'm developing a web-application where t

Re: easiest way to split a list into evenly divisble smaller lists, and assign them to variables?

2005-06-06 Thread gene tani
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/303279 http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/347689 http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/303060 OR: collections.deque: http://python.org/doc/2.4/lib/deque-recipes.html flamesrock wrote: > hmmm..that m

Re: Question about Object Oriented + functions/global vars?

2005-06-06 Thread gene tani
#include canonical design pattern advice longjmp(Borders or other_big_chain_bookstore) opt1=fopen("Oreilly's Head first design pattern","r") opt2=fopen("design patterns book by Shalloway and trott (i think that's their names)","r") another=poll("any other intro to DP books that people like?")

Re: Pythonic Gotchas

2005-06-06 Thread gene tani
or Norvig's IAQ: http://www.norvig.com/python-iaq.html -- http://mail.python.org/mailman/listinfo/python-list

Re: split up a list by condition?

2005-06-06 Thread gene tani
Sounds like itertools.groupby() is what you're looking for, just sort your sequence on the grouping func that you will pass as 2nd arg to groupby(), before you pass the sequence to groupby() http://www.python.org/doc/2.4/whatsnew/node13.html http://www.python.org/dev/doc/devel/lib/itertools-functi

Re: Did you read about that?

2007-05-06 Thread gene tani
On May 6, 6:26 am, "Martin P. Hellwig" <[EMAIL PROTECTED]> wrote: > Dustan wrote: > > On May 6, 8:20 am, Steven D'Aprano > > <[EMAIL PROTECTED]> wrote: > >> On Sun, 06 May 2007 04:53:23 -0700, Dustan wrote: > >>> SPAM! > >>> SPAM! > >>> SPAM! > >>> SPAM! > >>> SPAM! > >>> SPAM! > >>> SPAM! > >>> SP

Re: Custom Python Runtime

2007-04-08 Thread gene tani
On Apr 6, 4:52 pm, "Jack" <[EMAIL PROTECTED]> wrote: > Since the full installation of Python (from either the standard installer or > ActiveState installer) is too big for my intended use, I'd like to build a > custom distribution of Python for Windows platform, omitting some lib files, > such as a

Re: NLTK, Random Sentence Generators?

2007-04-10 Thread gene tani
On Apr 10, 1:36 am, Passer By <[EMAIL PROTECTED]> wrote: > Has any created or not of examples of random sentence generators using > n-gram models (or other models might be interesting). > > I know of one example from a course at MIT, but besides that nothing. > > Any help would be great. Markov ch

Re: Python certification/training

2006-04-17 Thread gene tani
aum wrote: > > Makes me wonder, just out of curiosity - are there any universities > actually teaching python (in anything bigger than a small elective > module), or are they all still owned by Java, C++, C# and Visual Basic? > like NLTK, maybe? http://www.ldc.upenn.edu/sb/home/papers/nltk.pdf

Re: any update to this?

2006-04-17 Thread gene tani
[EMAIL PROTECTED] wrote: > hi > i was looking at this : > http://www.python.org/doc/essays/comparisons.html > on comparisons of python and other languages? are there any updates to > this doc? or is there > other reliable source for such comparison elsewhere? thanks lots of blogs out there, check

Re: Looking for resources for making the jump from Java to Python easier and more productive

2006-04-24 Thread gene tani
Ant wrote: > Take a look at the newgroup archives over the last week or two - there > seem to have been a glut of people coming from Java to Python and > asking the same sort of questions. There were some links to a bunch of > Python 'gotcha' pages which will be useful. > Here's a few gotchas whi

Re: Coming from delphi - looking for an IDE - willing to spend money

2006-04-24 Thread gene tani
Just call me James wrote: > Hi, > > Coming away from the luxury of the delphi IDE has been something of a > shock. > > As a consequence I've become aware that maybe I need to spend some > money on a python IDE. You can google for lots of IDE reviews, here's a start http://www.awaretek.com/tutori

Re: (was Re: Xah's Edu Corner: Criticism vs Constructive Criticism)

2006-04-26 Thread gene tani
John Bokma wrote: > Roedy Green <[EMAIL PROTECTED]> wrote: > > I leave that up to Xah's ISP/USP and hosting provider to decide :-D > he's solidified position as top troll of 2003-2006 -- http://mail.python.org/mailman/listinfo/python-list

Re: Measure memory usage in Python

2006-04-30 Thread gene tani
Rune Strand wrote: > Is there a way to measure how much memory a data structure use? For > instance, what is the footprint of a particular list object like > [0,1,2,3,4,5,6,7,8,9]? i have a note to try this, but haven't got around to it, if you want to blog/post http://pysizer.8325.org/ -- htt

Re: Measure memory usage in Python

2006-05-01 Thread gene tani
Rune Strand wrote: > gene tani wrote: > > Rune Strand wrote: > > > Is there a way to measure how much memory a data structure use? For > > > instance, what is the footprint of a particular list object like > > > [0,1,2,3,4,5,6,7,8,9]? > > > > i ha

Re: python rounding problem.

2006-05-07 Thread gene tani
Erik Max Francis wrote: > chun ping wang wrote: > > > Hey i have a stupid question. > > > > How do i get python to print the result in only three decimal place... > > > > Example>>> round (2.9954254, 3) > > 2.9951 > > > > but i want to get rid of all trailing 0's..how would i d

Re: How to guess the language of a given textstring?

2006-05-15 Thread gene tani
Roman wrote: > Does anybody know an easy way (or tool) to guess the language of a > given text string? > http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/355807 http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/326576 -- http://mail.python.org/mailman/listinfo/python-list

Re: who can give me the detailed introduction of re modle?

2006-05-19 Thread gene tani
softwindow wrote: > the re module is too large and difficult to study it's powerful, takes a little time to work with. Make yourself aware of the VERBOSE switch, RE debuggers in komodo and Wing, string functions/methods and when you need a full parser, also http://www.awaretek.com/tutorials.htm

Re: Daily python url archives

2006-05-19 Thread gene tani
Bobert wrote: > Hi, > > Do you know by chance if someone has archives from the "daily python url" > feed (http://www.pythonware.com/daily/rss2.xml) ? An archive of the last 3 > or 6 months would be most useful to me. it gets picked up on Swik.net, with a bunch of other stuff: http://swik.net/Pyt

Re: Daily python url archives

2006-05-19 Thread gene tani
gene tani wrote: > Bobert wrote: > > Hi, > > > > Do you know by chance if someone has archives from the "daily python url" > > feed (http://www.pythonware.com/daily/rss2.xml) ? An archive of the last 3 > > or 6 months would be most useful to me. > &g

Re: Can any body help me

2006-05-26 Thread gene tani
satish wrote: > how to write script for these > > 1.Given a test file containing lines of words such as (abc, abb, > abd,abb, etc), write a script that prints, in order of frequency, how > many times each word appears in the file. > > 2. > Write a script running in an endless loop that pings an IP

Re: Why the HELL has nobody answered my question !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

2008-02-01 Thread gene tani
On Jan 30, 4:40 pm, "Blubaugh, David A." <[EMAIL PROTECTED]> wrote: > I do not understand why no one has answered the following question: > > Has anybody worked with Gene Expression Programming > > David Blubaugh > David (may i call you David?) May i suggest you lock your workstation when you

Re: Checking function calls

2006-03-07 Thread gene tani
Roy Smith wrote: > Fredrik Tolf wrote: > >If I have a variable which points to a function, can I check if certain > >argument list matches what the function wants before or when calling it? > > > >Currently, I'm trying to catch a TypeError when calling the function > >(since that is what is rais

Re: Learning different languages

2006-03-07 Thread gene tani
Rich wrote: > Hi, > > (this is a probably a bit OT here, but comp.lang seems rather > desolated, so I'm not sure I would get an answer there. And right now > I'm in the middle of learning Python anyway so...) > > Anyway, my question is: what experience you people have with working > with different

Re: Learning different languages

2006-03-09 Thread gene tani
Harry George wrote: > > re the OP: > > I find I have to concentrate on one language for a while (several > programs) to ramp up on the syntax, semantics, idioms, and libraries. > Then I'm safe to wander off and learn other languages. When it comes > time to do a project, I use one main language u

Re: Python source cross reference doc generator?

2006-03-11 Thread gene tani
Colin J. Williams wrote: > Harry Fuecks wrote: > > Hi All, > > > > Wondering if a tool exists to generate "cross reference" documentation > > for Python code bases? > > > > Particularly after something like phpxref - > > http://phpxref.sourceforge.net/ : written in Perl, scans a bunch of > > PHP s

Re: how to get 20000 html pages content quickly from one server?

2006-03-15 Thread gene tani
JuHui wrote: > Hi > I want to get 20 html pages content from one server, you know > urllib.urlopen need construct network connection, it will be very > slowly, how to speed up this function? > I try to using multi-thread, it speed up, but I want to quickly more, > any idea about it? > Thank

Re: Spidering Hacks for Python, not Perl

2006-03-21 Thread gene tani
Duncan Booth wrote: > Enigma Curry wrote: > > > I've been looking for similar stuff recently. I haven't found much, but > > this is the list of links I've come across so far: > > http://awaretek.com/nowak/mygale.html http://cheeseshop.python.org/pypi/spider.py/0.5 http://sig.levillage.org/?p=599

Re: Spidering Hacks for Python, not Perl

2006-03-21 Thread gene tani
gene tani wrote: > Duncan Booth wrote: > > Enigma Curry wrote: > > a couple more http://cheeseshop.python.org/pypi/Orchid/1.0 http://cheeseshop.python.org/pypi/webstemmer/0.5.0 -- http://mail.python.org/mailman/listinfo/python-list

Re: What's the best way to learn perl for a python programmer?

2006-03-24 Thread gene tani
vj wrote: > I've been given a project which requires writing scripts that need to > be run on over 3000 servers. Only about 15% of them have python > installed on them. While all/most of them will have perl. > > I'll try and do as much as possible in pexpect but am sure I'll have do > some signifi

Re: What's The Best Editor for python

2006-03-25 Thread gene tani
Christoph Zwerschke wrote: > Just because nobody has mentioned them so far: > > - SciTe is a perfect editor for Pyhton on Win and Linx > - PyScripter is a wonderful IDE (but only on Win) > - DrPython is a nice platform independent editor/mini-IDE > http://www.artima.com/forums/flat.jsp?forum=106

Re: What's The Best Editor for python

2006-03-25 Thread gene tani
gene tani wrote: > Christoph Zwerschke wrote: > > Just because nobody has mentioned them so far: > > http://spyced.blogspot.com/2006/02/pycon-python-ide-review.html -- http://mail.python.org/mailman/listinfo/python-list

Re: Parsing csh scripts with python

2006-03-29 Thread gene tani
Dave Benjamin wrote: > On Tue, 28 Mar 2006, David Hirschfield wrote: > > > I need to be able to parse the script, modify some variable settings and > > then write the script back out so that the only changes are the > > variables I've modified (comments, ordering of statements, etc. must > > remai

Re: how to comment lot of lines in python

2006-03-31 Thread gene tani
[EMAIL PROTECTED] wrote: > Like in C we comment like > /* > Bunch of lines of code > */ > scite has a feature where you modify your delimiter in block comments, i.e. what comes after "#" http://scintilla.sourceforge.net/SciTEDoc.html -- http://mail.python.org/mailman/listinfo/python-list

Re: python tutorial: popular/informative Python sites ?

2006-04-01 Thread gene tani
Fredrik Lundh wrote: > the "what now?" page in the tutorial > > to replace it with something else, what should that be? what sites > do pythoneers and pythonistas visit these days? > > post your suggestions in this thread or on this page: > Pilgrims tricks/ips http://diveintopython.org/appendix/t

Re: Dr. Dobb's Python-URL! - weekly Python news and links (Apr 4)

2006-04-04 Thread gene tani
Peter Otten wrote: > The old Python "To-Do List" now lives principally in a > SourceForge reincarnation. > http://sourceforge.net/tracker/?atid=355470&group_id=5470&func=browse > http://python.sourceforge.net/peps/pep-0042.html > Thanks, very nice summary. One thing, the

Re: python on Mac

2006-04-06 Thread gene tani
Lou Pecora wrote: > YIKES! Don't do that. Don't mess with Apple's python. Not > recommended. Check the MacPython FAQ and Wiki pages. Python 2.4 was > installed in /usr/local/bin. You should put that in your $PATH variable > Before /usr/bin. That will cause the new Python to be launched. >

Re: Help for a complete newbie

2006-04-15 Thread gene tani
Ralph H. Stoos Jr. wrote: > Tim, > > After a little more research, I did find that out. It is funny, but in > the tutorial "Non-Programmers Tutorial For Python", it makes no mention > of the indentation issue, at least in the beginning portions which I had > read. > > This is an age old problem o

<    1   2   3