> But a csv.DictReader might still be more efficient.
Depends on what efficiency you care about. The DictReader class is
implemented in Python, and builds a dict for every row. It will never
be more efficient CPU-wise than instantiating the csv.reader type
directly and only doing what you need.
OTOH, the DictReader class "just works" and its usage is more obvious
when you come back later to modify your code. It also makes the code
insensitive to column ordering (though yours seems to be as well, if
I'm reading it correctly). On the programmer efficiency axis, I score
the DictReader class higher than the reader type.
A simple test:
##########################
import csv
from timeit import Timer
setup = '''import csv
lst = ["""a,b,c,d,e,f,g"""]
lst.extend(["""05:38:24,0.6326,1,0,1.0,0.0,0.0"""] * 1000000)
reader = csv.reader(lst)
dreader = csv.DictReader(lst)
'''
t1 = Timer("for row in reader: pass", setup)
t2 = Timer("for row in dreader: pass", setup)
print(min(t1.repeat(number=10)))
print(min(t2.repeat(number=10)))
###############################
demonstrates that the raw reader is, indeed, much faster than the DictReader:
0.972723007202
8.29047989845
but that's for the basic iteration. Whatever you need to add to the
raw reader to insulate yourself from changes to the structure of the
CSV file and improve readability will slow it down, while the
DictReader will never be worse than the above.
Skip
--
http://mail.python.org/mailman/listinfo/python-list
