Re: Memory error due to the huge/huge input file size

2008-11-20 Thread tejsupra
On Nov 10, 4:47 pm, [EMAIL PROTECTED] wrote: > Hello Everyone, > > I need to read a .csv file which has a size of 2.26 GB . And I wrote a > Python script , where I need to read this file. And my Computer has 2 > GB RAM Please see the code as follows: > > """ > This program has been developed to ret

Re: Memory error due to the huge/huge input file size

2008-11-10 Thread John Machin
On Nov 11, 8:47 am, [EMAIL PROTECTED] wrote: > import linecache Why??? > reader2 = csv.reader(open(sys.argv[2],"rb")) > reader2_list = [] > reader2_list.extend(reader2) > > for data2 in reader2_list: >    refSeqIDsinTransPro.append(data2[3]) > for data2 in reader2_list: >    promoterSequencesinT

Re: Memory error due to the huge/huge input file size

2008-11-10 Thread James Mills
On Tue, Nov 11, 2008 at 7:47 AM, <[EMAIL PROTECTED]> wrote: > refSeqIDsinTransPro = [] > promoterSequencesinTransPro = [] > reader2 = csv.reader(open(sys.argv[2],"rb")) > reader2_list = [] > reader2_list.extend(reader2) Without testing, this looks like you're reading the _ENTIRE_ input stream int