Re: Finding size of Variable

2014-02-05 Thread Ayushi Dalmia
On Wednesday, February 5, 2014 7:13:34 PM UTC+5:30, Dave Angel wrote: > Ayushi Dalmia Wrote in message: > > > On Wednesday, February 5, 2014 12:59:46 AM UTC+5:30, Tim Chase wrote: > > >> On 2014-02-04 14:21, Dave Angel wrote: > > >> > > >> >

Re: Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
On Wednesday, February 5, 2014 11:15:09 AM UTC+5:30, Rustom Mody wrote: > On Wednesday, February 5, 2014 11:05:05 AM UTC+5:30, Ayushi Dalmia wrote: > > > This also doesn't gives the true size. I did the following: > > > > > import sys > > >

Re: Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
On Wednesday, February 5, 2014 12:59:46 AM UTC+5:30, Tim Chase wrote: > On 2014-02-04 14:21, Dave Angel wrote: > > > To get the "total" size of a list of strings, try (untested): > > > > > > a = sys.getsizeof (mylist ) > > > for item in mylist: > > > a += sys.getsizeof (item) > > > >

Re: Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
On Wednesday, February 5, 2014 12:51:31 AM UTC+5:30, Dave Angel wrote: > Ayushi Dalmia Wrote in message: > > > > > > > > Where am I going wrong? What are the alternatives I can try? > > > > You've rejected all the alternatives so far witho

Re: Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
On Tuesday, February 4, 2014 7:36:48 PM UTC+5:30, Dennis Lee Bieber wrote: > On Tue, 4 Feb 2014 05:19:48 -0800 (PST), Ayushi Dalmia > > declaimed the following: > > > > > > >I need to chunk out the outputs otherwise it will give Memory Error. I need > >t

Re: Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
On Tuesday, February 4, 2014 6:23:19 PM UTC+5:30, Asaf Las wrote: > On Tuesday, February 4, 2014 2:43:21 PM UTC+2, Ayushi Dalmia wrote: > > > > > > As I said, I need to merge large files and I cannot afford more I/O > > > operations. So in order to minimise the

Re: Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
On Tuesday, February 4, 2014 6:39:00 PM UTC+5:30, Dave Angel wrote: > Ayushi Dalmia Wrote in message: > > > > >> getsizeof() gives you the size of the list only; to complete the picture > >> you > > >> > > >> have to add the sizes of

Re: Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
On Tuesday, February 4, 2014 5:10:25 PM UTC+5:30, Peter Otten wrote: > Ayushi Dalmia wrote: > > > > > I have 10 files and I need to merge them (using K way merging). The size > > > of each file is around 200 MB. Now suppose I am keeping the merged data in > >

Re: fseek In Compressed Files

2014-02-04 Thread Ayushi Dalmia
On Tuesday, February 4, 2014 2:27:38 AM UTC+5:30, Dave Angel wrote: > Ayushi Dalmia Wrote in message: > > > On Thursday, January 30, 2014 4:20:26 PM UTC+5:30, Ayushi Dalmia wrote: > > >> Hello, > > >> > > >> > > >> > > &g

Finding size of Variable

2014-02-04 Thread Ayushi Dalmia
Hello, I have 10 files and I need to merge them (using K way merging). The size of each file is around 200 MB. Now suppose I am keeping the merged data in a variable named mergedData, I had thought of checking the size of mergedData using sys.getsizeof() but it somehow doesn't gives the actual

Re: fseek In Compressed Files

2014-01-31 Thread Ayushi Dalmia
On Friday, January 31, 2014 12:16:59 AM UTC+5:30, Dave Angel wrote: > Ayushi Dalmia Wrote in message: > > > On Thursday, January 30, 2014 4:20:26 PM UTC+5:30, Ayushi Dalmia wrote: > > >> Hello, > > >> > > >> > > >> > > &g

Re: fseek In Compressed Files

2014-01-31 Thread Ayushi Dalmia
On Thursday, January 30, 2014 9:51:28 PM UTC+5:30, Peter Otten wrote: > Serhiy Storchaka wrote: > > > > > 30.01.14 13:28, Peter Otten написав(ла): > > >> Ayushi Dalmia wrote: > > >> > > >>> I need to randomly access a bzip2 or gzip fil

Re: fseek In Compressed Files

2014-01-30 Thread Ayushi Dalmia
On Thursday, January 30, 2014 4:20:26 PM UTC+5:30, Ayushi Dalmia wrote: > Hello, > > > > I need to randomly access a bzip2 or gzip file. How can I set the offset for > a line and later retreive the line from the file using the offset. Pointers > in this direction w

Re: fseek In Compressed Files

2014-01-30 Thread Ayushi Dalmia
On Thursday, January 30, 2014 4:20:26 PM UTC+5:30, Ayushi Dalmia wrote: > Hello, > > > > I need to randomly access a bzip2 or gzip file. How can I set the offset for > a line and later retreive the line from the file using the offset. Pointers > in this direction will

fseek In Compressed Files

2014-01-30 Thread Ayushi Dalmia
Hello, I need to randomly access a bzip2 or gzip file. How can I set the offset for a line and later retreive the line from the file using the offset. Pointers in this direction will help. -- https://mail.python.org/mailman/listinfo/python-list

Re: Large Two Dimensional Array

2014-01-28 Thread Ayushi Dalmia
On Wednesday, January 29, 2014 10:55:54 AM UTC+5:30, Ayushi Dalmia wrote: > Hello, > > > > I am trying to implement IBM Model 1. In that I need to create a matrix of > 5*5 with double values. Currently I am using dict of dict but it is > unable to support suc

Re: Large Two Dimensional Array

2014-01-28 Thread Ayushi Dalmia
On Wednesday, January 29, 2014 10:55:54 AM UTC+5:30, Ayushi Dalmia wrote: > Hello, > > > > I am trying to implement IBM Model 1. In that I need to create a matrix of > 5*5 with double values. Currently I am using dict of dict but it is > unable to support suc

Large Two Dimensional Array

2014-01-28 Thread Ayushi Dalmia
Hello, I am trying to implement IBM Model 1. In that I need to create a matrix of 5*5 with double values. Currently I am using dict of dict but it is unable to support such high dimensions and hence gives memory error. Any help in this regard will be useful. I understand that I cannot s

Re: Initialise dictionary of dictionary

2014-01-23 Thread Ayushi Dalmia
Thank you so much Tim. This is precisely what I wanted to do! On Thursday, January 23, 2014 9:00:23 PM UTC+5:30, Tim Chase wrote: > On 2014-01-23 07:15, Ayushi Dalmia wrote: > > > I need to initialise a dictionary of dictionary with float values. > > > I do not know the s

Initialise dictionary of dictionary

2014-01-23 Thread Ayushi Dalmia
I need to initialise a dictionary of dictionary with float values. I do not know the size of the dictionary beforehand. How can we do that in Python -- https://mail.python.org/mailman/listinfo/python-list

Re: Python Fast I/o

2014-01-14 Thread Ayushi Dalmia
On Tuesday, January 14, 2014 7:33:08 PM UTC+5:30, Chris Angelico wrote: > On Wed, Jan 15, 2014 at 12:50 AM, Ayushi Dalmia > > wrote: > > > I need to write into a file for a project which will be evaluated on the > > basis of time. What is the fastest way to write 200

Python Fast I/o

2014-01-14 Thread Ayushi Dalmia
I need to write into a file for a project which will be evaluated on the basis of time. What is the fastest way to write 200 Mb of data, accumulated as a list into a file. Presently I am using this: with open('index.txt','w') as f: f.write("".join(data)) f.close() where data is a l