Re: [R] Huge data sets and RAM problems

2010-04-22 Thread Stella Pachidi
Dear all, Thank you very much for your replies and help. I will try to work with your suggestions and come back to you if I need something more. Kind regards, Stella Pachidi On Thu, Apr 22, 2010 at 5:30 AM, kMan wrote: > You set records to NULL perhaps (delete, shift up). Perhaps your system is

Re: [R] Huge data sets and RAM problems

2010-04-21 Thread kMan
You set records to NULL perhaps (delete, shift up). Perhaps your system is susceptible to butterflies on the other side of the world. Your code may have 'worked' on a small section of data, but the data used did not include all of the cases needed to fully test your code. So... test your code! sc

Re: [R] Huge data sets and RAM problems

2010-04-20 Thread Jay Emerson
Stella, A few brief words of advice: 1. Work through your code a line at a time, making sure that each is what you would expect. I think some of your later problems are a result of something early not being as expected. For example, if the read.delim() is in fact not giving you what you expect,