Re: [R] big panel: filehash, bigmemory or other

2010-03-11 Thread Johan Jackson
Hello Eric, If you can do a project like this (that manages huge datasets) in SAS, I'd recommend to just do them in SAS rather than use R. I've sadly come to the conclusion that R isn't very good at working with large datasets, and until the powers that be try to do something about to help users l

[R] big panel: filehash, bigmemory or other

2010-02-22 Thread Eric Fail
Dear R-list I'm on my way to start a new project on a rather big panel, consisting of approximately 8 million observations in 30 waves of data and about 15 variables. I have a similar data set that is approximately 7 gigabytes in size. Until now I have done my data management in SAS, and