Re: [R] Large data and space use

2021-11-28 Thread Avi Gross via R-help
e: [R] Large data and space use If you have enough data that running out of memory is a serious problem, then a language like R or Python or Octave or Matlab that offers you NO control over storage may not be the best choice. You might need to consider Julia or even Rust. However, if you

Re: [R] Large data and space use

2021-11-28 Thread Richard O'Keefe
If you have enough data that running out of memory is a serious problem, then a language like R or Python or Octave or Matlab that offers you NO control over storage may not be the best choice. You might need to consider Julia or even Rust. However, if you have enough data that running out of mem

Re: [R] Large data and space use

2021-11-27 Thread Jeff Newmiller
First priority is to obtain a correct answer. Second priority is to document it and write tests for it. Third priority is to optimize it. Sometimes it is useful to keep intermediate values around to support supplemental calculations ala "summary", that may or may not lead to using rm where you m

[R] Large data and space use

2021-11-27 Thread Avi Gross via R-help
Several recent questions and answers have mad e me look at some code and I realized that some functions may not be great to use when you are dealing with very large amounts of data that may already be getting close to limits of your memory. Does the function you call to do one thing to your object