[R] Correlation of huge matrix saved as binary file

2012-03-02 Thread Bryo
Hi, I have a 900,000,000*9,000 matrix where I need to calculate the correlation between all entries along the smaller dimension, thus creating a 9k*9k correlation matrix. This matrix is too big to be uploaded in R, and is saved as a binary file. To access the data in the file I use mmap and some a

[R] Selecting a subsample so that it follows a distribution.

2011-03-02 Thread Bryo
ion of values that this permutation gives in NOT equal to the distr of significant genes, but a lot narrower. Simple because my method assumes a uniform distribution of values to chose from. Sorry if this was a complicated message, I would highly appreciate any help or comments! Best, Bryo