Re: [R] compress data on read, decompress on write

2008-02-29 Thread Ramon Diaz-Uriarte
Thanks, Greg. Yes, I'd store the compressed stuff as a raw data type. Best, R. On Thu, Feb 28, 2008 at 11:54 PM, Gregory Warnes <[EMAIL PROTECTED]> wrote: > > You might look at storing the data using R's "raw" data type... > > -G > > > > > On Feb 28, 2008, at 5:38PM , Ramon Diaz-Uriarte wrote

Re: [R] compress data on read, decompress on write

2008-02-28 Thread Gregory Warnes
You might look at storing the data using R's "raw" data type... -G On Feb 28, 2008, at 5:38PM , Ramon Diaz-Uriarte wrote: > Dear Christos, > > Thanks for your reply. Actually, I should have been more careful with > language: its not really a sparse matrix, but rather a ragged array > that resu

Re: [R] compress data on read, decompress on write

2008-02-28 Thread Ramon Diaz-Uriarte
Dear Prof. Ripley, Thanks a lot. I've just looked at Rcompression and it seems to do exactly what I need, though it requires having zlib and bzip2 installed (and I am not sure if this will deter some windows users). I'll also check connections.c, which might be a way to go, or else wait for the re

Re: [R] compress data on read, decompress on write

2008-02-28 Thread Ramon Diaz-Uriarte
Dear Christos, Thanks for your reply. Actually, I should have been more careful with language: its not really a sparse matrix, but rather a ragged array that results from a more compact representation we though of for the hidden states in a Hidden Markov Model in many runs of MCMC. However, it mig

Re: [R] compress data on read, decompress on write

2008-02-28 Thread Prof Brian Ripley
One solution is likely to be the Omegahat package Rcompression. Otherwise, R does have internal facilities to do internal (gzip) compression and decompression (e.g. see the end of src/main/connections.c), and you could make creative use of serialization to do the compression. On Thu, 28 Feb 20

Re: [R] compress data on read, decompress on write

2008-02-28 Thread Christos Hatzis
Ramon, If you are looking for a solution to your specific application (as opposed to a general compression/ decompression mechanism), it might be worth checking out the Matrix package, which has facilities for storing and manipulating sparse matrices. The sparseMatrix class stores matrices in the