Thanks to you all for your replies. I didn't realize bigmemory is only
available in Unix environments - when I saw
> install.packages('bigmemory')
Installing package into C:/Users/BenC/Documents/R/win-library/3.0
(as lib is unspecified)
--- Please select a CRAN mirror for use in this session -
On 29/04/2013 23:46, Benjamin Caldwell wrote:
Dear helpers,
Does anyone have information on the status of bigmemory and R3.0? Will it
just take time for the devs to re-code for the new environment? Or is there
an alternative for this new version?
What are you asking about? 'bigmemory' has bee
On 29 April 2013 at 15:46, Benjamin Caldwell wrote:
| Dear helpers,
|
| Does anyone have information on the status of bigmemory and R3.0? Will it
| just take time for the devs to re-code for the new environment? Or is there
| an alternative for this new version?
It just works, with R 3.0.0 and o
OK, did a test where I did both - wrote a ~6Mx58 double matrix as a .txt file
(write.big.matrix), but also left the backing file + descriptor file as-is
(rather than deleting it as I usually do). Opened a different R session.
Compared contents of first 100 rows of both, they seem identical.
Size-wi
Hi Allie,
When you are working with the ff package, the counterpart of a data.frame is
called an ffdf (ff data frame). It can handle the types you are talking
about - factor, integer but characters will be stored as factors. So this
means that your data types do not have to be of 1 specific type.
i believe ff has a dataframe class. as for your object data im less clear.
how big is it
On Oct 18, 2012 12:45 PM, "Alexander Shenkin" wrote:
> Hi Folks,
>
> I've been bumping my head against the 4GB limit for 32-bit R. I can't
> go to 64-bit R due to package compatibility issues (ROBDC - possib
System Info:
R 2.14.2
Windows 7 Pro x64 SP1
8GB RAM
On 10/18/2012 3:42 PM, Alexander Shenkin wrote:
> Hi Folks,
>
> I've been bumping my head against the 4GB limit for 32-bit R. I can't
> go to 64-bit R due to package compatibility issues (ROBDC - possible but
> painful, xlsReadWrite - not possi
R internally uses 32-bit integers for indexing (though this may change).
For this and other reasons these external objects with specialized purposes
(larger-than-RAM, shared memory) simply can't behave exactly as R objects.
Best case, some R functions will work. Others would simply break. Others
To answer your first question about read.big.matrix(), we don't know what
your acc3.dat file is, but it doesn't appear to have been detected as a
standard file (like a CSV file) or -- perhaps -- doesn't even exist (or
doesn't exist in your current directory)?
Next:
> In addition, I am planning to
Thanks again for your help.
I've been able to add several packages, bigmemory seems to be the only one
to fail and it
fails on isinf.
Is there a way I can download the code and change it to include a ininf
function or definition?
I'm using the GNU compiler; should I have been using the SUN St
By far the easiest way to achieve this would be to use the bigmemory
C++ structures in your program itself. However, if you do something
on your own (but fundamentally have a column-major matrix in shared
memory), it should be possible to play around with the pointer with
R/bigmemory to accomplish
Hi,
Yes, I am using the 32-bit version of R (version 2.10.0 RC). The OS used is
Windows-7 32 bit.
And I preprocessed the airline csv file using the utilities provided on
bigmemory.org.
The R-environment is empty, with no other objects in memory.
When I test the code provided by you, I am able t
It seems very likely you are working on a 32-bit version of R, but it's a
little surprising still that you would have a problem with any single year.
Please tell us the operating system and version of R. Did you preprocess
the airline CSV file using the utilities provided on bigmemory.org? If you
Jay, thanks a bunch. New package seems to work just fine and great
improvement in docs by the way:). I tried the same example, new version
deals with it smoothly. In terms of usefulness of my sample code -- sure i
am writing same stuff to disk many times with only one handle -- it was some
toy cod
Zerdna,
Please note that the CRAN version 3.12 is about
to be replaced by a new cluster of packages now on R-Forge; we consider the
new bigmemory >= 4.0 to be "stable" and recommend you start using it
immediately. Please see http://www.bigmemory.org.
In your case, two comments:
(1) Your for() l
Utkarsh,
Thanks again for the feedback and suggestions on bigmemory.
A follow-up on counting NAs: we have exposed a new function colna()
to the user in upcoming release 3.7. Of course mwhich() can still be
helpful.
As for the last topic -- applying any function to columns of a big.matrix
object
Thanks for the really valuable inputs, developing the package and
updating it regularly. I will be glad if I can contribute in any way.
In problem three, however, I am interested in knowing a generic way to
apply any function on columns of a big.matrix object (obviously without
loading the dat
Thanks for trying this out.
Problem 1. We'll check this. Options should certainly be available. Thanks!
Problem 2. Fascinating. We just (yesterday) implemented a
sub.big.matrix() function doing exactly
this, creating something that is a big matrix but which just
references a contiguous subset
18 matches
Mail list logo
