Re: [R] read.table.ffdf and fixed width files

Dear R Users This is a summary of the things I tried with read.table.ffdf and fixed-width files. I would like to thank Jan Wijffels and Jan van der Laan for their suggestions and the time they spent on my problem! My objective was to import a file with 6'079'455 lines and 32 variables using th

Re: [R] read.table.ffdf and fixed width files

What probably is the problem is that read.table.ffdf uses the nrows argument to read the file in chunks. However, read.fwf doesn't use a nrow argument but a n argument. One (non tested) solution is to write a wrapper around read.fwf and pass this wrapper to read.table.ffwf. Something like:

[R] read.table.ffdf and fixed width files

Dear all I am working on Windows 7 32-bit, and the ff- package is my daily life-saver to overcome the inherent memory limitations. Recently, I tried using read.table.ffdf to import data from a fixed-width ASCII file (file size: 1'440'865'015 Bytes) with 6'079'455 lines and 32 variables using th