I decided to give it 1 more variable, which is strongly significant to help
the optimization and it throws:
> bigglm (formula = resp ~ relage+relage2+termfac+ri+sn ,
+ data = a, family = binomial(link='logit'));
Error in bigglm.function(formula = resp ~ relage + relage2 + termfac + :
mode
the model fails to converge after more than 3 hours ( I went home so don't
know how long it took)
> bigglm (formula = resp ~ relage+I(relage^2)+termfac+ri ,
+ data = a, family = binomial(link='logit'));
Large data regression model: bigglm(formula = resp ~ relage + I(relage^2) +
termfac + ri,
after correcting the error spotted by Thomas, I tried again and it goes to
work, but there is no result after 1 hour.
is there anything I can do to debug?
the dataset has 12mln rows and SAS on a server will produce results in 15
secs. I am running this on PC with XP (hence mem limit of 2.5 gigs)
Sincere apologies and many thanks. The pasted code from the help forum has the
error and I did not see it. When I wrote my own import I used "c" as I should.
See:
http://r.789695.n4.nabble.com/R-Example-function-for-bigglm-biglm-data-input-from-file-td816496.html#a816496
Stephen Bond
| Senior An
Actually, I think the problem *is* reading in the data
If I try reading in your supplied lines of data with the read.table arguments()
in your make.data() function I get your error message.
data<-read.table(tmp<-textConnection(
+ "97 2007-03-05 2007-06-01 90 3 5.450 205500.00 999.00 999.
I am using an example posted in this help forum to work with a file. the head
of the file looks like:
97 2007-03-05 2007-06-01 90 3 5.450 205500.00 999.00 999.000 0.000 0 0
97 2007-03-06 2007-06-01 90 3 5.450 205500.00 999.00 999.000 0.000 1 0
97 2007-03-07 2007-06-01 90 3 5.450 205500
6 matches
Mail list logo
