[R] Extract values from a predict() result... how?

2010-02-15 Thread Jay
Hello, silly question I suppose, but somehow I can't manage to extract the probabilities from a glm.predict() result: > str(res) Named num [1:9] 0.00814 0.01877 0.025 0.02941 0.03563 ... - attr(*, "names")= chr [1:9] "1" "2" "3" "4" ... I got from: # A Gamma example, from McCullagh & Nelder (

[R] Checking the assumptions for a proper GLM model

2010-02-17 Thread Jay
Hello, Are there any packages/functions available for testing the assumptions underlying assumptions for a good GLM model? Like linktest in STATA and smilar. If not, could somebody please describe their work process when they check the validity of a logit/probit model? Regards, Jay

Re: [R] Checking the assumptions for a proper GLM model

2010-02-18 Thread Jay
ssion. * boxtid--performs power transformation of independent variables and performs nonlinearity test. But, since I'm new to GLM, I owuld greatly appreciate how you/others go about and test the validity of a GLM model. On Feb 18, 1:18 am, Jay wrote: > Hello, > > Are there any

Re: [R] Checking the assumptions for a proper GLM model

2010-02-18 Thread Jay
last couple of days. However, their section on using R for validating the assumptions is very lacking. Naturally links like google.com and amazon.com will eventually get me there, but if somebody have other recommendations, I would be very fortunate to get even more help. BR, Jay On Feb 18, 7:

[R] Extract information from S4 object

2010-02-22 Thread Jay
The function prediction() returns this: Formal class 'performance' [package "ROCR"] with 6 slots ..@ x.name : chr "Cutoff" ..@ y.name : chr "Accuracy" ..@ alpha.name : chr "none" ..@ x.values:List of 1 .. ..$ : Named num [1:89933] Inf 2.23 2.22 2.17 2.16 ... .. .. ..- at

Re: [R] Extract information from S4 object

2010-02-22 Thread Jay
Tahnk you. But, when I try the command you both suggested I get a NULL as the results. > names(object1 @ x.values) NULL Where did I go wrong? On Feb 22, 4:34 pm, David Winsemius wrote: > On Feb 22, 2010, at 8:05 AM, Jay wrote: > > > > > The function prediction() retur

[R] Cross-validation for parameter selection (glm/logit)

2010-04-02 Thread Jay
) What is the correct way to perform this variable selection? And are the readily available packages for this? Similarly, when I have my final parameter set, how should I go about and make the final assessment of the models predictability? CV? What package? Thank you in ad

[R] xyplot ontop a contourplot (package: lattice)

2010-04-16 Thread Jay
Hello, I have a contourplot plot that shows the data I want. However, I would like to point a certain amount of points from this plot via a xyplot(). Example: x <- seq(pi/4, 5 * pi, length.out = 100) y <- seq(pi/4, 5 * pi, length.out = 100) r <- as.vector(sqrt(outer(x^2, y^2, "+"))) grid <- expa

[R] Check for overdispersion in logit model

2010-04-16 Thread Jay
A quick question for those that are familiar with the subject, is it OK to check for overdispersion in a logit model using: sum(resid(model, type = "pearson")^2) / df.residual(model) Are tehre other commands? packages? /Jay __ R-help@r-p

[R] Positioning plots on top of each other (aligment & borders)

2009-12-30 Thread Jay
Hello, I want to place two plots on top of each other. However, the problem is that I can't figure out a simple way to align them correctly. Is there a way to specify this? Since the data is bunch of coordinates and the second layer is an outline of a map (a .ps file I import using the grImport pa

[R] xyplot: several plots in one creates y-scale problem

2010-01-02 Thread Jay
Hello, I've been looking for a solution to this problem for some time now but I seem unable to solve it.. so this is the case: I want to plot 4 time series in the same graph using xyplot(). When I do this with xyplot(mydata[,2]+mydata[,3]+mydata[,4]+mydata[,5] ~ mydata[,1], data = mydata,

[R] xyplot: problems with column names & legend

2010-01-02 Thread Jay
Hello! one more question about xyplot. If I have data which have space in the column names, say "xyz 123". How do I create a working graph where this text is displayed in the legend key? Now when I try something like xyplot("xyz 123" ~ variable1, data = mydata, ...) I get nothing. Also, is it

Re: [R] xyplot: problems with column names & legend

2010-01-03 Thread Jay
ame the names should have been converted, > > make.names('my variable') > [1] "my.variable" > > HTH, > > baptiste > > 2010/1/3 Jay : > > > > > Hello! > > > one more question about xyplot. If I have data which have space in the >

Re: [R] xyplot: problems with column names & legend

2010-01-05 Thread Jay
Anybody? Frustrating to be unable to solve this silly little problem... On Jan 3, 12:48 pm, Jay wrote: > Thanks, the backtickes got the code working. However, now I cant get > it to draw the legend/key. > For example, look at this > figure:http://osiris.sunderland.ac.uk/~cs0he

[R] xyplot: adjusting the scale (min, max & tick)

2010-01-05 Thread Jay
Hi, I'm terribly sorry but it seems it cannot figure this one out by myself so, please, if somebody could help I would be very grateful. So, when I plot with xyplot() I get an y-axis that is very ugly... starting from a random number and having so many ticks that it becomes unreadable. How do I t

Re: [R] xyplot: adjusting the scale (min, max & tick)

2010-01-06 Thread Jay
Peter Ehlers wrote: > > Have a look at the 'scales' argument. For example: > > # default plot > xyplot(Sepal.Length ~ Petal.Length | Species, data = iris) > > # modified plot > xyplot(Sepal.Length ~ Petal.Length | Species, data = iris, > scales=

Re: [R] Results from clogit out of range?

2013-03-01 Thread Jay
I'm not positive of the question you are asking b/c I lost some of initial messages in thread but I think >predict(model, type="expected") gives fitted probabilities Apologies if I answered a question no one asked. On Feb 28, 2013, at 7:45 PM, lisa wrote: > I do appreciate this answer. I hea

[R] nnclust: nnfind() distance metric?

2010-05-06 Thread Jay
Hello, pardon my ingorance, but what distance metric is used in this function in the nnclust package? The manual only says: "Find the nearest neighbours of points in one data set from another data set. Useful for Mallows-type distance metrics."

[R] Lattice: location of key inside a xyplot()

2010-05-11 Thread Jay
ot;, but surely this must be possible somehow? BR, Jay __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, min

[R] RODBC: owerwrite into a named range in Excel

2010-05-20 Thread Jay
them. Should I use sqlSave() or sqlUpdate()? Using the update I get the error: "cannot update ‘data_001’ without unique column" sqlUpdate(connection_name, my_new_data_frame, "name_of_the_range_in_excel") Let's say that the range in Excel is in E10:

[R] Shared nearest neighbor (SNN) clustering algorithm implementation?

2011-02-18 Thread Jay
Hello, is there an implementation available for a shared nearest neighbor (SNN) clustering algorithm? //Jay __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org

[R] Fuzzy Discriminant Analysis (DA)

2011-02-23 Thread Jay
Hello all, as the combination DA and R is rather new to me I would like to know: are there packages that implement a fuzzy version of Discriminant Analysis? Thanks! __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLE

[R] kohonen: "Argument data should be numeric"

2011-02-25 Thread Jay
hat I want. How did I end up with this data format? What I did: data1 <- read.csv("data1.txt", sep = ";") training <- sample(nrow(data1), 1000) data.train <- data1[training,2:20] I tried to use scan as the import method (read about this somewhere) and unlist,

[R] ggplot2: "ndensity" and "density" parameters

2011-03-27 Thread Jay
Hello, if I want to compare the distributions of two datasets using ggplots, how should I choose the density type? More exactly, what assumptions and are behind the "ndensity" and "density" parameters? And when should they be used? See http://had.co.nz/ggplot2/stat_bin.html While I understand th

[R] Extracting columns with specific string in their names

2011-08-22 Thread Jay
Hi, Let's say that I have a set of column names that begin with the string "Xyz". How do I extract these specific columns? I tried to do the following: dataframe1[,grep("Xyz",colnames(dataframe1))] But it does not work. What is wrong with my expression? _

Re: [R] Extracting columns with specific string in their names

2011-08-22 Thread Jay
hard to be certain. > > Use dput() and head() to give a small cut-and-paste-able example. > > Michael > > > > > > > > > > On Mon, Aug 22, 2011 at 10:33 AM, Jay wrote: > > Hi, > > > Let's say that I have a set of column names

[R] rpart: plot without scientific notation

2011-08-25 Thread Jay
While I'm very pleased with the results I get with rpart and rpart.plot, I would like to change the scientific notation of the dependent variable in the plots into integers. Right now all my 5 or more digit numbers are displayed using scientific notation. I managed to find this: http://tolstoy.new

[R] Decision tree with the group median as response?

2011-08-25 Thread Jay
As I am only familiar with the basics regarding decision trees I would like to ask, with the risk of sating a silly question: is it possible to perform recursive partitioning with the group median as the response/objective? For example, in stead of rpart focusing on means, could a similar tree be

[R] rpart: apply tree to new data to get "counts"

2011-08-29 Thread Jay
Hi, when I have made a decision tree with rpart, is it possible to "apply" this tree to a new set of data in order to find out the distribution of observations? Ideally I would like to plot my original tree, with the counts (at each node) of the new data. Rea

Re: [R] rpart: apply tree to new data to get "counts"

2011-08-29 Thread Jay
I tried that, while I find the documentation a bit short, but the only result I get from this is a probability distribution of my data (I'm building a tree with 2 classes). How do I plot a tree where the counts are show in each step/node? BR, Jay On Aug 29, 9:40 pm, Weidong Gu

[R] On-line machine learning packages?

2011-09-11 Thread Jay
round. //Jay __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.

Re: [R] On-line machine learning packages?

2011-09-11 Thread Jay
what I'm looking for..(?) BR, Jay On Sep 11, 7:15 pm, David Winsemius wrote: > On Sep 11, 2011, at 11:42 AM, Jay wrote: > > > What R packages are available for performing classification tasks? > > That is, when the predictor has done its job on the dataset (based on > &g

Re: [R] On-line machine learning packages?

2011-09-11 Thread Jay
If the answer is so obvious, could somebody please spell it out? On Sep 11, 10:59 pm, Jason Edgecombe wrote: > Try this: > > http://cran.r-project.org/web/views/MachineLearning.html > > On 09/11/2011 12:43 PM, Jay wrote: > > > > > Hi, > > > I used the r

Re: [R] On-line machine learning packages?

2011-09-12 Thread Jay
ms in R, please respond. Or will "http://cran.r-project.org Look for 'Task Views'" be my next piece of advice? On Sep 12, 11:31 am, Dennis Murphy wrote: > http://cran.r-project.org/web/views/ > > Look for 'machine learning'. > > Dennis > > >

Re: [R] On-line machine learning packages?

2011-09-13 Thread Jay
have a particular algorithm or technique in mind? Does it have a > name? > > How does sequential classification differ form running a one-off > classifier for each run? > > On 09/12/2011 05:24 AM, Jay wrote: > > > > > In my mind this sequential classification t

[R] Factor analysis on ordinal & nominal data

2011-06-14 Thread Jay
Hi, are there readily available R packages that are able to perform FA on ordinal and/or nominal data? If not, what other approaches and helpful packages would you suggest? BR, Jay __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman

[R] Count occurances in integers (or strings)

2011-06-15 Thread Jay
Hi, I have a dataframe column from which I want to calculate the number of 1's in each entry. Some column values could, for example, be "0001001000" and "111". To get the number of occurrences from a string I use this: sum(unlist(strsplit(mydata[,"my_column"], "")) == "1") However, as my

[R] split data, but ensure each level of the factor is represented

2008-10-13 Thread Jay
1.4 0.2 2 4.9 3.0 1.4 0.2 3 4.7 3.2 1.3 0.2 5 5.0 3.6 1.4 0.2 8 5.0 3.4 1.5 0.2 10 4.9 3.1

Re: [R] split data, but ensure each level of the factor is represented

2008-10-13 Thread Jay
Thanks so much. On Oct 13, 1:14 pm, "Henrique Dallazuanna" <[EMAIL PROTECTED]> wrote: > Try this: > > a<-factor(c(3, 3, 3, 2, 3, 2, 2, 3, 2, 3), levels = 1:3) > split(iris, a) > > lapply(split(iris, a), dim) > > > > On Mon, Oct 13, 2008 at

[R] Comparing pooled proportions(complication and reoperation rates) of different treatment modalities

2017-06-23 Thread Jay Zola
Dear sir/madame, I am currently writing a meta-analysis on the complication and reoperation rates of 5 different treatment modalities after a distal radius fracture. I was able to pool the rates of the 5 different rates using R. Now I have to compare the pooled rates of the 4 treatment modalit

Re: [R] Comparing pooled proportions(complication and reoperation rates) of different treatment modalities

2017-06-23 Thread Jay Zola
treatment modalities separately with the golden standar... Van: David Winsemius Verzonden: vrijdag 23 juni 2017 20:18 Aan: Jay Zola CC: r-help@r-project.org Onderwerp: Re: [R] Comparing pooled proportions(complication and reoperation rates) of different treatment modalities > On Ju

Re: [R] Comparing pooled proportions(complication and reoperation rates) of different treatment modalities

2017-06-26 Thread Jay Zola
people keep coming along >> and sticking things into it." >> -- Opus (aka Berkeley Breathed in his "Bloom County" comic strip ) >> >> >>> On Fri, Jun 23, 2017 at 5:53 AM, Jay Zola wrote: >>> Dear sir/madame, >>> >>> >

Re: [R] Comparing pooled proportions(complication and reoperation rates) of different treatment modalities

2017-06-26 Thread Jay Zola
Op 26 jun. 2017 om 15:22 heeft Jay Zola mailto:jayjay.1...@hotmail.nl>> het volgende geschreven: What is the best way to change my R code to be able to compare the pooled proportions(complication and reoperation rates) with the Chi square method? Just adding an adjustment to the links b

[R] Model studies in one analysis using treatment as a five level moderator in a meta-regression

2017-06-26 Thread Jay Zola
meone told me I could best model the data in one analysis using treatment as a five level moderator in a meta-regression. Can some help me with the R code to do this? Your help would be very much appreciated. Thank you, Jay Study| Event Type| Treatment| Number of Events (n)| N| n/N| Kuma

Re: [R] Model studies in one analysis using treatment as a five level moderator in a meta-regression

2017-06-26 Thread Jay Zola
Dear Vito, Thank you for your reply. I tried to contact the statistics departement numerous times, but did not receive any reply. That is why I started to look on the internet for help. Yours sincerely, Jay Verstuurd vanaf mijn iPhone > Op 26 jun. 2017 om 22:05 heeft Vito Michele Rosa

[R] Change Rcode for a meta-analysis(netmeta) to use a random effects model instead of a mixed effects model

2017-06-29 Thread Jay Zola
effects model is used? Thank you very much, Jay R code library(meta) library(readxl) All <- read_excel("Basics excel file complication and reoperation rate.xlsx", sheet=1) names(All) <- c("Study_ID","Event_Type","Treatment","Events_

Re: [R] Change Rcode for a meta-analysis(netmeta) to use a random effects model instead of a mixed effects model

2017-06-29 Thread Jay Zola
.com/s/j1urqzr99bt76ip/Basics%20excel%20file%20complication%20and%20reoperation%20rate.xlsx?dl=0 Van: Viechtbauer Wolfgang (SP) Verzonden: donderdag 29 juni 2017 19:47 Aan: Jay Zola; r-help@r-project.org Onderwerp: RE: Change Rcode for a meta-analysis(netmeta) to

Re: [R] Qvalue package: I am getting back 1, 000 q values when I only want 1 q value.

2017-01-17 Thread Jay Tanzman
What you're doing makes no sense. Given p-values p_i, i=1...n, resulting from hypothesis tests t_i, i=1...n, the q-value of p_i is the expected proportion of false positives among all n tests if the significance level of each test is α=p_i. Thus a q-value is only defined for an observed p-value.

[R] Setting fixed size for segement plot using stars() (axes size vs print size)

2008-07-30 Thread Jay Douillard
I have been making some segment plots with five variables. They work great, especially when I used a different scale function, which scaled them by area of the circle rather than radius scale <- function(x, Mr = 1 , Mx = 100) { ((x/Mx)^.5)*Mr} Where x is the the value, Mr is the Maximum radiu

[R] call perl

2008-08-21 Thread Jay an
Hi,   It may be the old question. can anyone tell me how to call perl in R? thanks   Y.     [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting

Re: [R] reading web log file into R

2009-09-23 Thread Jay Emerson
ge in R designed just for this, but I encourage students to develop the raw skills... Jay -- John W. Emerson (Jay) Associate Professor of Statistics Department of Statistics Yale University http://www.stat.yale.edu/~jay __ R-help@r-project.org ma

[R] RMySQL_0.7-4 core dumped on dbWriteTable

2010-03-09 Thread Jay Castino
/usr/lib64/R/bin/exec/R terminated" How can I fix this? Appreciate your help. Sincerely, Jay James Castino, PE Principal JJCENG.COM, PC www.jjceng.com +1 (541) 633-7990 1560 NE 1st ST. #14 Bend, OR USA 97701 ## partial .RHistory ### >sessionInfo() R version 2.10.1 (2009-

[R] ' R ' - General Question (newbie)

2009-07-10 Thread Jay Mistry
milar to ODS of SAS. 2) Any print/ online documentation for the beginning user of R. Thanks, Jay [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guid

Re: [R] Building a big.matrix using foreach

2009-07-19 Thread Jay Emerson
more general iteration in parellel. Regards, Jay Original message: Hi there! I have become a big fan of the 'foreach' package allowing me to do a lot of stuff in parallel. For example, evaluating the function f on all elements in a vector x is easily accomplished: foreach(i=1:length(x),.co

Re: [R] kmeans.big.matrix

2009-07-22 Thread Jay Emerson
an's point is right: big data packages (like bigmemory and ff) can't be used directly with R functions (like lm). And because of R's design you can't extract subsets with more than 2^31-1 elements, even though the big.matrix can be as large as you need (with filebacking). I hop

Re: [R] Mosaic plots

2010-03-23 Thread Jay Emerson
real challenge faced by all of us with these plots, so you should try each version. I'm not sure what you intend to do with a legend, but if you want the ability to customize and hack code, I suggest you look at grid and a modification to vcd's version to suit your purposes. Jay > &g

Re: [R] large dataset

2010-03-27 Thread Jay Emerson
For example, RMySQL supports MySQL databases. At the other end of the spectrum, there are possibilities discussed on a nice page by Dirk Eddelbuettel which you might look at: http://cran.r-project.org/web/views/HighPerformanceComputing.html Jay -- John W. Emerson (Jay) Associate Profess

Re: [R] Huge data sets and RAM problems

2010-04-20 Thread Jay Emerson
though you can afford 1 (or a few) copies of this, it doesn't leave you much room for the memory overhead of working with such an object. Part of the oringal message below. Jay - Message: 80 Date: Mon, 19 Apr 2010 22:07:03 +02

Re: [R] bigmemory package woes

2010-04-24 Thread Jay Emerson
ldn't be a problem with the new version. The CRAN update should take place early next week, along with some revised documentation. Regards, Jay --- Message: 125 Date: Fri, 23 Apr 2010 13:51:32 -0800 (PST) From: zerdna To: r-help@r-project.org Subject: [R] bigmemory package woe

[R] Help producing plot for assessing forecasting accuracy

2009-10-09 Thread Jay Ulfelder
ot is (Y_cond)/(Y_tot) across all values of x. I would be grateful for any guidance you can offer, and I'm sorry if I've overlooked some really simple solution; I'm fairly new to R and learning by doing. Regards, Jay -- Jay Ulfelder, Ph.D. Research Director Political Instability Tas

Re: [R] Estimation in a changepoint regression with R

2009-10-16 Thread Jay Emerson
strucchange, among others). Jay Message: 4 Date: Thu, 15 Oct 2009 03:56:22 -0700 (PDT) From: FMH Subject: [R] Estimation in a changepoint regression with R To: r-help@r-project.org Message-ID: <365399.56401...@web38

Re: [R] Multicore package: sharing/modifying variable accross processes

2009-10-31 Thread Jay Emerson
beautifully with multicore. Feel free to email us with questions, and we appreciate feedback. Jay Original message: Hi, I want to parallelize some computations when it's possible on multicore machines. Each computation produces a big objects that I don't want to store if not necessary: in th

Re: [R] bigmemory - extracting submatrix from big.matrix object

2009-06-02 Thread Jay Emerson
will not be implementing all of R's functions directly with big.matrix objects. We will be creating a new package "bigmemoryAnalytics" and would welcome contributions to the package. Feel free to email us directly with bugs, questions,

Re: [R] bigmemory - extracting submatrix from big.matrix object

2009-06-03 Thread Jay Emerson
rther discussion of development ideas would be great, but should probably be moved offine or over to R-devel. As always, we appreciate feedback, complaints, bug reports, etc... Thanks, Jay On Wed, Jun 3, 2009 at 3:16 AM, utkarshsinghal wrote: > Thanks for the really valuable inputs, develo

[R] [R-pkgs] Major bigmemory revision released.

2009-04-16 Thread Jay Emerson
matrices for larger-than-RAM applications. We're working on updating the package vignette, and a draft is available upon request (just send me an email if you're interested). The user interface is largely unchanged. Feedback, bug reports, etc... are welcome. Jay Emerson & Michael Ka

[R] Bivariate pdf and marginal pdf of non-standard distributions

2009-05-02 Thread Jay Liu
suggestion to it. Thanks, Jay Liu, University of Tennesse at Knoxville ## # f(x,y) = 4xy, range of x is (0,1), range of y is (0,1) # Checking if f (x,y) is a joint pdf Pxy<-integrate(function(y) { sapply(y, function(y) { integrate(function(x) { sapply(x, function(x) (4*x*y)) }, 0

Re: [R] question about bigmemory: releasing RAM from a big.matrix that isn't used anymore

2010-02-06 Thread Jay Emerson
c(). >>> But it's available for re-use; if you want to be really sure, have a look >>> in /dev/shm to make sure the shared memory segments have been >>> deleted. Thanks, Matt -- John W. Emerson (Jay) Associate Professor of Statistics Department of Statistics Ya

[R] Stats Package Fix

2019-08-07 Thread Jay Waldron
wer even if that timeline is too aggressive. Thank you for your consideration. My contact information is: Jay Spencer Waldron Personal Email (This is the one I am subscribed to R-Help with): gateofti...@gmail.com (385) 335-7879 #---Code paste begins--- > library(readxl) > Growth_Value <-

Re: [R] t-statistic for independent samples

2013-04-17 Thread Jay Kerns
Dear David, On Wed, Apr 17, 2013 at 6:24 PM, David Arnold wrote: > Hi, [snip] > > D. Before posting to StackExchange, check out the Wikipedia entry for "Behrens-Fisher problem". Cheers, Jay -- G. Jay Kerns, Ph.D. Youngstown State University http://peo

[R] practical to loop over 2million rows?

2012-10-10 Thread Jay Rice
ever be able to write efficient enough code to perform a complicated loop over 2 million rows in a reasonable time. Is it useless for me to try to do any complicated loops on 2 million rows, or if I get much better at programming in R will it be manageable even for complicated situa

[R] error msg using na.approx "x and index must have the same length"

2012-10-11 Thread Jay Rice
I am not sure why I get the error message. Jay [[alternative HTML version deleted]] __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.htm

[R] First time Rcpp user needs compiler help, I think

2012-10-15 Thread Jay Rice
I am trying to write a C++ function to be called from R and have never done this before. I have done the following: require(Rcpp) require(inline) src <- 'blahblahblah' fun <- cxxfunction(signature(a="numeric",b="numeric"),src,plugin="Rcpp") That last line generates the error message: Error in co

Re: [R] Parallel computing on Windows (foreach) (Sergey Goriatchev)

2010-06-16 Thread Jay Emerson
ple, doing blocks of tasks in chunks rather than passing each one as an individual job). But more to the point, doSNOW works just fine on an SMP, no problem, it doesn't require a cluster. Jay <> Not only is the sequential foreach much slower than the simple for-loop (as least in this part

Re: [R] (help) This is an R workspace memory processing question

2010-06-23 Thread Jay Emerson
You should look at packages like ff, bigmemory, RMySQL, and so on. However, you should really consider moving to a different platform for large-data work (Linux, Mac, or Windows 7 64-bit). Jay - This is an R workspace memory processing question

[R] Error installing tkrplot

2010-07-17 Thread Jay-pea
Hi, I've been trying to install tkrplot and have been coming across this error. Loading required package: tcltk Loading Tcl/Tk interface ... Error : .onLoad failed in loadNamespace() for 'tcltk', details: call: dyn.load(file, DLLpath = DLLpath, ...) error: unable to load shared library '/L

[R] Prediction plot for logistic regression output

2010-09-23 Thread Jay Vaughan
How do I construct a figure showing predicted value plots for the dependent variable as a function of each explanatory variable (separately) using the results of a logistic regression? It would also be helpful to know how to show uncertainty in the prediction (95% CI or SE). Thanks- This emai

Re: [R] merging and working with big data sets

2010-10-12 Thread Jay Emerson
ot;smart" cbind() would be possible simply by manipulating the descriptor file. Again, not something we advise or formally provide, but it wouldn't be hard. Jay -- John W. Emerson (Jay) Associate Professor of Statistics Department of Statistics Yale University http://www.stat.yale.edu/~jay

Re: [R] big data and lmer

2010-10-22 Thread Jay Emerson
means, and perhaps a few other things. In many cases, it's just a matter of someone deciding to port a tool/analysis of interest to one of these different object types -- we welcome collaborators and would be happy to offer advice if you want to adapt something for bigmemory structures! Jay

Re: [R] [Fwd: adding more columns in big.matrix object of bigmemory package]

2010-12-17 Thread Jay Emerson
For good reasons (having to do with avoiding copies of massive things) we leave such merging to the user: create a new filebacking of the proper size, and fill it (likely a column at a time, assuming you have enough RAM to support that). Jay On Fri, Dec 17, 2010 at 2:16 AM, utkarshsinghal wrote

Re: [R] Bigmemory: Error Running Example

2010-08-11 Thread Jay Emerson
ize until you get a failure. This sort of exercise is extremely helpful in situations like this. Jay Subject: [R] Bigmemory: Error Running Example Message-ID: > Content-Type: text/plain Hi, I am trying to run the bigmemory example provided on the http://www.bigmemory.org/ The exa

[R] DNA sequence Fst

2010-08-23 Thread blue jay
Hi, I want to analyse DNA sequence data (mtDNA) in R as in calculate Fst, Heterozygosity and such summary statistics. Package Adagenet converts the DNA sequence into retaining only retaining the polymorphic sites and then calcuates Fst.. but is there any other way to do this? I mean analyse the DN

Re: [R] bigmemory doubt

2010-09-08 Thread Jay Emerson
accomplish this, yes. Feel free to email us directly for advice. Jay > Message: 153 > Date: Wed, 8 Sep 2010 10:52:19 +0530 (IST) > From: "raje...@cse.iitm.ac.in" > To: r-help > Subject: [R] bigmemory doubt > Message-ID: > <1204692515.13855.1283923339865

[R] [R-pkgs] "Bayesian change point" package bcp 2.2.0 available

2010-05-10 Thread Jay Emerson
consider taking advantage of it for tasks that might be computationally intensive and could be easily done in parallel. Some vignettes are available at http://cran.r-project.org/web/packages/foreach/index.html. Jay Emerson & Chandra Erdman -- John W. Emerson (Jay) Associate Professor of Stati

[R] [R-pkgs] Bayesian change point" package bcp 2.2.0 available

2010-05-17 Thread Jay Emerson
consider taking advantage of it for tasks that might be computationally intensive and could be easily done in parallel.  Some vignettes are available at http://cran.r-project.org/web/packages/foreach/index.html. Jay Emerson & Chandra Erdman (Apologies, the first version of this announcement was not pl

[R] [R-pkgs] bigmemory 4.2.3

2010-05-17 Thread Jay Emerson
visit http://www.bigmemory.org/. Jay Emerson & Mike Kane -- John W. Emerson (Jay) Associate Professor of Statistics Department of Statistics Yale University http://www.stat.yale.edu/~jay ___ R-packages mailing list r-packa...@r-project.org h

Re: [R] lm without intercept

2011-02-18 Thread Jay Emerson
ll data set: if you sent an R command such as: x <- c(x1, x2, ..., xn) y <- c(y1, y2, ..., yn) you might even get some more interesting feedback. One of the many good intro stats textbooks might also be helpful as you get up to speed. Jay - Origina

Re: [R] Kolmogorov-smirnov test

2011-02-28 Thread Jay Emerson
, tsippel wrote: > Is the kolmogorov-smirnov test valid on both continuous and discrete data? > ?I don't think so, and the example below helped me understand why. > > A suggestion on testing the discrete data would be appreciated. > > Thanks, -- John W. Emerson (Jay) Associat

Re: [R] Exception while using NeweyWest function with doMC

2011-08-29 Thread Jay Emerson
. It also doesn't appear that you are making use of shared memory, so I'm unsure what the gains are. However, I don't have any particular insight as to the subsequent problem with NeweyWest (which doesn't seem to be using the big.matrix objects). Jay -- Mess

Re: [R] Installation of bigmemory fails

2011-06-25 Thread Jay Emerson
look at it and see what we can do. Please email us if you don't hear back in the next week or so. Thanks, Jay --- Hello All, I tried to intall the bigmemory package from a CRAN mirror site and receive

Re: [R] Memory limit for Windows 64bit build of R

2012-08-06 Thread Jay Emerson
any R analytics under the hood use matrices, so you may not know up front where you could hit a limit. Jay Original message I have a Windows Server 2008 R2 Enterprise machine, with 64bit R installed running on 2 x Quad-core Intel Xeon 5500 processor with 24GB DDR3 1066 Mhz RAM. I am se

[R] bigmemory on Solaris

2011-12-01 Thread Jay Emerson
ear up the other warnings in the logs, though. !-) We should also revisit the possibility of a CRAN BOOST library for use by a small group of packages (like bigmemory) which might make patches to BOOST easier to track and maintain. This might improve things in the long run. Jay -- John W. Em

Re: [R] efficient coding with foreach and bigmemory

2011-09-30 Thread Jay Emerson
her backends do; otherwise, the workers will not be able to properly address the shared-memory or filebacked big.matrix. Some documentation on bigmemory.org may help, and feel free to email us directly. Jay -- John W. Emerson (Jay) Associate Professor of Statistics Department of Stati

Re: [R] Foreach (doMC)

2011-10-19 Thread Jay Emerson
relating to my own packages is something I try to do, but it doesn't always happen. I would like to think foreach is widely used -- it does have a growing list of reverse depends/suggests. And was updated as recently as last May, I just noticed. http://cran.r-project.org/web/packages/foreach/

Re: [R] Foreach (doMC)

2011-10-20 Thread Jay Emerson
n you might try joining the r-sig-...@r-project.org group. Clearly there are far more users of "core" R and hence "mainstream" questions on r-help are likely to be answered more quickly (on average) than specialized questions. Regards, Jay On Thu, Oct 20, 2011 at 4:27 PM, J

Re: [R] bigmemory

2012-05-11 Thread Jay Emerson
tures). In particular, for large data sets you would likely use up all of RAM (other reasons are more subtle and important, but out of place in this reply). Jay -- John W. Emerson (Jay) Associate Professor of Statistics Department of Statistics Yale University http://www.stat.yale.edu/~jay

Re: [R] bigmemory

2012-05-11 Thread Jay Emerson
ly on both matrix and big.matrix objects. Jay Hi Jay, > > I have a question about your reply. > > You mentioned that "the more serious problem is that you can't expect to > run just any R function on a big.matrix (or on an ff object, if you check > out ff for some nice f

[R] [R-pkgs] Package bigmemory now available on CRAN

2008-06-26 Thread Jay Emerson
ns the door for more powerful parallel analyses and data mining of massive data sets. -- John W. Emerson (Jay) Assistant Professor of Statistics Department of Statistics Yale University http://www.stat.yale.edu/~jay ___ R-packages mailing list [EMAIL P

Re: [R] R package building

2008-05-17 Thread Jay Emerson
S4 that passes R CMD check cleanly, I'm not convinced I've got it quite right. If someone has recently created more documentation or a 'white pages' on this, please do spread the word. Thanks to all who have -- and continue -- to work on the system! Jay >Subject: [R] R pa

Re: [R] Using very large matrix

2009-02-26 Thread Jay Emerson
they tried, anyway). Feel free to email me for more information (and this invitation applies to anyone who is interested in this). Cheers, Jay #Dear friends, # #I have to use a very large matrix. Something of the sort of #matrix(8,8,n) where n is something numeric of the sort 0.xx

Re: [R] Using very large matrix

2009-03-02 Thread Jay Emerson
Steve et.al., The old version is still on CRAN, but I strongly encourage anyone interested to email me directly and I'll make the new version available. In fact, I wouldn't mind just pulling the old version off of CRAN, but of course that's not a great idea. !-) Jay On Mon, M

  1   2   >