You may want to use this for basic measures : http://cran.r-project.org/web/packages/entropy/ from http://strimmerlab.org/software/entropy/ Look at their paper, it may give you some idea Before going into more complicated cases, http://arxiv.org/PS_cache/arxiv/pdf/0811/0811.3579v3.pdf
>-----Original Message----- >From: r-help-boun...@r-project.org [mailto:r-help-boun...@r-project.org] >On Behalf Of Reza Salimi-Khorshidi >Sent: 30 October 2011 14:45 >To: r-help@r-project.org >Subject: [R] calculating joint entropy of many variables > >Hello list. >I need help (e.g., a reference, code, package, etc.) in calculating the >joint entropy of many variables (some sure highly mutually-informative >and >some not). >Is there anyone here who knows a computationally-efficient solution >(such >as an R package)? I appreciate you help ... >Best, Reza > > [[alternative HTML version deleted]] > >______________________________________________ >R-help@r-project.org mailing list >https://stat.ethz.ch/mailman/listinfo/r-help >PLEASE do read the posting guide http://www.R-project.org/posting- >guide.html >and provide commented, minimal, self-contained, reproducible code. LEGAL NOTICE This message is intended for the use o...{{dropped:10}} ______________________________________________ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
