Re: question about machine learning on Hive

2013-01-17 Thread Robin Morris
.com From: Igor Tatarinov mailto:i...@decide.com>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Thursday, January 17, 2013 1:29 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user

Re: question about machine learning on Hive

2013-01-17 Thread Igor Tatarinov
Here is how Twitter does it with Pig: http://www.umiacs.umd.edu/~jimmylin/publications/Lin_Kolcz_SIGMOD2012.pdf We use a similar approach and I think that Pig, being somewhat lower-level with better support of nested objects, is a better tool than Hive. It should be possible to do something simila