Re: Introducing PigPen: Map-Reduce for Clojure

2014-01-03 Thread Matt Bossenbroek
I would recommend the Pig setup guide here: http://pig.apache.org/docs/r0.11.0/start.html Then you can run it like this: $ pig -x local -f my-script.pig That said, you really only have to install Pig if you want to run it on a cluster. To run/test/develop queries locally, you can use the dump

Re: Introducing PigPen: Map-Reduce for Clojure

2014-01-03 Thread Mark Engelberg
This is exciting! Not knowing anything about Pig, is there a walkthrough somewhere that demonstrates how to set up the kind of environment and install the pig tools necessary to run the pig scripts generated by PigPen? Thanks, Mark -- -- You received this message because you are subscribed to

Introducing PigPen: Map-Reduce for Clojure

2014-01-02 Thread Matt Bossenbroek
Today we (Netflix) released PigPen; Map-Reduce for Clojure! PigPen allows you to write what looks like regular Clojure code and compile it to an Apache Pig script that can be used in a Hadoop map-reduce cluster. Check out the blog post & other links below for more info: Blog post: http://techb