Thanks All, To start with, I wish to implement a simple k-means algorithm using Apache PIG.
Just by using Python Streaming, there doesn't look like an easy way to do this. Dmitriy: Jython is stuck in 2.5, and I kind of like Python 3 :) Also, Jython will force me to write code in a certain way, that it interacts with Hadoop, java style. I will try out Piglet. Allan: That sounds very interesting. So two features I am looking forward to - Embedding PIG Statements in Scripting Languages, and support for Iterative MapReduce. Regards, Deepak -----Original Message----- From: Alan Gates [mailto:[email protected]] Sent: Monday, January 10, 2011 9:49 PM To: [email protected] Subject: Re: Iterative MapReduce with PIG This is one of our major initiatives for 0.9. See http://wiki.apache.org/pig/TuringCompletePig and https://issues.apache.org/jira/browse/PIG-1479. But until that's ready you'll have to use Java or piglet as recommended by Dmitriy. Alan. On Jan 10, 2011, at 3:09 AM, [email protected] wrote: > Hi, > > I need to implement an application that is iterative in nature. At the > end of each iteration, I need to take the result and provide it as an > input for the next iteration. > > Embedding PIG statements in a Java Program looks like one way to do > it. > > But I prefer using Python for programming. How can I do this? > > Thanks, > Deepak > > Please do not print this email unless it is absolutely necessary. > > The information contained in this electronic message and any > attachments to this message are intended for the exclusive use of the > addressee(s) and may contain proprietary, confidential or privileged > information. If you are not the intended recipient, you should not > disseminate, distribute or copy this e-mail. Please notify the sender > immediately and destroy all copies of this message and any > attachments. > > WARNING: Computer viruses can be transmitted via email. The recipient > should check this email and any attachments for the presence of > viruses. The company accepts no liability for any damage caused by any > virus transmitted by this email. > > www.wipro.com Please do not print this email unless it is absolutely necessary. The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
