Hadoop Compatibility and EMR

2010-03-21 Thread ilayaraja
Hi, We 've been using hadoop 15.5 in our production environment where we have about 10 TB of data stored on the dfs. The files were generated as mapreduce output. We want to move our env. to Amazon Elastic Map Reduce (EMR) which throws the following questions to us: 1. EMR supports only hadoop

Re: Hadoop Compatibility and EMR

2010-03-21 Thread Owen O'Malley
I believe you need to take two jumps. I believe it is 15-> 18 -> 20. I'd strongly suggest trying a practice file system first. Did we have owners and perms in 15? If not, you'll need to set owners and perms. -- Owen On Mar 21, 2010, at 12:23 AM, "ilayaraja" wrote: Hi, We 've been usin

[jira] Created: (HADOOP-6653) NullPointerException in setupSaslConnection when browsing directories

2010-03-21 Thread Owen O'Malley (JIRA)
NullPointerException in setupSaslConnection when browsing directories - Key: HADOOP-6653 URL: https://issues.apache.org/jira/browse/HADOOP-6653 Project: Hadoop Common Issue

[jira] Resolved: (HADOOP-6617) Version 0.20.2 is not published on the maven repositories

2010-03-21 Thread Benson Margulies (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benson Margulies resolved HADOOP-6617. -- Resolution: Duplicate Fix Version/s: 0.20.2 t HADOOP-6382 > Version 0.20.2 is

Re: Hadoop Compatibility and EMR

2010-03-21 Thread Philip Zeyliger
I believe 0.15 had HftpFileSystem. http://hadoop.apache.org/common/docs/r0.15.3/api/index.html You may be able to run 0.19's distcp to copy from your 0.15 (use HFTP as the source) to HDFS. -- Philip On Sun, Mar 21, 2010 at 12:26 PM, Owen O'Malley wrote: > I believe you need to take two jumps.