[
https://issues.apache.org/jira/browse/HADOOP-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jai Kumar Singh resolved HADOOP-7989.
-------------------------------------
Resolution: Not A Problem
It was a setting problem. (by whirr) ulimit was not set to unlimited which was
causing jvm to fail.
> [ec2] hadoop Could not create the Java virtual machine
> ------------------------------------------------------
>
> Key: HADOOP-7989
> URL: https://issues.apache.org/jira/browse/HADOOP-7989
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Environment: Amazon EC2 m1.large instance (AMI-ID ami-fd589594)
> Reporter: Jai Kumar Singh
>
> On Amazon EC2, If I set mapred.child.java.opts to "-Xmx512m". Job execution
> fails saying that "Could Not create the java virtual machine"
> If unset mapred.child.java.opts everything runs fine. I've even tried the
> same thing on c1.xlarge instances but with the same result.
> I'll add full logs. I need to set mapred.child.java.opts becuase my reduce
> program are memory hungry.
> I've been trying to setup a map-reduce cluster on ec2 for last two days via
> whirr, but this error was recurring. At first I thought It might be whirr
> specific, but manual ec2 cluster also resulted in same.
> <snippet>
> ubuntu@ip-10-84-237-173:~/workspace$ hadoop jar $HADOOP_HOME/*examples*.jar
> wordcount in out
> 12/01/21 18:08:28 INFO input.FileInputFormat: Total input paths to process :
> 16
> 12/01/21 18:08:28 INFO mapred.JobClient: Running job: job_201201211751_0007
> 12/01/21 18:08:29 INFO mapred.JobClient: map 0% reduce 0%
> 12/01/21 18:08:35 INFO mapred.JobClient: Task Id :
> attempt_201201211751_0007_m_000017_0, Status : FAILED
> java.lang.Throwable: Child Error
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:35 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stdout
> 12/01/21 18:08:35 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_0&filter=stderr
> 12/01/21 18:08:41 INFO mapred.JobClient: Task Id :
> attempt_201201211751_0007_r_000002_0, Status : FAILED
> java.lang.Throwable: Child Error
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:41 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stdout
> 12/01/21 18:08:41 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-12-15-189.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_0&filter=stderr
> 12/01/21 18:08:47 INFO mapred.JobClient: Task Id :
> attempt_201201211751_0007_m_000017_1, Status : FAILED
> java.lang.Throwable: Child Error
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:47 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stdout
> 12/01/21 18:08:47 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_m_000017_1&filter=stderr
> 12/01/21 18:08:53 INFO mapred.JobClient: Task Id :
> attempt_201201211751_0007_r_000002_1, Status : FAILED
> java.lang.Throwable: Child Error
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
> 12/01/21 18:08:53 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stdout
> 12/01/21 18:08:53 WARN mapred.JobClient: Error reading task
> outputhttp://ip-10-32-50-20.ec2.internal:50060/tasklog?plaintext=true&attemptid=attempt_201201211751_0007_r_000002_1&filter=stderr
> 12/01/21 18:09:01 INFO mapred.JobClient: Task Id :
> attempt_201201211751_0007_m_000017_2, Status : FAILED
> java.lang.Throwable: Child Error
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> </snippet>
> <snippet>
> ubuntu@ip-10-12-15-189:~/workspace$ cat
> ~/hadoop/logs/userlogs/job_201201211751_0007/attempt_201201211751_0007_m_000016_1/std*
> Could not create the Java virtual machine.
> Error occurred during initialization of VM
> Could not reserve enough space for object heap
> ubuntu@ip-10-12-15-189:~/workspace$
> </snippet>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
