java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to java.util.Iterator --------------------------------------------------------------------------------------------------------------------------
Key: HADOOP-7819 URL: https://issues.apache.org/jira/browse/HADOOP-7819 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.20.2 Environment: Linux calculate 2.6.39-pf4 #15 SMP PREEMPT Sat Nov 5 18:14:51 GST 2011 x86_64 Intel(R) Core(TM) i3 CPU M 330 @ 2.13GHz GenuineIntel GNU/Linux java version "1.6.0_26" Java(TM) SE Runtime Environment (build 1.6.0_26-b03) Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02, mixed mode) Reporter: Eldar Abdrazakov 11/11/13 22:07:26 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= WARNING: partition-by already refers to: #'clojure.core/partition-by in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/partition-by WARNING: frequencies already refers to: #'clojure.core/frequencies in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/frequencies WARNING: shuffle already refers to: #'clojure.core/shuffle in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/shuffle WARNING: reductions already refers to: #'clojure.core/reductions in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/reductions WARNING: partition-all already refers to: #'clojure.core/partition-all in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/partition-all WARNING: group-by already refers to: #'clojure.core/group-by in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/group-by WARNING: flatten already refers to: #'clojure.core/flatten in namespace: hadoop1, being replaced by: #'clojure.contrib.seq-utils/flatten 11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1 11/11/13 22:07:26 INFO mapred.JobClient: Running job: job_local_0001 11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1 11/11/13 22:07:26 INFO mapred.MapTask: io.sort.mb = 100 11/11/13 22:07:27 INFO mapred.MapTask: data buffer = 79691776/99614720 11/11/13 22:07:27 INFO mapred.MapTask: record buffer = 262144/327680 11/11/13 22:07:27 INFO mapred.JobClient: map 0% reduce 0% 11/11/13 22:07:30 INFO mapred.MapTask: Spilling map output: record full = true 11/11/13 22:07:30 INFO mapred.MapTask: bufstart = 0; bufend = 2097400; bufvoid = 99614720 11/11/13 22:07:30 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 11/11/13 22:07:31 INFO mapred.MapTask: Finished spill 0 11/11/13 22:07:32 INFO mapred.LocalJobRunner: 11/11/13 22:07:33 INFO mapred.MapTask: Spilling map output: record full = true 11/11/13 22:07:33 INFO mapred.MapTask: bufstart = 2097400; bufend = 4194707; bufvoid = 99614720 11/11/13 22:07:33 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 11/11/13 22:07:33 INFO mapred.JobClient: map 75% reduce 0% 11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 1 11/11/13 22:07:34 INFO mapred.MapTask: Starting flush of map output 11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 2 11/11/13 22:07:34 INFO mapred.Merger: Merging 3 sorted segments 11/11/13 22:07:34 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 6276350 bytes 11/11/13 22:07:35 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting 11/11/13 22:07:35 INFO mapred.LocalJobRunner: 11/11/13 22:07:35 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000000_0' done. 11/11/13 22:07:35 INFO mapred.LocalJobRunner: 11/11/13 22:07:35 INFO mapred.Merger: Merging 1 sorted segments 11/11/13 22:07:35 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 6276346 bytes 11/11/13 22:07:35 INFO mapred.LocalJobRunner: 11/11/13 22:07:35 WARN mapred.LocalJobRunner: job_local_0001 java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to java.util.Iterator at clojure.core$iterator_seq.invoke(core.clj:4561) at hadoop1$string_long_reduce_reader$fn__214.invoke(hadoop1.clj:40) at hadoop1$my_reduce.invoke(hadoop1.clj:31) at clojure.lang.AFn.applyToHelper(AFn.java:165) at clojure.lang.AFn.applyTo(AFn.java:151) at clojure.core$apply.invoke(core.clj:540) at clojure_hadoop.wrap$wrap_reduce$fn__178.invoke(wrap.clj:92) at clojure_hadoop.job_reducer.reduce(Unknown Source) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176) at clojure_hadoop.job_reducer.run(Unknown Source) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) 11/11/13 22:07:35 INFO mapred.JobClient: map 100% reduce 0% 11/11/13 22:07:35 INFO mapred.JobClient: Job complete: job_local_0001 11/11/13 22:07:35 INFO mapred.JobClient: Counters: 12 11/11/13 22:07:35 INFO mapred.JobClient: FileSystemCounters 11/11/13 22:07:35 INFO mapred.JobClient: FILE_BYTES_READ=22930784 11/11/13 22:07:35 INFO mapred.JobClient: FILE_BYTES_WRITTEN=28672002 11/11/13 22:07:35 INFO mapred.JobClient: Map-Reduce Framework 11/11/13 22:07:35 INFO mapred.JobClient: Reduce input groups=0 11/11/13 22:07:35 INFO mapred.JobClient: Combine output records=0 11/11/13 22:07:35 INFO mapred.JobClient: Map input records=12760 11/11/13 22:07:35 INFO mapred.JobClient: Reduce shuffle bytes=0 11/11/13 22:07:35 INFO mapred.JobClient: Reduce output records=0 11/11/13 22:07:35 INFO mapred.JobClient: Spilled Records=1255180 11/11/13 22:07:35 INFO mapred.JobClient: Map output bytes=5021164 11/11/13 22:07:35 INFO mapred.JobClient: Combine input records=0 11/11/13 22:07:35 INFO mapred.JobClient: Map output records=627590 11/11/13 22:07:35 INFO mapred.JobClient: Reduce input records=0 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira