[ https://issues.apache.org/jira/browse/HADOOP-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer resolved HADOOP-2608. -------------------------------------- Resolution: Fixed I'm going to close this out as stale. > Reading sequence file consumes 100% cpu with maximum throughput being about > 5MB/sec per process > ----------------------------------------------------------------------------------------------- > > Key: HADOOP-2608 > URL: https://issues.apache.org/jira/browse/HADOOP-2608 > Project: Hadoop Common > Issue Type: Improvement > Components: io > Reporter: Runping Qi > > I did some tests on the throughput of scanning block-compressed sequence > files. > The sustained throughput was bounded at 5MB/sec per process, with the cpu of > each process maxed at 100%. > It seems to me that the cpu consumption is too high and the throughput is too > low for just scanning files. -- This message was sent by Atlassian JIRA (v6.2#6252)