its 1073741824 now but I cant see anything running on client side, the job which kicked up by the query got completed but HS2 is crashing
On Wed, Sep 21, 2016 at 6:40 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > FetchOperator will run client side. What is the value for > hive.fetch.task.conversion.threshold? > > Thanks > Prasanth > > On Sep 21, 2016, at 6:37 PM, Sanjeev Verma <sanjeev.verm...@gmail.com> > wrote: > > > > I am getting hiveserver2 memory even after increasing the heap size from > 8G to 24G, in clue why it still going to OOM with enough heapsize > > > > "HiveServer2-HttpHandler-Pool: Thread-58026" prio=5 tid=58026 RUNNABLE > > at java.lang.OutOfMemoryError.<init>(OutOfMemoryError.java:48) > > at org.apache.hadoop.util.LineReader.<init>(LineReader.java:140) > > at org.apache.hadoop.mapreduce.lib.input.SplitLineReader.< > init>(SplitLineReader.java:37) > > at org.apache.hadoop.mapreduce.lib.input. > UncompressedSplitLineReader.<init>(UncompressedSplitLineReader.java:46) > > at org.apache.hadoop.mapred.LineRecordReader.<init>( > LineRecordReader.java:128) > > at org.apache.hadoop.mapred.TextInputFormat.getRecordReader( > TextInputFormat.java:67) > > at org.apache.hadoop.hive.ql.exec.FetchOperator$ > FetchInputFormatSplit.getRecordReader(FetchOperator.java:682) > > at org.apache.hadoop.hive.ql.exec.FetchOperator. > getRecordReader(FetchOperator.java:328) > > at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow( > FetchOperator.java:450) > > at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow( > FetchOperator.java:419) > > at org.apache.hadoop.hive.ql.exec.FetchTask.fetch( > FetchTask.java:143) > > at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1745) > > at org.apache.hive.service.cli.operation.SQLOperation. > getNextRowSet(SQLOperation.java:347) > > at org.apache.hive.service.cli.operation.OperationManager. > getOperationNextRowSet(OperationManager.java:223 > > at org.apache.hive.service.cli.session.HiveSessionImpl. > fetchResults(HiveSessionImpl.java:716) > > at sun.reflect.GeneratedMethodAccessor15.invoke(<unknown string>) > > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at org.apache.hive.service.cli.session.HiveSessionProxy. > invoke(HiveSessionProxy.java:78) > > at org.apache.hive.service.cli.session.HiveSessionProxy. > access$000(HiveSessionProxy.java:36) > > at org.apache.hive.service.cli.session.HiveSessionProxy$1. > run(HiveSessionProxy.java:63) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:415) > > at org.apache.hadoop.security.UserGroupInformation.doAs( > UserGroupInformation.java:1709) > >
