> On July 11, 2016, 4:46 p.m., Sergio Pena wrote: > > beeline/src/java/org/apache/hive/beeline/BeeLineOpts.java, line 75 > > <https://reviews.apache.org/r/49782/diff/1/?file=1439316#file1439316line75> > > > > Should we use an constant variable for the 1000 number?
Yes thats a good idea, updated. > On July 11, 2016, 4:46 p.m., Sergio Pena wrote: > > beeline/src/java/org/apache/hive/beeline/IncrementalRows.java, line 36 > > <https://reviews.apache.org/r/49782/diff/1/?file=1439318#file1439318line36> > > > > is '--incremental' still working? > > Also, I don't see this config on the --help message. I think that > > adding it on BeeLine.properties will add it as Peter Vary mentioned. Yes the `--incremental` option still works, and in fact the new parameter only takes affect if `--incremental` is set to `true`. Right now, it is set to `false` by default, but there are efforts to set it to `true` by default. I updated the `BeeLine.properties` file and confirmed that the `--help` option displays the new parameter. - Sahil ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/49782/#review141714 ----------------------------------------------------------- On July 11, 2016, 5:29 p.m., Sahil Takiar wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/49782/ > ----------------------------------------------------------- > > (Updated July 11, 2016, 5:29 p.m.) > > > Review request for hive, Sergio Pena, Thejas Nair, and Vaibhav Gumashta. > > > Bugs: HIVE-14170 > https://issues.apache.org/jira/browse/HIVE-14170 > > > Repository: hive-git > > > Description > ------- > > * Added a new BeeLine Options called `incrementalBufferRows` which controls > the number of `Row`s the `IncrementalRows` class should buffer, by default it > is 1000 > * Modified `BufferedRows` so that it can accept a limit on the number of > `Row`s it buffers > * Modified `IncrementalRows` to read the value of `incrementalBufferRows` and > buffer rows as per HIVE-14170 > * The class delegates all buffering work to a `BufferedRows` class > * This has the advantage that all the width calculaltion that spans multiple > rows can be encapsulate in the `BufferedRows` class, there is no need to > re-implement the logic in `IncrementalRows` > * `IncrementalRows` will buffer `incrementalBufferRows` rows at a time, when > the buffer is depleted, it will fetch the next buffer and re-calculate the > width for that buffer > > > Diffs > ----- > > beeline/pom.xml a720d08 > beeline/src/java/org/apache/hive/beeline/BeeLineOpts.java 5aaa385 > beeline/src/java/org/apache/hive/beeline/BufferedRows.java 962c531 > beeline/src/java/org/apache/hive/beeline/IncrementalRows.java 8aef976 > beeline/src/java/org/apache/hive/beeline/Rows.java 453f685 > beeline/src/main/resources/BeeLine.properties 7500df9 > beeline/src/test/org/apache/hive/beeline/TestIncrementalRows.java > PRE-CREATION > > Diff: https://reviews.apache.org/r/49782/diff/ > > > Testing > ------- > > * Unit Test added for `IncrementalRows` > * Tested locally > > > Thanks, > > Sahil Takiar > >
