[jira] [Commented] (HIVE-2623) Add Integer type compressors

2012-08-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13438434#comment-13438434 ] Krishna Kumar commented on HIVE-2623: - Hi Rao, I have not been able to do

[jira] [Updated] (HIVE-2097) Explore mechanisms for better compression with RC Files

2012-05-14 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2097: Attachment: datacomp.tar.gz unrefactored source for all the implemented compression codecs

[jira] [Commented] (HIVE-2623) Add Integer type compressors

2012-02-13 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206967#comment-13206967 ] Krishna Kumar commented on HIVE-2623: - I will attach cpu usage information

[jira] [Created] (HIVE-2692) Add compressors for qualitative data types

2012-01-04 Thread Krishna Kumar (Created) (JIRA)
Reporter: Krishna Kumar Assignee: Krishna Kumar Priority: Minor Any data type (int, string et al) for which the frequency of occurrences can be counted (a.k.a. categorical or enumeration types), can be compressed via methods such as huffman, arithmetic and ppm compressors

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Status: Patch Available (was: Open) > Add Integer type compress

[jira] [Commented] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174824#comment-13174824 ] Krishna Kumar commented on HIVE-2623: - Compression efficiency stats (unary is opt

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlawTimestamp.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: data.tar.gz Artificial data sets for the 8 integer compressors. >

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlaw1S.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlaw2S.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlawIQ.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: HIVE-2623.v2.patch Added another simple integer coder (unary) and the four variants of

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Component/s: (was: Query Processor) (was: Serializers/Deserializers

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Component/s: (was: Query Processor) (was: Serializers/Deserializers

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-17 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Attachment: HIVE-2604.v2.patch > Add UberCompressor Serde/Codec to contrib which allows

[jira] [Commented] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-08 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165815#comment-13165815 ] Krishna Kumar commented on HIVE-2604: - :) I used the word Uber, not in the sens

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-12-08 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Status: Patch Available (was: Open) > Enable/Add type-specific compression for rcf

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-08 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Status: Patch Available (was: Open) > Add UberCompressor Serde/Codec to contrib which all

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-08 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Attachment: HIVE-2604.v1.patch Serde wraps lazysimpleserde to make it more similar to columnarserde

[jira] [Commented] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163437#comment-13163437 ] Krishna Kumar commented on HIVE-2623: - RCFile size stats: gzip/bzip2/

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: HIVE-2623.v1.patch Added 3 three more elias gamma compressors - so now supporting one

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: steppedpowerlawTimestamp.gz steppedpowerlawIQ.gz

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlaw.gz) > Add Integer type compress

[jira] [Commented] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-05 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162709#comment-13162709 ] Krishna Kumar commented on HIVE-2604: - The current implementation works as fol

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-12-05 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162705#comment-13162705 ] Krishna Kumar commented on HIVE-2600: - He Yongqiang, In UberCompressor, I have

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-05 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: steppedpowerlaw.gz Synthetic data for elias gamma. Storage size when stored as rc

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-05 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: HIVE-2623.v0.patch Elias gamma for a two-sided distribution. Draft only - tests and one

[jira] [Created] (HIVE-2623) Add Integer type compressors

2011-12-05 Thread Krishna Kumar (Created) (JIRA)
Add Integer type compressors Key: HIVE-2623 URL: https://issues.apache.org/jira/browse/HIVE-2623 Project: Hive Issue Type: Sub-task Reporter: Krishna Kumar Assignee: Krishna Kumar

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-29 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159734#comment-13159734 ] Krishna Kumar commented on HIVE-2600: - That is part of the compression codec

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-28 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159122#comment-13159122 ] Krishna Kumar commented on HIVE-2600: - I have chosen to record that information in

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-28 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Attachment: HIVE-2600.v1.patch Added logging to report every column's total le

[jira] [Commented] (HIVE-2097) Explore mechanisms for better compression with RC Files

2011-11-28 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158484#comment-13158484 ] Krishna Kumar commented on HIVE-2097: - Thanks Alex for the suggestions. Just t

[jira] [Commented] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-24 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156758#comment-13156758 ] Krishna Kumar commented on HIVE-2604: - Sure. I'll add some of the compressors

[jira] [Assigned] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-23 Thread Krishna Kumar (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar reassigned HIVE-2604: --- Assignee: Krishna Kumar > Add UberCompressor Serde/Codec to contrib which allows

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-23 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156006#comment-13156006 ] Krishna Kumar commented on HIVE-2600: - Added the code for uber codec/serde to

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-23 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Attachment: HIVE-2604.v0.patch initial version of the patch. > Add UberCompres

[jira] [Created] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-23 Thread Krishna Kumar (Created) (JIRA)
Project: Hive Issue Type: Sub-task Reporter: Krishna Kumar The strategies supported are 1. using a specified codec on the column 2. using a specific codec on the column which is serialized via a specific serde 3. using a specific "TypeSpecificCompressor" instanc

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-22 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155228#comment-13155228 ] Krishna Kumar commented on HIVE-2600: - This should be usable for any rcfile data.

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Status: Patch Available (was: Open) > Enable/Add type-specific compression for rcf

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Attachment: HIVE-2600.v0.patch Added two interfaces and invocations at appropriate places

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Description: Enable schema-aware compression codecs which can perform type-specific compression on

[jira] [Created] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Created) (JIRA)
, Serializers/Deserializers Reporter: Krishna Kumar Assignee: Krishna Kumar Priority: Minor Enable schema-aware compression codecs which can perform type-specific compression on a per-column basis. I see this as in three-parts 1. Add interfaces for the rcfile to

[jira] [Updated] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-09-01 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2413: Attachment: HIVE-2413.v1.patch Empty string not handled correctly in JC so handling it here

[jira] [Updated] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-30 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2417: Attachment: HIVE-2417.v1.patch Test changed after review comments - default codec instead of bzip2

[jira] [Commented] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-30 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094294#comment-13094294 ] Krishna Kumar commented on HIVE-2417: - Yes, the test is designed to produce the e

[jira] [Updated] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-08-29 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2413: Assignee: Krishna Kumar Status: Patch Available (was: Open) > BlockMergeTask ignores cli

[jira] [Updated] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-29 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2417: Status: Patch Available (was: Open) > Merging of compressed rcfiles fails to write the valuebuf

[jira] [Updated] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-29 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2417: Attachment: HIVE-2417.v0.patch Test added > Merging of compressed rcfiles fails to write

[jira] [Created] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-29 Thread Krishna Kumar (JIRA)
Type: Bug Components: Query Processor Reporter: Krishna Kumar Assignee: Krishna Kumar Attachments: HIVE-2417.v0.patch The blockmerge task does not create proper rc files when merging compressed rc files as the valuebuffer writing is incorrect. -- This

[jira] [Updated] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-08-25 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2413: Attachment: HIVE-2413.v0.patch Here is a simple fix which works for me, though there may be better

[jira] [Created] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-08-25 Thread Krishna Kumar (JIRA)
Reporter: Krishna Kumar Priority: Minor User-specified jars are not added to the hadoop tasks while executing a BlockMergeTask resulting in a ClassNotFoundException. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software

[jira] [Updated] (HIVE-2384) import of multiple partitions from a partitioned table with external location overwrites files

2011-08-17 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2384: Attachment: HIVE-2384.v0.patch Patch with tests > import of multiple partitions from a partitio

[jira] [Updated] (HIVE-2384) import of multiple partitions from a partitioned table with external location overwrites files

2011-08-17 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2384: Assignee: Krishna Kumar Status: Patch Available (was: Open) > import of multiple partiti

[jira] [Created] (HIVE-2384) import of multiple partitions from a partitioned table with external location overwrites files

2011-08-17 Thread Krishna Kumar (JIRA)
Project: Hive Issue Type: Bug Components: Query Processor Reporter: Krishna Kumar when we import multiple partitions from an exported partitioned table, if we import it with a specified external location, then the partitions end up overwriting. -- This

[jira] [Commented] (HIVE-956) Add support of columnar binary serde

2011-07-19 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067588#comment-13067588 ] Krishna Kumar commented on HIVE-956: Common code moved to a base class to

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-07-19 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Attachment: HIVE-956v4.patch Please note that HIVE-2209 is a pre-requisite for this patch. >

Re Stats Publishing /Aggregation

2011-06-20 Thread Krishna Kumar
Any reason why persistent stores such as jdbc and hbase are supported for temporary stats storage IIUC, but hadoop counters were not used for the tasks to 'publish' their stats for the aggregation task to pick it up from? Cheers, Krishna

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-06-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Status: Patch Available (was: Open) I have tested the setting of rawDataSize with a "ANALYZE

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-06-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Attachment: HIVE-956v3.patch After separating mapcomparer changes to its own jira/patch - HIVE-2209

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Attachment: HIVE-2209v2.patch Fixed a lowercase/uppercase typo in the test classes > Provide a

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-17 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Attachment: HIVE2209v1.patch Added another implementation with sorting of the keys > Provide a

[jira] [Commented] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-14 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13049297#comment-13049297 ] Krishna Kumar commented on HIVE-2209: - He Yongqiang, Can you take a look at this

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-10 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Status: Patch Available (was: Open) For review by He Yongqiang > Provide a way by wh

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-10 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Attachment: HIVE-2209v0.patch Patch, with tests, added. > Provide a way by wh

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-09 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Issue Type: Improvement (was: Sub-task) Parent: (was: HIVE-956) > Provide a way

[jira] [Created] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-09 Thread Krishna Kumar (JIRA)
URL: https://issues.apache.org/jira/browse/HIVE-2209 Project: Hive Issue Type: Sub-task Reporter: Krishna Kumar Assignee: Krishna Kumar Priority: Minor Now ObjectInspectorUtils.compare throws an exception if a map is contained

[jira] [Commented] (HIVE-956) Add support of columnar binary serde

2011-06-09 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046362#comment-13046362 ] Krishna Kumar commented on HIVE-956: bq. can warnedOnceNullMapKey be removed? I

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-06-08 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Attachment: HIVE.956.patch.2 Re-ordering my responses; bq. can LazyBinaryColumnarSerDe share some

[jira] [Commented] (HIVE-956) Add support of columnar binary serde

2011-06-08 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046043#comment-13046043 ] Krishna Kumar commented on HIVE-956: Re-ordering my responses; bq.

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-06-02 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Attachment: HIVE.956.patch.1 Patch with a change on how null vs empty strings are handled. This patch

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-06-02 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Status: Patch Available (was: Open) > Add support of columnar binary se

[jira] [Commented] (HIVE-956) Add support of columnar binary serde

2011-05-31 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13041506#comment-13041506 ] Krishna Kumar commented on HIVE-956: Review board: https://reviews.apache.org/r

[jira] [Commented] (HIVE-956) Add support of columnar binary serde

2011-05-31 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13041502#comment-13041502 ] Krishna Kumar commented on HIVE-956: Initial patch for lazy binary columnar s

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-05-31 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Attachment: HIVE.956.patch.0 Initial patch for lazy binary columnar serde. Reuses elements of columnar

[jira] [Commented] (HIVE-2065) RCFile issues

2011-04-07 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13017229#comment-13017229 ] Krishna Kumar commented on HIVE-2065: - The minor version is needed so that we

[jira] [Updated] (HIVE-2098) Make couple of convenience methods in EximUtil public

2011-04-07 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2098: Status: Patch Available (was: Open) > Make couple of convenience methods in EximUtil pub

[jira] [Updated] (HIVE-2098) Make couple of convenience methods in EximUtil public

2011-04-07 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2098: Attachment: HIVE.2098.patch.0.txt Couple of methods made public for use outside of the package

[jira] [Assigned] (HIVE-2098) Make couple of convenience methods in EximUtil public

2011-04-07 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar reassigned HIVE-2098: --- Assignee: Krishna Kumar > Make couple of convenience methods in EximUtil pub

[jira] [Created] (HIVE-2098) Make couple of convenience methods in EximUtil public

2011-04-07 Thread Krishna Kumar (JIRA)
Make couple of convenience methods in EximUtil public - Key: HIVE-2098 URL: https://issues.apache.org/jira/browse/HIVE-2098 Project: Hive Issue Type: Bug Reporter: Krishna

[jira] [Updated] (HIVE-2071) enforcereadonlytables hook should not check a configuration variable

2011-04-06 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2071: Attachment: HIVE.2071.patch.0.txt Tentative patch to show the implementation for the sessionstate

[jira] [Commented] (HIVE-2097) Explore mechanisms for better compression with RC Files

2011-04-06 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016451#comment-13016451 ] Krishna Kumar commented on HIVE-2097: - Comment hijacked from HIVE-2065: He Yongq

[jira] [Assigned] (HIVE-2097) Explore mechanisms for better compression with RC Files

2011-04-06 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar reassigned HIVE-2097: --- Assignee: Krishna Kumar > Explore mechanisms for better compression with RC Fi

[jira] [Created] (HIVE-2097) Explore mechanisms for better compression with RC Files

2011-04-06 Thread Krishna Kumar (JIRA)
: Query Processor, Serializers/Deserializers Reporter: Krishna Kumar Priority: Minor Optimization of the compression mechanisms used by RC File to be explored. Some initial ideas 1. More efficient serialization/deserialization based on type-specific and storage-specific

[jira] [Commented] (HIVE-2065) RCFile issues

2011-04-06 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016444#comment-13016444 ] Krishna Kumar commented on HIVE-2065: - Updated patch where sequence file complianc

[jira] [Updated] (HIVE-2065) RCFile issues

2011-04-06 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2065: Attachment: HIVE.2065.patch.1.txt Updated patch where sequence file compliance is not addressed but

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-31 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014351#comment-13014351 ] Krishna Kumar commented on HIVE-2065: - As I indicated, the reason I made changes

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-31 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014065#comment-13014065 ] Krishna Kumar commented on HIVE-2065: - The RCFile layout seems to have been desi

[jira] [Updated] (HIVE-2065) RCFile issues

2011-03-28 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2065: Status: Patch Available (was: Open) > RCFile issues > - > >

[jira] [Commented] (HIVE-2071) enforcereadonlytables hook should not check a configuration variable

2011-03-28 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13012293#comment-13012293 ] Krishna Kumar commented on HIVE-2071: - Namit, While we can read the config vari

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-28 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13012125#comment-13012125 ] Krishna Kumar commented on HIVE-2065: - Review Board Entry at h

[jira] [Updated] (HIVE-2065) RCFile issues

2011-03-28 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2065: Attachment: HIVE.2065.patch.0.txt Patch. Since it contains binary files, it was generated with

[jira] [Updated] (HIVE-2065) RCFile issues

2011-03-28 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2065: Attachment: proposal.png The layout as implemented in the attached patch > RCFile iss

[jira] [Updated] (HIVE-2065) RCFile issues

2011-03-28 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2065: Attachment: (was: proposal.png) > RCFile issues > - > >

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-22 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009981#comment-13009981 ] Krishna Kumar commented on HIVE-2065: - Hmm. #3 is taking me a bit too far th

[jira] [Updated] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2003: Status: Patch Available (was: Open) Please review asap as there are lots of changes to q.out files

[jira] [Commented] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-21 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009203#comment-13009203 ] Krishna Kumar commented on HIVE-2003: - For #4 above, I have taken now the

[jira] [Commented] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-21 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009202#comment-13009202 ] Krishna Kumar commented on HIVE-2003: - Added to review board: h

[jira] [Updated] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-21 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2003: Attachment: HIVE-2003.patch.1.txt Regenerated the patch. > LOAD compilation does not set

[jira] Updated: (HIVE-2065) RCFile issues

2011-03-19 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2065: Attachment: proposal.png Notation : Length bracket inside the dashed box means it is the

[jira] Commented: (HIVE-2065) RCFile issues

2011-03-19 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008741#comment-13008741 ] Krishna Kumar commented on HIVE-2065: - So should I go ahead and fix #2 and #3 as

  1   2   >