Re: hbase column without prefix

2015-07-24 Thread Wojciech Indyk
I know a solution with column family -> hive map, but HBase doesn't support more than 2 CF well. I need ~10 maps in row. I think the idea with a flag is very well. I've prepared a patch to be able to use a flag. I am not sure where to include the possibility to define a flag and pass the flag to L

Re: hbase column without prefix

2015-07-23 Thread kulkarni.swar...@gmail.com
So let me ask you this. If we did not have the support for pulling data via prefixes, there would be two options for us to pull this data. One, wither we provide just the column family name like "fam:" and let hive pull everything under that column family and stuff it in a map with key being the co

Re: hbase column without prefix

2015-07-23 Thread Wojciech Indyk
Hello! Yes, but if I define a map prefix "tag_" I don't want to receive the prefix for each element of the map. I know what the prefix for the map is. It is hard to join such data with another structures which doesn't have prefixes. All in all it's easier to integrate data without prefixes. IMO Pr

Re: hbase column without prefix

2015-07-23 Thread kulkarni.swar...@gmail.com
Hey, Just so that I understand your issue better, why do you think it should be key: one, value: 0.5 key: two: value: 0.5 instead of key: tag_one, value: 0.5 key: tag_two, value: 0.5 when you know that the prefixes for your columns are tag_. Hive won't really do anything but simply pull all th

hbase column without prefix

2015-07-22 Thread Wojciech Indyk
Hi! I've created an issue https://issues.apache.org/jira/browse/HIVE-11329 and need an advice is it a bug or should it be a new feature, e.g. a flag to enable somewhere in a table definition? I am eager to create a patch, however I need some help with design a work to do (e.g. which modules affect