I've heard similar use cases from NCSoft(A big game company in Korea)
platform team but they might use their own StorageHandler
(and HiveStoragePredicateHandler) implementation.
We might introduce new injection point for partition pruning, If you can
implement the logic via an interface similar wi
Hi Alan,
thank you for your reply. The loose idea I had was to store one row in the
RDBMS per Hive partition so I don't think the size will be an issue
(expecting 3000 partitions or so). The end goal was to help to decide which
partitions that are relevant for a query. Something like adding partit
HCatalog is definitely not designed for this purpose. Could you explain your
use case more fully? Is this indexing for better query planning or faster file
access? If so, you might look at some of the work going on in ORC, which is
storing indices of its data in the format itself for these pu
Hi,
I have a case where I would like to extend Hive to use information from a
regular RDBMS. To limit the complexity of the installation I thought I
could piggyback on the already existing metatstore.
As I understand it, HCatalog is not built for this purpose. Is there
someone out there that has
