Wildcard and Automatic partitioning

Hi, is there a way in hive when I create an external table I can specify wild card in LOCATION and have hive automatically identify partitions. I have opened HIVE-17236 for wildcard support. same time I also have issue of specifying partitions. I

Re: Wildcard and Automatic partitioning

le must be created with the corresponding partition keys. > It may actually be good to have a feature to do it in a standard manner > for external tables only, however it would probably be restricted to the > same format. So, the example below probably won’t work because of the star >

Re: Wildcard and Automatic partitioning

the nested directories. In fact iirc it’s on by > default if Tez is used. > > From: Nirav Patel > Reply-To: "user@hive.apache.org" > Date: Thursday, August 3, 2017 at 11:41 > To: "user@hive.apache.org" > Subject: Re: Wildcard and Automatic partitioning >

Performance issue with hive metastore

Hi, I am trying to do 1000s of update parquet partition operations on different hive tables parallely from my client application. I am using sparksql with hive enabled in my application to submit hive query. spark.sql(" ALTER TABLE mytable PART

Re: Performance issue with hive metastore

> > Not sure what spark.sql exactly does, but my guess it reuses the HS2 > connection and with it the Session. You might be able to increase your > throughput by creating multiple connections. > > Thanks, > Peter > > > On Jan 30, 2020, at 02:04, Nirav Patel wrote: &g

ACID transaction over ORC

Hi, Are there any companies using hive ACID capabilities ? I am trying to understand how stable/reliable is ACID transaction on ORC in terms of ingesting real time data over 10 mins window and writing those data potentially on same ORC partition (merge into). Nirav

Re: ACID transaction over ORC

nt delete / update the hive acid + orc is a better > choice. If you just occasionally delete / update the rows, Iceberg could be > a better solution. (I personally would prefer Iceberg) but it depends on > your use case. Anyhow both will be an excellent choice. > > -Attila > > On T