[jira] [Created] (HIVE-21652) Extend ALTER TABLE DROP PARTITION syntax to use regular expressions

2019-04-25 Thread Valeriy (JIRA)
Valeriy created HIVE-21652: -- Summary: Extend ALTER TABLE DROP PARTITION syntax to use regular expressions Key: HIVE-21652 URL: https://issues.apache.org/jira/browse/HIVE-21652 Project: Hive Issue T

[jira] [Created] (HIVE-21651) Move protobuf serde into hive-exec.

2019-04-25 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created HIVE-21651: Summary: Move protobuf serde into hive-exec. Key: HIVE-21651 URL: https://issues.apache.org/jira/browse/HIVE-21651 Project: Hive Issue Type: Bug

Re: HIVE-21639 and Hive 2.3.5 release

2019-04-25 Thread Alan Gates
Yuming, and Hjukjin, I've committed HIVE-21639 and HIVE-21536 to branch-2.3. Let me know once you've tested this against Spark 3 and are ready to start the release process. Alan. On Thu, Apr 25, 2019 at 9:47 AM Alan Gates wrote: > Yuming Wang and Hjukjin Kwon have proposed releasing a Hive 2.3

Re: A proposal for read-only external table for cloud-native Hive deployment

2019-04-25 Thread Gopal Vijayaraghavan
>reuse the transactional_properties and add 'read_only' as a new value. With >read-only tables, all INSERT, UPDATE, DELETE statements will fail at Hive >front-end. This is actually a common ask when it comes to OnPrem -> Cloud REPL streams, to avoid diverging. The replicated data ha

Re: A proposal for read-only external table for cloud-native Hive deployment

2019-04-25 Thread Alan Gates
My suggestion does require a change to your ETL process, but it doesn't require you to copy the data into HDFS or to create storage clusters. Hive managed tables can reside in S3 with no problem. Alan. On Thu, Apr 25, 2019 at 2:18 PM Thai Bui wrote: > Your suggested workflow will work and it w

Re: A proposal for read-only external table for cloud-native Hive deployment

2019-04-25 Thread Thai Bui
Your suggested workflow will work and it would require us to re-ETL data from S3 to all over the place to multiple clusters. This is a cumbersome approach since most of our data reside on S3 and clusters are somewhat transient in nature (in the order of a few months for a redeployment & don't have

HIVE-21639 and Hive 2.3.5 release

2019-04-25 Thread Alan Gates
Yuming Wang and Hjukjin Kwon have proposed releasing a Hive 2.3.5 that Spark can use. They need to push a couple of back ports into branch-2.3 first. See [1] and [2] for details. I'm willing to work with them to get this done. Alan. 1. https://issues.apache.org/jira/browse/HIVE-21639?focusedCo

Re: Hive Pulsar Integration

2019-04-25 Thread Slim Bouguerra
Hey sorry your image is not showing? Not sure why. On Wed, Apr 24, 2019 at 6:53 AM PengHui Li wrote: > Sorry for so long to reply, > > I drew a simple picture, hope can help for the question. > The main point is to reduce the read of messages from unnecessary topics > while read data from partit

[jira] [Created] (HIVE-21650) QOutProcessor should provide configurable partial masks for qtests

2019-04-25 Thread Aditya Shah (JIRA)
Aditya Shah created HIVE-21650: -- Summary: QOutProcessor should provide configurable partial masks for qtests Key: HIVE-21650 URL: https://issues.apache.org/jira/browse/HIVE-21650 Project: Hive