Re: [feature request] auto-increment field in Hive

2018-09-16 Thread Nicolas Paris
On Sat, Sep 15, 2018 at 09:19:12PM -0700, Gopal Vijayaraghavan wrote: > Since we added a sequence + locking in Hive ACID, there's a Surrogate > Key prototype (for Hive 3.0) Great. I did not mention I needed an ACID compliant sequence. > This is not an auto_increment key, but the numbering is for

Re: [feature request] auto-increment field in Hive

2018-09-16 Thread Nicolas Paris
On Sat, Sep 15, 2018 at 09:38:01PM +, Vineet Garg wrote: > Not exactly sequence but an ability to generate unique numbers (with > limitation) is under development: > https://issues.apache.org/jira/browse/HIVE-20536 unique numbers is sufficient for a sequence. However, the limitation looks hug

Re: [feature request] auto-increment field in Hive

2018-09-15 Thread Jörn Franke
been done on it in a long time. A > simple UDF isn't capable of providing true unique sequence support. > > Thanks > Shawn > > -Original Message- > From: Jörn Franke > Sent: Saturday, September 15, 2018 6:09 AM > To: user@hive.apache.org > Subject: R

Re: [feature request] auto-increment field in Hive

2018-09-15 Thread Gopal Vijayaraghavan
Hi, > It doesn't help if you need concurrent threads writing to a table but we are > just using the row_number analytic and a max value subquery to generate > sequences on our star schema warehouse. Yup, you're right the row_number doesn't help with concurrent writes - it doesn't even scale be

Re: [feature request] auto-increment field in Hive

2018-09-15 Thread Vineet Garg
e.apache.org> Subject: Re: [feature request] auto-increment field in Hive If you really need it then you can write an UDF for it. On 15. Sep 2018, at 11:54, Nicolas Paris mailto:nicolas.pa...@riseup.net>> wrote: Hi Hive does not provide auto-increment columns (=sequences). Is there any chanc

RE: [feature request] auto-increment field in Hive

2018-09-15 Thread Shawn Weeks
ubject: Re: [feature request] auto-increment field in Hive If you really need it then you can write an UDF for it. > On 15. Sep 2018, at 11:54, Nicolas Paris wrote: > > Hi > > Hive does not provide auto-increment columns (=sequences). Is there any > chance that feature wi

Re: [feature request] auto-increment field in Hive

2018-09-15 Thread Jörn Franke
If you really need it then you can write an UDF for it. > On 15. Sep 2018, at 11:54, Nicolas Paris wrote: > > Hi > > Hive does not provide auto-increment columns (=sequences). Is there any > chance that feature will be provided in the future ? > > This is one of the highest limitation in hive