Re: Remove subscription form list

2017-06-02 Thread Lefty Leverenz
Maybe you should just try again. A typo could have blocked your message. -- Lefty On Fri, Jun 2, 2017 at 8:18 AM, John Tench wrote: > I didn’t receive any confirmation message. Maybe the server is rejecting > my message as spam? > > > > I can’t see how I could be subscribed under two email ac

Re: FYI: Backports of Hive UDFs

2017-06-02 Thread Edward Capriolo
Don't we currently support features that load functions from external places like maven http server etc? I wonder if it would be easier to back port that back port a handful of functions ? On Fri, Jun 2, 2017 at 2:22 PM, Alan Gates wrote: > Rather than put that code in hive/contrib I was thinkin

Re: FYI: Backports of Hive UDFs

2017-06-02 Thread Alan Gates
Rather than put that code in hive/contrib I was thinking that you could just backport the Hive 2.2 UDFs into the same locations in Hive 1 branch. That seems better than putting them into different locations on different branches. If you are willing to do the porting and post the patches (including

RE: Migrating Variable Length Files to Hive

2017-06-02 Thread Ryan Harris
Depending on your use case and whether or not you will continue adding data to this table on an ongoing basis, I would probably either JSON encode all of the data, and drop everything into a single column in hive, and then use JSON UDF to create a hive view to map the columns you care about, or

Re: Migrating Variable Length Files to Hive

2017-06-02 Thread Nishanth S
Thanks Ryan. In my case I have around 200 small files in mainframe . Columns are same within a file but vary in number across files .Now I need to get all these data into a *single* hive table . The first three columns are standard in case of all files .Any idea how the schema would look if I

Re: Migrating Variable Length Files to Hive

2017-06-02 Thread Nishanth S
Thanks Edward . I am leaning towards using array .My nested data does not have a schema .It is a collection of strings and the number of strings can vary. On Fri, Jun 2, 2017 at 10:41 AM, Edward Capriolo wrote: > > > On Fri, Jun 2, 2017 at 12:07 PM, Nishanth S > wrote: > >> Hello hive users

RE: Migrating Variable Length Files to Hive

2017-06-02 Thread Ryan Harris
I wrote some custom python parsing scripts using StingRay Reader ( http://stingrayreader.sourceforge.net/cobol.html ) that read in the copybooks and use the results to automatically generate hive table schema based on the source copybook. The EBCDIC data is then extracted to TAB separated ASCII

Re: Migrating Variable Length Files to Hive

2017-06-02 Thread Gopal Vijayaraghavan
> We are looking at migrating  files(less than 5 Mb of data in total) with > variable record lengths from a mainframe system to hive. https://issues.apache.org/jira/browse/HIVE-10856 + https://github.com/rbheemana/Cobol-to-Hive/ came up on this list a while back. > Are there other alternative

Re: Migrating Variable Length Files to Hive

2017-06-02 Thread Edward Capriolo
On Fri, Jun 2, 2017 at 12:07 PM, Nishanth S wrote: > Hello hive users, > > We are looking at migrating files(less than 5 Mb of data in total) with > variable record lengths from a mainframe system to hive.You could think of > this as metadata.Each of these records can have columns ranging from

Migrating Variable Length Files to Hive

2017-06-02 Thread Nishanth S
Hello hive users, We are looking at migrating files(less than 5 Mb of data in total) with variable record lengths from a mainframe system to hive.You could think of this as metadata.Each of these records can have columns ranging from 3 to n( means each record type have different number of colu

RE: Remove subscription form list

2017-06-02 Thread John Tench
I didn’t receive any confirmation message. Maybe the server is rejecting my message as spam? I can’t see how I could be subscribed under two email accounts. John . From: Lefty Leverenz [mailto:leftylever...@gmail.com] Sent: June 2, 2017 01:59 To: user@hive.apache.org Subject: Re: Rem