Re: Parsing Hive Query to get table names and column names

2014-11-06 Thread Ritesh Gautam
Thank You, Alok and Devopam, it finally worked. I was able to parse the query as hive parses it by taking guidance from the hive codebase. Regards, Ritesh On Thu, Nov 6, 2014 at 1:23 PM, Alok Kumar wrote: > btw, what error are you getting with ANTLR or HiveParser? If any > dependency class file

Re: Parsing Hive Query to get table names and column names

2014-11-05 Thread Alok Kumar
btw, what error are you getting with ANTLR or HiveParser? If any dependency class file is missing? Thanks Alok On Thu, Nov 6, 2014 at 12:59 PM, Alok Kumar wrote: > As Devopam suggested, do it right way from the start. > > PS : if queries are written manually, you could get tables too manually.

Re: Parsing Hive Query to get table names and column names

2014-11-05 Thread Alok Kumar
As Devopam suggested, do it right way from the start. PS : if queries are written manually, you could get tables too manually. :) Thanks Alok On Wed, Nov 5, 2014 at 6:44 PM, Devopam Mittra wrote: > hi Ritesh, > Please reconsider your entire design , it might be helpful to do it now > than bec

Re: Parsing Hive Query to get table names and column names

2014-11-05 Thread Devopam Mittra
hi Ritesh, Please reconsider your entire design , it might be helpful to do it now than becoming unmanageable later. If unavoidable, please use a metadata based approach for pre-calculating and keeping the list of tables that you need to refresh prior to firing a query on them (?) Hope it helps.

Re: Parsing Hive Query to get table names and column names

2014-11-05 Thread Ritesh Gautam
hey Alok, I want to do this so that I can refresh the dependent tables before I run my query, so that my query would now run on the current data. The queries are written manually, so that the only way to do this will be to parse the query. Isn't Hive somewhat different from SQL? I have already tr

Re: Parsing Hive Query to get table names and column names

2014-11-05 Thread Alok Kumar
Hi, Why at the first place you would want this? ( just curious ) Few thoughts - a) Try to get it from the piece of code where these query are being generated [ if not static in code!], that would be best place to get it. b) [ if you don't have access to a) ] - try http://zql.sourceforge.net/ , i

Parsing Hive Query to get table names and column names

2014-11-05 Thread Ritesh Gautam
Hello, I am trying to parse hive queries so that I can get the table names on which the query is dependent on. I have tried the following : 1) downloaded the grammer and used ANTLR to generate the lexer and parser, but there are some errors as such when I try to build it: .. symbol: