Re: How to capture query log and duration

2015-11-21 Thread Rajit Saha
Awesome !! Thanks a ton Gopal. Regards Rajit On 11/20/15, 1:35 PM, "Gopal Vijayaraghavan" wrote: > > >>Can you please also let me know what argument list this script want . >> >>I was trying following in HDP Sandbox , but did not get JSON outout > >The JSON output is saved into a .zip file,

Re: How to capture query log and duration

2015-11-20 Thread Gopal Vijayaraghavan
>Can you please also let me know what argument list this script want . > >I was trying following in HDP Sandbox , but did not get JSON outout The JSON output is saved into a .zip file, if you hit ^C. > https://gist.github.com/t3rmin4t0r/e4bf835f10271b9e466e Look for a file named atsdump*.zip

Re: How to capture query log and duration

2015-11-20 Thread Rajit Saha
Hi Gopal, Thanks for the help. Can you please also let me know what argument list this script want . I was trying following in HDP Sandbox , but did not get JSON outout [root@sandbox ~]# python ats-plan-fetcher.py --ats=http://127.0.0.1:8188/ws/v1/timeline/HIVE_QUERY_ID? --count=1 ats-plan-fetc

Re: How to capture query log and duration

2015-11-19 Thread Gopal Vijayaraghavan
> We would like to capture some information in our Hadoop Cluster. > Can anybody please suggest how we can we achieve this, any tools >available already ? Or do we need to scrub any log ? Apache Atlas is the standardized solution for deeper analytics into data ownership/usage (look at the HiveHoo