Re: HWI use on AWS/EMR

Hey Tony, Nitin's approach would work for you as well. Amazon has very good documentation of their services. A quick google search should get you the right info. Best, Ariel - Ariel Marcus, Consultant www.openbi.com | ariel.mar...@openbi.com 150 N Michigan Avenue,

RE: HWI use on AWS/EMR

If you could provide the steps to do this I'd be grateful - thanks. Thanks for all your input so far, time to head home for the weekend so I'll try it again with a fresh EMR instance next week. Tony From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: 18 January 2013 17:08 To: user@hive

Re: HWI use on AWS/EMR

ok so much discussion around this but why dont you open access to port for your specific machine (home/office) and access it normally without setting up port forwarding. AWS does give you ip level access control in the security groups On Fri, Jan 18, 2013 at 10:35 PM, Ariel Marcus wrote: >

Re: HWI use on AWS/EMR

This should be localhost instead of proxy: - In Connection/SSH/Tunnels I’ve added in the Source Port box, * localhost*: in the Destination box. Not sure if this is correct. Best, Aril - Ariel Marcus, Consultant www.openbi.com | ariel.mar...@openbi.com 150

RE: HWI use on AWS/EMR

Ok, thanks Ariel (and Dean in the next email!) I've set up PuTTY (v0.62) as follows: - EMR instance hostname in the Session/Host Name box (port left at 22, ok?) - In Connection/SSH/Auth I've added my private key file, downloaded from AWS ages for this account. - In Connection/SSH/Tunnels I've ad

Re: HWI use on AWS/EMR

Yes, this is straightforward to set up in Putty. Ariel, thanks for providing the details I was too lazy to mention ;) One flaw with this approach is that only your machine will have access to HWI. That is, the port is forwarded only to your machine. Making the ports public on the master node mean

Re: HWI use on AWS/EMR

Hey Tony, Port forwarding is the same as what Dean referred to as ssh tunneling. Here is a website explaining how to set up port forwarding in putty (use port ): http://www.cs.uu.nl/technical/services/ssh/putty/puttyfw.html You can edit either hive-default or hive-site but the general practi

RE: HWI use on AWS/EMR

Hi Ariel, Thanks for the speedy reply. We'll be accessing the HWI from Windows rather Linux desktops, so can you help me out with understanding how to carry out the port forwarding from a Windows environment? Currently I use WinSCP to initiate a connection to the EMR instance, then spawn a PuTT

RE: HWI use on AWS/EMR

Thanks for the quick reponse Dean. Confirmed that http://ec2-XX-AAA-BB-CCC.eu-west-1.compute.amazonaws.com gives the same timeout. Doesn't specifying http://: override the requirement for port 80 being open? Is ssh tunnelling the same as the process described by

Re: HWI use on AWS/EMR

Hey Tony, I would recommend using ssh port forwarding instead of making your hwi publicly available on the internet. When you connect to the master node using ssh you should use a command like the following: ssh -i /path/to/keyfile.pem -L :localhost: -l hadoop MASTER_HOSTNAME After you h

Re: HWI use on AWS/EMR

Oops, I overlooked that you have the public domain name in your message. Can you surf to http://ec2-54-247-61-206.eu-west-1.compute.amazonaws.com ? If not, does HWI use port 80? Is whatever port it uses blocked by EC2? If it's blocked you can use ssh to tunnel the port through. dean On Fri, Ja

Re: HWI use on AWS/EMR

That's the internal hostname, not visible outside. Use the name like ec2-NNN-NN-NN-NNN.compute-1.amazonaws.com. It's shown in the EMR console and the elastic-mapreduce script you might have used to launch the cluster. If that doesn't work, verify that port 80 is not blocked by default. That's cert

HWI use on AWS/EMR

Hi, I'm trying to get HWI running and accessible from an Amazon Web Services EMR instance. I've hit a blocker early on though, and the documentation is less than illuminating. Can you share any experiences you have had? Specifically, here's what I'm curious about. - Running on AWS. I've create

HiveQL where value not empty

Hi there, Im new here, but I have a short question I could very much use a quick answer, I am trying to find out how I could Filter empty value's. Is there a command similar to where (text is not Empty) With regards, Arthur From: nagarjuna kanamarlapudi [mailto:nagarjuna.kanamarlap...@gmail.co

Re: Execution of udf

That should be an identity pass through or NOOP that does nothing, but MapReduce requires "something". On Fri, Jan 18, 2013 at 8:57 AM, nagarjuna kanamarlapudi < nagarjuna.kanamarlap...@gmail.com> wrote: > No but the query execution shows a reducer running .. And infant I feel > that reduce phase

Re: Execution of udf

No but the query execution shows a reducer running .. And infant I feel that reduce phase can be there On Friday, January 18, 2013, Dean Wampler wrote: > There is no reduce phase needed in this query. > > On Fri, Jan 18, 2013 at 6:59 AM, nagarjuna kanamarlapudi < > nagarjuna.kanamarlap...@gmail.c

Re: Execution of udf

There is no reduce phase needed in this query. On Fri, Jan 18, 2013 at 6:59 AM, nagarjuna kanamarlapudi < nagarjuna.kanamarlap...@gmail.com> wrote: > Hi, > > Select col1,myudf(col2,col3) from table1; > > > In what phase if map reduce an udf is executed. > > In the very beginning, I assumed that h

jdbc connection breaking on ALTER

Hi I'm experiencing a strange behaviour with hive-0.9.0. Accessing it through JDBC driver and using ALTER statements causes the session to break. Specifically, the first successful ALTER breaks it. Steps to reproduce: alter table xyz add partition (dt='1'); alter table xyz add partition (dt='2')