Re: Hive ExIm from on-premise HDP to Amazon EMR

2016-01-24 Thread Artem Ervits
Have you looked at Apache Falcon? On Jan 8, 2016 2:41 AM, "Elliot West" wrote: > Further investigation appears to show this going wrong in a copy phase of > the plan. The correctly functioning HDFS → HDFS import copy stage looks > like this: > > STAGE PLANS: > Stage: Stage-1 > Copy >

Re: simple jason file analysing in Hive-0.14 using serde

2016-01-24 Thread Artem Ervits
Try this https://github.com/dbist/workshops/tree/master/hive/JSON On Jan 14, 2016 12:59 PM, "sri sowj" wrote: > Hi All, > > I am trying to execute hive commands on json file using > jsonserde's,but I am always getting null values ,but not actual data. > I have used serde's provided in > "code.goo

Re: how to set a job name for hive queries

2016-01-23 Thread Artem Ervits
Please see this, its possible with Tez in Hive 1.2.1 https://community.hortonworks.com/questions/9004/naming-tez-hive-session.html On Jan 19, 2016 11:06 AM, "Frank Luo" wrote: > We are in a multi-tenant environment wanting to add a client’s name into > each job name hence they can be informed/inv

RE: Hive on TEZ fails starting

2016-01-05 Thread Artem Ervits
Check if you have conflicting java versions On Jan 5, 2016 5:27 PM, "Mich Talebzadeh" wrote: > Hi Rajesh, > > > > This is what I have under :$HADOOP_COMMON_HOME/lib/native > > > > cd $HADOOP_COMMON_HOME/lib/native > > hduser@rhes564::/home/hduser/hadoop-2.6.0/lib/native> ls -ltr > > total 4936 >

Re: Storing the Hive Query Results into Variable

2015-12-04 Thread Artem Ervits
You can certainly do that with pig. On Dec 3, 2015 7:18 PM, "mahender bigdata" wrote: > Hi, > Is there option available to store hive results into variable like > > select @i= count(*) from HiveTable. > > or > > Storing Table Results into variable and make use of it later stage of > Query. I tire

Re: 答复: tunning guide

2015-12-01 Thread Artem Ervits
Here you go http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_performance_tuning/content/ch_hive_architectural_overview.html On Dec 1, 2015 4:25 AM, "San Luo" wrote: > Gotta ,thanks > > > > *发件人:* Srinivas Thunga [mailto:srinivas.thu...@gmail.com] > *发送时间:* 2015年12月1日 17:09 > *收件人:* user

Re: hive failure after HDP 2.3 upgrade

2015-11-19 Thread Artem Ervits
Confirm Hive metastore schema update scripts have run. On Nov 19, 2015 11:39 AM, "Brian Jeltema" wrote: > Following up, I turned on logging in the MySQL server to capture the > failing query. The query being logged by MySQL is > > SELECT `A0`.`NAME` AS NUCORDER0 FROM `DBS` `A0` WHERE > LOWER(`A

Re: Need suggestions on processing JSON junk (e.g., invalid double quotes) data using HIVE

2015-10-23 Thread Artem Ervits
Hive 0.13 and up has json serde built in, no need to register another serde . Flume has a Hive streaming sink so you could directly stream to Hive as well with flume 1.6.the json serde is from hcatalog BTW. You sure the text field doesn't have the quote? User-entered data may be malformed. Your oth

Re: Storm HiveBolt missing records due to batching of Hive transactions

2015-10-21 Thread Artem Ervits
Please try this version https://github.com/apache/storm/blob/master/external/storm-hive/pom.xml On Oct 21, 2015 11:19 AM, "Harshit Raikar" wrote: > withTickTupleInterval parameter is not available in the storm version > which I am using. > > On 21 October 2015 at 14:02, Harshit Raikar > wrote: >

RE: load data stored as sequencefiles

2013-09-24 Thread Artem Ervits
I was concentrating on your first suggestion and didn't realize that you already answered my question in the 2nd part of your answer :). Thank you, I will try that. From: Artem Ervits [mailto:are9...@nyp.org] Sent: Tuesday, September 24, 2013 12:59 PM To: user@hive.apache.org Subject: RE:

RE: load data stored as sequencefiles

2013-09-24 Thread Artem Ervits
you may want to give complete file name instead of part file in load command On Tue, Sep 24, 2013 at 7:51 PM, Artem Ervits mailto:are9...@nyp.org>> wrote: Anyone? From: Artem Ervits [mailto:are9...@nyp.org<mailto:are9...@nyp.org>] Sent: Friday, September 20, 2013 11:18 AM To:

RE: load data stored as sequencefiles

2013-09-24 Thread Artem Ervits
Anyone? From: Artem Ervits [mailto:are9...@nyp.org] Sent: Friday, September 20, 2013 11:18 AM To: user@hive.apache.org Subject: load data stored as sequencefiles Hello all, I'm a bit lost with using Hive and SequenceFiles. I loaded data using Sqoop from a RDBMS and stored as sequencefi

load data stored as sequencefiles

2013-09-20 Thread Artem Ervits
Hello all, I'm a bit lost with using Hive and SequenceFiles. I loaded data using Sqoop from a RDBMS and stored as sequencefile. I jarred the class generated by sqoop and added it to my create table script. Now I create a table in hive and specify "STORED AS SEQUENCEFILE", I also "ADD JAR SQOOP_

Re: FAILED: ParseException line 12:0 mismatched input 'Comment' expecting Identifier near ',' in column specification

2013-09-18 Thread Artem Ervits
Thank you, will do. Artem Ervits Data Analyst New York Presbyterian Hospital From: Justin Workman [mailto:justinjwork...@gmail.com] Sent: Wednesday, September 18, 2013 11:01 AM To: user@hive.apache.org Subject: Re: FAILED: ParseException line 12:0 mismatched input 'Comment'

RE: FAILED: ParseException line 12:0 mismatched input 'Comment' expecting Identifier near ',' in column specification

2013-09-18 Thread Artem Ervits
Anyone? From: Artem Ervits [mailto:are9...@nyp.org] Sent: Monday, September 16, 2013 5:07 PM To: user@hive.apache.org Subject: FAILED: ParseException line 12:0 mismatched input 'Comment' expecting Identifier near ',' in column specification Hello all, I'm trying to cre

FAILED: ParseException line 12:0 mismatched input 'Comment' expecting Identifier near ',' in column specification

2013-09-16 Thread Artem Ervits
version of Hive. Is that a bug or a feature? I understand that you can insert comments in DDL statements but what if a column name happens to be a reserved word, as in this case? Thanks Artem Ervits ar...@nyp.org<mailto:ar...@nyp.org> New York Presbyterian Hospital This electronic mess

Re: how to config the job id in oozie

2013-09-04 Thread Artem Ervits
You can also use shell action to generate timestamp in format you want and pass to the next action as parameter. I do agree it should be easier. Artem Ervits Data Analyst New York Presbyterian Hospital From: Sanjay Subramanian [mailto:sanjay.subraman...@wizecommerce.com] Sent: Tuesday

RE: Hive installation

2012-10-24 Thread Artem Ervits
arted hive shell successfully and I can do any kind of DDL so far. Thank you all. From: Artem Ervits [mailto:are9...@nyp.org] Sent: Wednesday, October 24, 2012 4:30 PM To: user@hive.apache.org Subject: RE: Hive installation Actually I'm getting warmer, I "grepped" in the src folder f

RE: Hive installation

2012-10-24 Thread Artem Ervits
rom trunk. Please advise Thank you. From: Artem Ervits [mailto:are9...@nyp.org] Sent: Wednesday, October 24, 2012 4:11 PM To: user@hive.apache.org Subject: RE: Hive installation I was able to go past this error by editing $HADOOP_HOME/conf/Hadoop-env.sh and adding this line: Export HADOOP_C

RE: Hive installation

2012-10-24 Thread Artem Ervits
row it from our children.'' PROTECT IT ! On Sat, Oct 20, 2012 at 2:52 AM, Artem Ervits mailto:are9...@nyp.org>> wrote: Hello all, I'm trying to install Hive on a four-node Hadoop cluster and am a bit confused by the instructions in the wiki. Am I to install Hive on one node o

Re: Hive installation

2012-10-20 Thread Artem Ervits
@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Friday, October 19, 2012 11:14 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: Hive installation installing Hive

Hive installation

2012-10-19 Thread Artem Ervits
ader.java:306) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 3 more Am I supposed to copy the hive jar into the Hadoop lib folder? Thank you. Artem Ervits Data Analyst New York Presbyterian Hospital This electronic message is intended to be for the use only of

Re: Best Report Generating tools for hive/hadoop file system

2012-08-01 Thread Artem Ervits
Latest eclipse birt release has Hive and Hadoop connector. Artem Ervits Data Analyst New York Presbyterian Hospital From: Techy Teck [mailto:comptechge...@gmail.com] Sent: Tuesday, July 31, 2012 08:46 PM To: user@hive.apache.org Subject: Best Report Generating tools for hive/hadoop file system

Re: HIVE AND HBASE

2012-07-28 Thread Artem Ervits
Apache Bigtop project combines Hadoop, Hbase, Hive etc into a repository. All tools are tested to be compatible with each other. There's a streamlined install process for all tools and it just makes things easy. Artem Ervits Data Analyst New York Presbyterian Hospital - Ori

Re: HIVE AND HBASE

2012-07-27 Thread Artem Ervits
Look at Apache Bigtop project. Artem Ervits Data Analyst New York Presbyterian Hospital - Original Message - From: abhiTowson cal [mailto:abhishek.dod...@gmail.com] Sent: Friday, July 27, 2012 12:30 PM To: user@hive.apache.org Subject: HIVE AND HBASE hi all, I am trying to install

Re: namenode starting error

2012-07-07 Thread Artem Ervits
Check your firewall settings, specifically if port 54310 is open. The other ports to look at are: 50010 50020 50030 50060 50070 54311 On 6/20/12 5:22 AM, "soham sardar" wrote: >the thing is i have updated my JAVA_HOME in both .bashrc and hadoop-env.sh > > >now the problem is when i try >jps is