Re: hqlsql on hive partition table

2019-01-29 Thread Dmitry Tolpeko
Can you please create a Jira ticket, and put code sample, not screenshot there. Thanks, Dmitry On Tue, Jan 29, 2019 at 9:08 AM 陈贵龙 wrote: > Hi, >How are you . i have a question in how to use hqlsql on hive partition > table > when I use Hqlsql on hive Partition table,Why get the key Word

Re: About hplsql

2018-12-28 Thread Dmitry Tolpeko
Hi, If you run Spark thrift server, you can just use an JDBC connection to connect to Spark SQL directly. Edit hplsql-site.xml and add your connection there. See http://hplsql.org/connections for details. Thanks, Dmitry On Fri, Dec 28, 2018 at 6:43 AM 郑 洁锋 wrote: > Hi, > We see that your h

Re: Re: How to use HPL/SQL connect with impala and Hive

2017-11-23 Thread Dmitry Tolpeko
ntime.tree.AbstractParseTreeVisitor.visit( > AbstractParseTreeVisitor.java:42) > at org.apache.hive.hplsql.Exec.run(Exec.java:775) > at org.apache.hive.hplsql.Exec.run(Exec.java:751) > at org.apache.hive.hplsql.Hplsql.main(Hplsql.java:23) > > > > 在 2017-11-22 20:48:39,"

Re: How to use HPL/SQL connect with impala and Hive

2017-11-22 Thread Dmitry Tolpeko
>exeception : java.lang.incompatible class change error Can you please send the entire error output? >How to make a connection between HPL/SQL and impala Connection to Impala is not pre-defined yet, so you have to create a new connection, see http://hplsql.org/connections Thanks, Dmitry On We

Re: Use case for Temporary or Volatile Table - Need to update fields in the hive table records

2017-10-02 Thread Dmitry Tolpeko
t; > Thanks & Regards, > Srini Alavala > > -Dmitry Tolpeko wrote: - > To: Srinivas Alavala > From: Dmitry Tolpeko > Date: 10/01/2017 03:19AM > Cc: user@hive.apache.org > Subject: Re: Hplsql Cursor Loop Java Error - Resolved > > Thanks! It should not throw NPE

Re: Hplsql Cursor Loop Java Error - Resolved

2017-10-01 Thread Dmitry Tolpeko
Thanks! It should not throw NPE anyway, I will create a ticket for Exception in thread "main" java.lang.NullPointerException at org.apache.hive.hplsql.Select.getIntoCount(Select.java:405) Thanks, Dmitry On Sun, Oct 1, 2017 at 1:43 AM, Srinivas Alavala wrote: > > I forgot to add the END

Hive table for a single file: CREATE/ALTER TABLE differences

2017-01-25 Thread Dmitry Tolpeko
​ ​I accidentally noticed​​ one feature: (it is well know ​n​ that in CREATE TABLE you must specify a directory for the table LOCATION otherwise you get: "Can't make directory for path 's3n://dir/file' since it is a file.") But at the same time, ALTER TABLE SET LOCATION 's3n://dir/file' works fine

Re: hplsql tool not supporting NON EQUI JOIN

2017-01-19 Thread Dmitry Tolpeko
Prabhu, Can you please post the statement? Dmitry On Thu, Jan 19, 2017 at 7:38 PM, wrote: > Hi there, > > This is Prabhu Sekar from Cognizant UK. > We are working on an initiative where in we need to migrate 100+ complex > stored procedures from SQL to Hive. > While researching, we came across

Re: Run HPL/SQL on CDH 5.7 with Hive 1.1

2016-11-30 Thread Dmitry Tolpeko
wrote: > Hi Dmitry Tolpeko and Hive Experts > > My company wants to migrate some ETL processes written in Oracle PL/SQL > to Hive or something else. > > Because we don't have any component running on our Hadoop cluster > which supports PL/SQL, wa wanna try HPL/SQL for our

Re: Issues regarding HPLSQL tool

2016-11-29 Thread Dmitry Tolpeko
> [training@miguel ~]$ ssh bea > The authenticity of host 'bea (10.164.79.119)' can't be established. > RSA key fingerprint is f8:ce:3a:a0:92:23:3d:e7:3f:e1:42:50:4b:17:de:7d. > Are you sure you want to continue connecting (yes/no)? yes > Warning: Permanently added 'bea

Re: Issues regarding HPLSQL tool

2016-11-29 Thread Dmitry Tolpeko
Ainhoa, Can you please post the entire script? Also try to add --trace option to see which query was actually executed in the database. Thanks, Dmitry On Tue, Nov 29, 2016 at 11:44 AM, Ainhoa Benitez wrote: > Good morning, > > my name is Ainhoa. I am starting to use the HPLSQL tool and up to n

Re: How to pass the TestHplsqlDb test in hive-hplsql?

2016-08-01 Thread Dmitry Tolpeko
ed with Hive” , where can I find this infomation of > these tables. > > Emerson > > 2016-08-01 16:27 GMT+08:00 Dmitry Tolpeko : > >> Hi Emerson, >> >> I did not commit TestHplsqlDb.java since Apache Pre-commit test starts >> executing it, and I did not manage

Re: How to pass the TestHplsqlDb test in hive-hplsql?

2016-08-01 Thread Dmitry Tolpeko
Hi Emerson, I did not commit TestHplsqlDb.java since Apache Pre-commit test starts executing it, and I did not manage how to pass it (there are connection errors). I can commit it as java_ to prevent execution, or someone can help with connection errors. Some table DDLs are here: https://github.c

Re: if else condition in hive

2016-06-21 Thread Dmitry Tolpeko
Hi Raj, Hive hpl/sql component can be used to achieve such functionality (see www.hplsql.org for docs), now you can run it as a separate tool, and I hope some day it will be available from Hive or Beeline CLI. Thanks, Dmitry On Tue, Jun 21, 2016 at 2:22 PM, raj hive wrote: > Hi friends, > > IN

Re: SELECT without FROM

2016-03-10 Thread Dmitry Tolpeko
and now on 2 >> >> Dr Mich Talebzadeh >> >> >> >> LinkedIn * >> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >> >

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

2016-03-09 Thread Dmitry Tolpeko
Congratulations, Wei! On Thu, Mar 10, 2016 at 5:48 AM, Chao Sun wrote: > Congratulations! > > On Wed, Mar 9, 2016 at 6:44 PM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > >> Congratulations Wei! >> >> On Mar 9, 2016, at 8:43 PM, Sergey Shelukhin >

Re: SELECT without FROM

2016-03-09 Thread Dmitry Tolpeko
AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 9 March 2016 at 09:58, Dmitry Tolpeko wrote: > >> Mich, >> >> I now that. I just want to trace when

Re: SELECT without FROM

2016-03-09 Thread Dmitry Tolpeko
8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 9 March 2016 at 09:50, Dmitry Tolpeko wrote: > >> I noticed that Hive allows you to execute SELECT without FROM clause &g

SELECT without FROM

2016-03-09 Thread Dmitry Tolpeko
I noticed that Hive allows you to execute SELECT without FROM clause (tested in Hive 0.14, Hive 1.2.1): SELECT 1+1; In which version was it added (is there a Jira)? I see that it is not mentioned in docs https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select So the question wheth

Re: Hive-2.0.1 Release date

2016-02-29 Thread Dmitry Tolpeko
ile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 1 March 2016 at 06:39, Dmitry Tolpeko wrote: > >> Mich, >> >> To avoid confusion: HPLSQL is shipped with Hive 2.0 (and will be shipped >> wit

Re: Hive-2.0.1 Release date

2016-02-29 Thread Dmitry Tolpeko
Mich, To avoid confusion: HPLSQL is shipped with Hive 2.0 (and will be shipped with all further versions). So you can use it with Hive on Tez, Hive on MR, and Hive on Spark. But now it is a separate tool: hplsql (like hive CLI, beeline CLI). What Alan meant is that it is not integrated to Hive *pa

Re: DB2 DDL to Hive DDL conversion **Need Help**

2016-02-19 Thread Dmitry Tolpeko
Abhi, The approach is quite simple and straightforward: 1) HPL/SQL is available since Hive 2.0 released a few days ago, so if you are using a previous Hive version (or Impala, Spark SQL, Presto etc) you can take the tool at http://hplsql.org/download 2) Follow http://hplsql.org/start to set it u

Re: DB2 DDL to Hive DDL conversion **Need Help**

2016-02-19 Thread Dmitry Tolpeko
Abhi needs to convert SQL scripts so I am afraid Sqoop will not help. Abhi, do you need to get equivalent Hive scripts or creating tables in Hive will be enough (without having scripts)? The new HPL/SQL tool is designed to execute existing DDL (created for any database), convert on the fly and cre

Re: [ANNOUNCE] Apache Hive 2.0.0 Released

2016-02-16 Thread Dmitry Tolpeko
Great! Thank you, Sergey! On Tue, Feb 16, 2016 at 10:44 PM, Sergey Shelukhin wrote: > The Apache Hive team is proud to announce the the release of Apache Hive > version 2.0.0. > > The Apache Hive (TM) data warehouse software facilitates querying and > managing large datasets residing in distribu

Re: January Hive User Group Meeting

2016-01-20 Thread Dmitry Tolpeko
If possible please share the slides after the meeting. Thank you! Dmitry On Wed, Jan 20, 2016 at 8:45 PM, Xuefu Zhang wrote: > Hi all, > > As a reminder, the meeting will be held tomorrow as scheduled. Please > refer to the meetup page[1] for details. Looking forward to meeting you all! > > Th

Re: HPLSQL Error

2015-12-14 Thread Dmitry Tolpeko
Pavan, Hadoop jars are not in the CLASSPATH. You can edit hplsql file (this is a bash script) and specify proper locations for your Hadoop installation. Dmitry On Mon, Dec 14, 2015 at 6:34 AM, Pavan Kumar wrote: > ./hplsql -e "select * from txn_ds_platter limit 1"; > Exception in thread "main"

Re: Building Rule Engine/ Rule Transformation

2015-11-29 Thread Dmitry Tolpeko
Mahender, Please try Hive HPL/SQL tool first. It will be included to Hive 2.0, but now it is available at hplsql.org. The tool attempts to implement procedural SQL for Hive. It is supporting SQL Server syntax as well. If there are any issues please contact me by email. Dmitry On Sat, Nov 28, 201

Re: Better way to do UDF's for Hive

2015-10-01 Thread Dmitry Tolpeko
In case of single string input Java UDF can be easier to write: accept string parameter, lookup hash map and return. In case of Python you have to use TRANSFORM clause and handle all columns, so it will be hard to reuse your Python script as the code may depend on the column position. One other po

Re: Organising Hive Scripts

2015-09-11 Thread Dmitry Tolpeko
Charles, Not sure what you can do in Hive CLI right now, but consider a new Hive HPL/SQL component that will be included to new Hive versions and that currently you can compile and run separately, see https://github.com/apache/hive/tree/master/hplsql or www.hplsql.org It supports include files, u

Re: PL/HQL - Procedural SQL-on-Hadoop

2015-04-30 Thread Dmitry Tolpeko
query results to RDBMS (actually any JDBC source), use RDBMS tables as map-join tables in Hive queries and so on. Early adopters are very welcome. Please contact me at dmtolp...@gmail.com Thanks, Dmitry Tolpeko PL/HQL - Procedural SQL-on-Hadoop, www.plhql.org On Fri, Mar 6, 2015 at 6:23 PM, Ronak

Re: Hive documentation update for isNull, isNotNull etc.

2015-04-17 Thread Dmitry Tolpeko
I also recently realized that NVL function is available, but not documented :( Dmitry Tolpeko -- PL/HQL - Procedural SQL-on-Hadoop - www.plhql.org On Sat, Apr 18, 2015 at 12:22 AM, Moore, Douglas < douglas.mo...@thinkbiganalytics.com> wrote: > I'm having major trouble finding

Re: PL/HQL - Procedural SQL-on-Hadoop

2015-03-06 Thread Dmitry Tolpeko
ectory > > -- > r7raul1...@163.com > > > *From:* Dmitry Tolpeko > *Date:* 2015-02-28 04:36 > *To:* user > *Subject:* PL/HQL - Procedural SQL-on-Hadoop > Let me introduce PL/HQL, an open source tool that implements procedural > SQL on Hadoop. It is going to support al

Re: PL/HQL - Procedural SQL-on-Hadoop

2015-03-02 Thread Dmitry Tolpeko
. Dmitry On Tue, Mar 3, 2015 at 4:39 AM, Venkat, Ankam wrote: > Is there a simple way to migrate from PL/SQL to PL/HQL? > > > > Regards, > > Venkat > > > > *From:* Dmitry Tolpeko [mailto:dmtolp...@gmail.com] > *Sent:* Friday, February 27, 2015 1:36 PM > *To

Re: PL/HQL - Procedural SQL-on-Hadoop

2015-02-28 Thread Dmitry Tolpeko
, Feb 28, 2015 at 3:45 AM, DU DU wrote: > Are there any github link for source code? > Any there any documents for writing the sproc? > What's performance than regular HQL statements? > Is there a plan to support spark SQL? > will > > On Fri, Feb 27, 2015 at 3:36 PM, Dmi

PL/HQL - Procedural SQL-on-Hadoop

2015-02-27 Thread Dmitry Tolpeko
. Thank you, Dmitry Tolpeko

Re: Multitable insert does not work with ORCFiles

2014-10-17 Thread Dmitry Tolpeko
ctorized execution and not with ORC. If I disable vectorization the query > seems to work fine even for ORC tables. I will dig through the JIRAs to see > if this is a known issue else I will file a bug. Thanks for reporting. > > - Prasanth > > > On Thu, Oct 16, 2014 at 1:

Multitable insert does not work with ORCFiles

2014-10-16 Thread Dmitry Tolpeko
urns 3 rows). Can please someone check this? Is it a known issue? Thanks, Dmitry Tolpeko