[jira] [Created] (HIVE-14721) Fix TestJdbcWithMiniHS2 runtime
Vaibhav Gumashta created HIVE-14721: --- Summary: Fix TestJdbcWithMiniHS2 runtime Key: HIVE-14721 URL: https://issues.apache.org/jira/browse/HIVE-14721 Project: Hive Issue Type: Sub-task Reporter: Vaibhav Gumashta Assignee: Vaibhav Gumashta Currently 450s -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] hive pull request #98: HIVE-14217: Druid integration
Github user asfgit closed the pull request at: https://github.com/apache/hive/pull/98 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (HIVE-14722) Support creating vector row batches from Druid
Jesus Camacho Rodriguez created HIVE-14722: -- Summary: Support creating vector row batches from Druid Key: HIVE-14722 URL: https://issues.apache.org/jira/browse/HIVE-14722 Project: Hive Issue Type: Sub-task Components: Druid integration Reporter: Jesus Camacho Rodriguez We could generate vector row batches so that vectorized execution may get triggered. This would be useful for queries that cannot be pushed completely to Druid i.e. we need to perform additional computation on the rows coming from Druid. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-14723) Move doesTableNeedLocation from DDLTask to HiveStorageHandler
Jesus Camacho Rodriguez created HIVE-14723: -- Summary: Move doesTableNeedLocation from DDLTask to HiveStorageHandler Key: HIVE-14723 URL: https://issues.apache.org/jira/browse/HIVE-14723 Project: Hive Issue Type: Improvement Components: StorageHandler Reporter: Jesus Camacho Rodriguez Priority: Minor Consider moving _doesTableNeedLocation_ method from DDLTask to HiveStorageHandler interface. https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L4471 We should take into account that it would break compatibility with existing 3rd party StorageHandlers. However, it seems better than the current solution, i.e. referencing specific storage handlers in the method. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Remote debugging of HIVE code from Intellij
Hi Ranjan, I am not sure about what you are about to test, but I think TestPositiveCliDriver is not a valid test name, so not test run in your case. Regards, Peter > On Sep 8, 2016, at 4:08 AM, Ranjan Banerjee wrote: > > Hi, > I am trying to remote debug HIVE code from Intellij. Here are my steps: > 1)In HIVE folder: mvn clean install -Dskiptests > 2)cd itests/qtest > 3)mvn clean install -Dskiptests > 4)mvn -Dmaven.surefire.debug -Dtest=TestPositiveCliDriver > -Dqfile=acid_bucket_pruning.q > I have setup the remote debugging config in Intellij and have put > breakpoint in sessionstate.java > However I see that the test completes successfully and does not listen at > the 5005 port. Can someone give some pointers as to why the mvn test is not > stopping to listen at this port? > > Thanks > Ranjan
[jira] [Created] (HIVE-14724) Cannot view/recognise character in Hive
Srinivas created HIVE-14724: --- Summary: Cannot view/recognise character in Hive Key: HIVE-14724 URL: https://issues.apache.org/jira/browse/HIVE-14724 Project: Hive Issue Type: Bug Reporter: Srinivas Hive does not recognise \ in the string. The original string is _X'c$Y[#:7qd+\ors"Tm. We can only see _X'c$Y[#:7qd+ors"Tm. The \ is missing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-14725) HiveServer2Hook invokes incorrect Auth mechanism when user not specified
Shreyas Joshi created HIVE-14725:
Summary: HiveServer2Hook invokes incorrect Auth mechanism when
user not specified
Key: HIVE-14725
URL: https://issues.apache.org/jira/browse/HIVE-14725
Project: Hive
Issue Type: Bug
Components: HiveServer2
Reporter: Shreyas Joshi
h3. Summary
{{HiveServer2Hook}} Seems to be ignoring the auth_mechanism when the user is
not specified. I am not entirely sure if the solution should be should change
impyala or Airflow.
h3. Reproducing the problem
With this connection string for Hive:
{{AIRFLOW_CONN_GH_HIVE=hive2://@localhost:1/}} (No user name and no
password)
I get the following error from {{HiveServer2hook}}:
{code}
from airflow.hooks import HiveServer2Hook
hive_hook = HiveServer2Hook (hiveserver2_conn_id='GH_HIVE')
{code}
{noformat}
[2016-09-08 14:30:52,420] {base_hook.py:53} INFO - Using connection to:
localhost
Traceback (most recent call last):
File "", line 1, in
File
"/Users/shreyasjoshis/python-envs/default-env/lib/python3.5/site-packages/airflow/hooks/hive_hooks.py",
line 464, in get_conn
database=db.schema or 'default')
File
"/Users/shreyasjoshis/python-envs/default-env/lib/python3.5/site-packages/impala/dbapi.py",
line 147, in connect
auth_mechanism=auth_mechanism)
File
"/Users/shreyasjoshis/python-envs/default-env/lib/python3.5/site-packages/impala/hiveserver2.py",
line 658, in connect
transport.open()
File
"/Users/shreyasjoshis/python-envs/default-env/lib/python3.5/site-packages/thrift_sasl/__init__.py",
line 72, in open
message=("Could not start SASL: %s" % self.sasl.getError()))
thriftpy.transport.TTransportException: TTransportException(type=1,
message="Could not start SASL: b'Error in sasl_client_start (-4) SASL(-4): no
mechanism available: No worthy mechs found'")
{noformat}
h3. More detail
[Here|https://github.com/apache/incubator-airflow/blob/master/airflow/hooks/hive_hooks.py#L591]
{{db.login}} ends up being an empty string rather than {{None}}. This seems to
cause impala to try sasl. Changing {{db.login}} from an empty string to
{{None}} seems to fix the issue.
So, the following does not work
{code}
from impala.dbapi import connect
connect (host='localhost', port=1, user='', auth_mechanism='PLAIN',
database= 'default')
{code}
The error is:
{noformat}
Traceback (most recent call last):
File "", line 1, in
File
"/Users/shreyasjoshis/python-envs/default-env/lib/python3.5/site-packages/impala/dbapi.py",
line 147, in connect
auth_mechanism=auth_mechanism)
File
"/Users/shreyasjoshis/python-envs/default-env/lib/python3.5/site-packages/impala/hiveserver2.py",
line 658, in connect
transport.open()
File
"/Users/shreyasjoshis/python-envs/default-env/lib/python3.5/site-packages/thrift_sasl/__init__.py",
line 72, in open
message=("Could not start SASL: %s" % self.sasl.getError()))
thriftpy.transport.TTransportException: TTransportException(type=1,
message="Could not start SASL: b'Error in sasl_client_start (-4) SASL(-4): no
mechanism available: No worthy mechs found'")
{noformat}
But the following does:
{code}
from impala.dbapi import connect
connect (host='localhost', port=1, user=None, auth_mechanism='PLAIN',
database= 'default')
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
RE: Remote debugging of HIVE code from Intellij
Hi Peter, Thank you so much for pointing it out. I ran -Dtest=TestCliDriver and it worked! On a sidenote I would like to contribute to the project. Is there any issue you would suggest that I could look into. Thanks Ranjan -Original Message- From: Peter Vary [mailto:pv...@cloudera.com] Sent: Thursday, September 8, 2016 6:26 AM To: dev@hive.apache.org Cc: dev-h...@hive.apache.org Subject: Re: Remote debugging of HIVE code from Intellij Hi Ranjan, I am not sure about what you are about to test, but I think TestPositiveCliDriver is not a valid test name, so not test run in your case. Regards, Peter > On Sep 8, 2016, at 4:08 AM, Ranjan Banerjee wrote: > > Hi, > I am trying to remote debug HIVE code from Intellij. Here are my steps: > 1)In HIVE folder: mvn clean install -Dskiptests 2)cd itests/qtest > 3)mvn clean install -Dskiptests > 4)mvn -Dmaven.surefire.debug -Dtest=TestPositiveCliDriver > -Dqfile=acid_bucket_pruning.q > I have setup the remote debugging config in Intellij and have put > breakpoint in sessionstate.java > However I see that the test completes successfully and does not listen at > the 5005 port. Can someone give some pointers as to why the mvn test is not > stopping to listen at this port? > > Thanks > Ranjan
[jira] [Created] (HIVE-14726) delete statement fails when spdo is on
Ashutosh Chauhan created HIVE-14726: --- Summary: delete statement fails when spdo is on Key: HIVE-14726 URL: https://issues.apache.org/jira/browse/HIVE-14726 Project: Hive Issue Type: Bug Components: Logical Optimizer Affects Versions: 2.1.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Review Request 51755: Support Intersect Distinct
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51755/ --- Review request for hive and Ashutosh Chauhan. Repository: hive-git Description --- HIVE-12765 Diffs - ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/HiveRelFactories.java cf93ed8 ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveIntersect.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveIntersectMergeRule.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveIntersectRewriteRule.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTConverter.java 9f5e733 ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java ff94160 ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 7ceb005 ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g df596ff ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 9ba1865 ql/src/java/org/apache/hadoop/hive/ql/parse/QBExpr.java cccf0f6 ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 943d9d7 ql/src/test/queries/clientpositive/intersect.q PRE-CREATION ql/src/test/results/clientpositive/intersect.q.out PRE-CREATION Diff: https://reviews.apache.org/r/51755/diff/ Testing --- Thanks, pengcheng xiong
