Hi,
I am a newbie in Hive. I have Hadoop cluster with installed Apache Knox
(version 0.6.0) on Edge node and Hive installed on Master NameNode. I
communicate with Hive from external client station with installed Teradata
Studio (but this is not important) which communicate with Apache Knox through
SSL. This communication is ok, but I get the following error:
java.lang.Exception: Error while processing statement: Cannot modify
hive.server2.thrift.http.path at runtime. It is not in list of params that are
allowed to be modified at runtime
at
com.teradata.datatools.hadoop.hive.connectivity.HiveConnection.openKnoxConnection(HiveConnection.java:330)
at
com.teradata.datatools.hadoop.hive.connectivity.HiveConnection.createConnection(HiveConnection.java:181)
at
org.eclipse.datatools.connectivity.DriverConnectionBase.internalCreateConnection(DriverConnectionBase.java:105)
at
org.eclipse.datatools.connectivity.DriverConnectionBase.open(DriverConnectionBase.java:54)
at
com.teradata.datatools.hadoop.hive.connectivity.HiveConnection.open(HiveConnection.java:144)
at
com.teradata.datatools.hadoop.hive.connectivity.HivePingFactory.createKnoxConnection(HivePingFactory.java:37)
at
com.teradata.datatools.hadoop.hive.connectivity.PingKnoxJob.createTestConnection(PingKnoxJob.java:30)
at com.teradata.datatools.hadoop.hive.connectivity.PingJob.run(PingJob.java:42)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
When I study the Apache Knox log I can see this:
2016-05-19 18:21:46,161 DEBUG server.Server (Server.java:handle(365)) - REQUEST
/gateway/CSOBHDP1/hive on
AsyncHttpConnection@3134a090,g=HttpGenerator{s=0,h=-1,b=-1,c=-1},p=HttpParser{s=2,l=12,c=157},r=7<mailto:AsyncHttpConnection@3134a090,g=HttpGenerator{s=0,h=-1,b=-1,c=-1},p=HttpParser{s=2,l=12,c=157},r=7>
2016-05-19 18:21:46,161 DEBUG handler.ContextHandler
(ContextHandler.java:doScope(942)) - scope null||/gateway/CSOBHDP1/hive @
o.e.j.w.WebAppContext{/gateway/CSOBHDP1,file:/var/lib/knox/data-2.3.2.0-2950/deployments/CSOBHDP1.war.154c9bf4c70/},/usr/hdp/2.3.2.0-2950/knox/bin/../data/deployments/CSOBHDP1.war.154c9bf4c70
2016-05-19 18:21:46,161 DEBUG handler.ContextHandler
(ContextHandler.java:doScope(1014)) - context=/gateway/CSOBHDP1||/hive @
o.e.j.w.WebAppContext{/gateway/CSOBHDP1,file:/var/lib/knox/data-2.3.2.0-2950/deployments/CSOBHDP1.war.154c9bf4c70/},/usr/hdp/2.3.2.0-2950/knox/bin/../data/deployments/CSOBHDP1.war.154c9bf4c70
2016-05-19 18:21:46,161 DEBUG server.session
(SessionHandler.java:checkRequestedSessionId(275)) - Got Session ID
ptd3c4lwwomvibkctseqh8in from cookie
2016-05-19 18:21:46,161 DEBUG server.session (SessionHandler.java:doScope(187))
-
sessionManager=org.eclipse.jetty.server.session.HashSessionManager@2de366bb<mailto:sessionManager=org.eclipse.jetty.server.session.HashSessionManager@2de366bb>
2016-05-19 18:21:46,161 DEBUG server.session (SessionHandler.java:doScope(188))
-
session=org.eclipse.jetty.server.session.HashedSession:ptd3c4lwwomvibkctseqh8in@1802771505
2016-05-19 18:21:46,161 DEBUG servlet.ServletHandler
(ServletHandler.java:doScope(414)) - servlet /gateway/CSOBHDP1||/hive ->
CSOBHDP1
2016-05-19 18:21:46,161 DEBUG servlet.ServletHandler
(ServletHandler.java:doHandle(476)) - chain=null
2016-05-19 18:21:46,161 DEBUG hadoop.gateway (GatewayFilter.java:doFilter(110))
- Received request: POST /hive
2016-05-19 18:21:46,162 DEBUG realm.AuthorizingRealm
(AuthorizingRealm.java:getAuthorizationCacheLazy(234)) - No authorizationCache
instance set. Checking for a cacheManager...
2016-05-19 18:21:46,162 INFO realm.AuthorizingRealm
(AuthorizingRealm.java:getAuthorizationCacheLazy(248)) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
2016-05-19 18:21:46,163 DEBUG hadoop.gateway
(UrlRewriteProcessor.java:rewrite(155)) - Rewrote URL:
https://hadoop.intapp.eu:8083/gateway/CSOBHDP1/hive, direction: IN via implicit
rule: HIVE/hive/inbound to URL: http://hdp200-7:10001/cliservice
2016-05-19 18:21:46,164 DEBUG hadoop.gateway
(DefaultDispatch.java:executeOutboundRequest(110)) - Dispatch request: POST
http://hdp200-7:10001/cliservice?user.name=jd89552
2016-05-19 18:21:46,164 DEBUG protocol.RequestAddCookies
(RequestAddCookies.java:process(122)) - CookieSpec selected: best-match
2016-05-19 18:21:46,164 DEBUG protocol.RequestAuthCache
(RequestAuthCache.java:process(75)) - Auth cache not set in the context
2016-05-19 18:21:46,165 DEBUG conn.PoolingHttpClientConnectionManager
(PoolingHttpClientConnectionManager.java:requestConnection(219)) - Connection
request: [route: {}->http://hdp200-7:10001][total kept alive: 1; route
allocated: 1 of 2; total allocated: 1 of 20]
2016-05-19 18:21:46,165 DEBUG conn.PoolingHttpClientConnectionManager
(PoolingHttpClientConnectionManager.java:leaseConnection(250)) - Connection
leased: [id: 0][route: {}->http://hdp200-7:10001][total kept alive: 0; route
allocated: 1 of 2; total allocated: 1 of 20]
2016-05-19 18:21:46,165 DEBUG execchain.MainClientExec
(MainClientExec.java:execute(190)) - Stale connection check
2016-05-19 18:21:46,166 DEBUG http.wire (Wire.java:wire(86)) - http-outgoing-0
<< "[read] I/O error: Read timed out"
2016-05-19 18:21:46,166 DEBUG execchain.MainClientExec
(MainClientExec.java:execute(238)) - Executing request POST
/cliservice?user.name=jd89552 HTTP/1.1
2016-05-19 18:21:46,167 DEBUG execchain.MainClientExec
(MainClientExec.java:execute(249)) - Proxy auth state: UNCHALLENGED
2016-05-19 18:21:46,167 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(124)) -
http-outgoing-0 >> POST /cliservice?user.name=jd89552 HTTP/1.1
2016-05-19 18:21:46,167 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> X-Forwarded-For: 10.215.214.104
2016-05-19 18:21:46,167 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> X-Forwarded-Proto: https
2016-05-19 18:21:46,167 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> X-Forwarded-Port: 8083
2016-05-19 18:21:46,167 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> X-Forwarded-Host: hadoop.intapp.eu:8083
2016-05-19 18:21:46,168 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> X-Forwarded-Server: hadoop.intapp.eu
2016-05-19 18:21:46,168 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> X-Forwarded-Context: /gateway/CSOBHDP1
2016-05-19 18:21:46,168 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Accept: application/x-thrift
2016-05-19 18:21:46,168 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Connection: keep-alive
2016-05-19 18:21:46,168 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Accept-Encoding: gzip,deflate
2016-05-19 18:21:46,168 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> User-Agent: Java/THttpClient/HC
2016-05-19 18:21:46,168 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Content-Type: application/x-thrift
2016-05-19 18:21:46,169 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Cookie: JSESSIONID=ptd3c4lwwomvibkctseqh8in;
hive.server2.auth=cu=jd89552&rn=-3432571366460178167&s=asVOnE2it/HHtqTmWCZdi8T0ywM=
2016-05-19 18:21:46,169 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Authorization: Basic amQ4OTU1Mjoq
2016-05-19 18:21:46,169 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Transfer-Encoding: chunked
2016-05-19 18:21:46,169 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(127)) -
http-outgoing-0 >> Host: hdp200-7:10001
2016-05-19 18:21:46,169 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "POST /cliservice?user.name=jd89552 HTTP/1.1[\r][\n]"
2016-05-19 18:21:46,169 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "X-Forwarded-For: 10.215.214.104[\r][\n]"
2016-05-19 18:21:46,170 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "X-Forwarded-Proto: https[\r][\n]"
2016-05-19 18:21:46,170 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "X-Forwarded-Port: 8083[\r][\n]"
2016-05-19 18:21:46,170 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "X-Forwarded-Host: hadoop.intapp.eu:8083[\r][\n]"
2016-05-19 18:21:46,170 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "X-Forwarded-Server: hadoop.intapp.eu[\r][\n]"
2016-05-19 18:21:46,170 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "X-Forwarded-Context: /gateway/CSOBHDP1[\r][\n]"
2016-05-19 18:21:46,170 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Accept: application/x-thrift[\r][\n]"
2016-05-19 18:21:46,170 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Connection: keep-alive[\r][\n]"
2016-05-19 18:21:46,171 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Accept-Encoding: gzip,deflate[\r][\n]"
2016-05-19 18:21:46,171 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "User-Agent: Java/THttpClient/HC[\r][\n]"
2016-05-19 18:21:46,171 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Content-Type: application/x-thrift[\r][\n]"
2016-05-19 18:21:46,171 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Cookie: JSESSIONID=ptd3c4lwwomvibkctseqh8in;
hive.server2.auth=cu=jd89552&rn=-3432571366460178167&s=asVOnE2it/HHtqTmWCZdi8T0ywM=[\r][\n]"
2016-05-19 18:21:46,171 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Authorization: Basic amQ4OTU1Mjoq[\r][\n]"
2016-05-19 18:21:46,171 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Transfer-Encoding: chunked[\r][\n]"
2016-05-19 18:21:46,172 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "Host: hdp200-7:10001[\r][\n]"
2016-05-19 18:21:46,172 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "[\r][\n]"
2016-05-19 18:21:46,172 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "9d[\r][\n]"
2016-05-19 18:21:46,172 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>>
"[0x80][0x1][0x0][0x1][0x0][0x0][0x0][0x10]ExecuteStatement[0x0][0x0][0x0][0x5][0xc][0x0][0x1][0xc][0x0][0x1][0xc][0x0][0x1][0xb][0x0][0x1][0x0][0x0][0x0][0x10][0xd0]/.[0xbd][0xc5][0x0]I[0x1a][0x9f][0x84]Y[0xef]8|[0xcf][0xc][0xb][0x0][0x2][0x0][0x0][0x0][0x10][0xb4][0xd9]4[0xac]6[0xc1]B[0xdb][0xaa][0xb7][0xf9][0x1f][0x96][0x1d]
3[0x0][0x0][0xb][0x0][0x2][0x0][0x0][0x0]2SELECT COUNT(*) FROM
lake_curated.ads_transactions[\r][0x0][0x3][0xb][0xb][0x0][0x0][0x0][0x0][0x2][0x0][0x4][0x1][0x0][0x0][\r][\n]"
2016-05-19 18:21:46,172 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "0[\r][\n]"
2016-05-19 18:21:46,172 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
>> "[\r][\n]"
2016-05-19 18:21:46,331 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "HTTP/1.1 200 OK[\r][\n]"
2016-05-19 18:21:46,331 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "Content-Type: application/x-thrift[\r][\n]"
2016-05-19 18:21:46,331 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "Transfer-Encoding: chunked[\r][\n]"
2016-05-19 18:21:46,331 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "Server: Jetty(7.6.0.v20120127)[\r][\n]"
2016-05-19 18:21:46,331 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "[\r][\n]"
2016-05-19 18:21:46,331 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "1069[\r][\n]"
2016-05-19 18:21:46,332 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<<
"[0x80][0x1][0x0][0x2][0x0][0x0][0x0][0x10]ExecuteStatement[0x0][0x0][0x0][0x5][0xc][0x0][0x0][0xc][0x0][0x1][0x8][0x0][0x1][0x0][0x0][0x0][0x3][0xf][0x0][0x2][0xb][0x0][0x0][0x0].[0x0][0x0][0x0][0xdd]*org.apache.hive.service.cli.HiveSQLException:Error
while compiling statement: FAILED: HiveAccessControlException Permission
denied: user [jd89552] does not have [SELECT] privilege on
[lake_curated/ads_transactions]:36:35[0x0][0x0][0x0]Qorg.apache.hive.service.cli.operation.Operation:toSQLException:Operation.java:315[0x0][0x0][0x0]Porg.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:112[0x0][0x0][0x0]Torg.apache.hive.service.cli.operation.SQLOperation:runInternal:SQLOperation.java:181[0x0][0x0][0x0]Forg.apache.hive.service.cli.operation.Operation:run:Operation.java:257[0x0][0x0][0x0]eorg.apache.hive.service.cli.session.HiveSessionImpl:executeStatementInternal:HiveSessionImpl.java:388[0x0][0x0][0x0]borg.apache.hive.service.cli.session.HiveSessionImpl:executeStatementAsync:HiveSessionImpl.java:375[0x0][0x0][0x0]Porg.apache.hive.service.cli.CLIService:executeStatementAsync:CLIService.java:274[0x0][0x0][0x0]^org.apache.hive.service.cli.thrift.ThriftCLIService:ExecuteStatement:ThriftCLIService.java:486[0x0][0x0][0x0]iorg.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1313[0x0][0x0][0x0]iorg.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1298[0x0][0x0][0x0]Aorg.apache.thrift.ProcessFunction:process:ProcessFunction.java:39[0x0][0x0][0x0]?org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39[0x0][0x0][0x0]9org.apache.thrift.server.TServlet:doPost:TServlet.java:83[0x0][0x0][0x0]Vorg.apache.hive.service.cli.thrift.ThriftHttpServlet:doPost:ThriftHttpServlet.java:171[0x0][0x0][0x0];javax.servlet.http.HttpServlet:service:HttpServlet.java:727[0x0][0x0][0x0];javax.servlet.http.HttpServlet:service:HttpServlet.java:820[0x0][0x0][0x0]Eorg.eclipse.jetty.servlet.ServletHolder:handle:ServletHolder.java:565[0x0][0x0][0x0]Iorg.eclipse.jetty.servlet.ServletHandler:doHandle:ServletHandler.java:479[0x0][0x0][0x0]Porg.eclipse.jetty.server.session.SessionHandler:doHandle:SessionHandler.java:225[0x0][0x0][0x0]Qorg.eclipse.jetty.server.handler.ContextHandler:doHandle:ContextHandler.java:1031[0x0][0x0][0x0]Horg.eclipse.jetty.servlet.ServletHandler:doScope:ServletHandler.java:406[0x0][0x0][0x0]Oorg.eclipse.jetty.server.session.SessionHandler:doScope:SessionHandler.java:186[0x0][0x0][0x0]Oorg.eclipse.jetty.server.handler.ContextHandler:doScope:ContextHandler.java:965[0x0][0x0][0x0]Lorg.eclipse.jetty.server.handler.ScopedHandler:handle:ScopedHandler.java:117[0x0][0x0][0x0]Norg.eclipse.jetty.server.handler.HandlerWrapper:handle:HandlerWrapper.java:111[0x0][0x0][0x0]6org.eclipse.jetty.server.Server:handle:Server.java:345[0x0][0x0][0x0]]org.eclipse.jetty.server.AbstractHttpConnection:handleRequest:AbstractHttpConnection.java:449[0x0][0x0][0x0]forg.eclipse.jetty.server.AbstractHttpConnection$RequestHandler:content:AbstractHttpConnection.java:925[0x0][0x0][0x0]?org.eclipse.jetty.http.HttpParser:parseNext:HttpParser.java:952[0x0][0x0][0x0]Dorg.eclipse.jetty.http.HttpParser:parseAvailable:HttpParser.java:235[0x0][0x0][0x0]Oorg.eclipse.jetty.server.AsyncHttpConnection:handle:AsyncHttpConnection.java:76[0x0][0x0][0x0]Torg.eclipse.jetty.io.nio.SelectChannelEndPoint:handle:SelectChannelEndPoint.java:609[0x0][0x0][0x0]Rorg.eclipse.jetty.io.nio.SelectChannelEndPoint$1:run:SelectChannelEndPoint.java:45[0x0][0x0][0x0]Njava.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1142[0x0][0x0][0x0]Njava.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:617[0x0][0x0][0x0]$java.lang.Thread:run:Thread.java:745[0x0][0x0][0x0][0xbe]*org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAccessControlException:Permission
denied: user [jd89552] does not have [SELECT] privilege on
[lake_curated/ads_transactions]:42:7[0x0][0x0][0x0]rorg.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer:checkPrivileges:RangerHiveAuthorizer.java:352[0x0][0x0][0x0]Borg.apache.hadoop.hive.ql.Driver:doAuthorizationV2:Driver.java:779[0x0][0x0][0x0]@org.apache.hadoop.hive.ql.Driver:doAuthorization:Driver.java:574[0x0][0x0][0x0]8org.apache.hadoop.hive.ql.Driver:compile:Driver.java:468[0x0][0x0][0x0]8org.apache.hadoop.hive.ql.Driver:compile:Driver.java:308[0x0][0x0][0x0]Aorg.apache.hadoop.hive.ql.Driver:compileInternal:Driver.java:1122[0x0][0x0][0x0]Corg.apache.hadoop.hive.ql.Driver:compileAndRespond:Driver.java:1116[0x0][0x0][0x0]Porg.apache.hive.service.cli.operation.SQLOperation:prepare:SQLOperation.java:110[0xb][0x0][0x3][0x0][0x0][0x0][0x5]42000[0x8][0x0][0x4][0x0][0x0][0x9c]@[0xb][0x0][0x5][0x0][0x0][0x0][0xa9]Error
while compiling statement: FAILED: HiveAccessControlException Permission
denied: user [jd89552] does not have [SELECT] privilege on
[lake_curated/ads_transactions][0x0][0x0][0x0][\r][\n]"
2016-05-19 18:21:46,332 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onResponseReceived(113)) -
http-outgoing-0 << HTTP/1.1 200 OK
2016-05-19 18:21:46,332 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onResponseReceived(116)) -
http-outgoing-0 << Content-Type: application/x-thrift
2016-05-19 18:21:46,332 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onResponseReceived(116)) -
http-outgoing-0 << Transfer-Encoding: chunked
2016-05-19 18:21:46,333 DEBUG http.headers
(LoggingManagedHttpClientConnection.java:onResponseReceived(116)) -
http-outgoing-0 << Server: Jetty(7.6.0.v20120127)
2016-05-19 18:21:46,333 DEBUG execchain.MainClientExec
(MainClientExec.java:execute(267)) - Connection can be kept alive indefinitely
2016-05-19 18:21:46,333 DEBUG hadoop.gateway
(DefaultDispatch.java:executeOutboundRequest(136)) - Dispatch response status:
200
2016-05-19 18:21:46,333 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "0[\r][\n]"
2016-05-19 18:21:46,334 DEBUG http.wire (Wire.java:wire(72)) - http-outgoing-0
<< "[\r][\n]"
I can find in this log that this error message send Hive and I do not know why.
One colleague install Apache Ranger and add plugin into Hive but then found out
that there is bug and did not finish the installation.
Does anybody the experience with this error. I need the information when this
error can occur because I do not know what I have to control or what I can do
with this.
Many thanks.
Radim Sotola
