Re: HiveServer2 Goes down while parallel Query execution

Hi Jimmy, Any prominent reason for it run out of worker thread when maximum query fired at a time fired are only 8. I am trying to open multiple session on different connection, so each thread corresponds to one connection. Thanks! On Sat, Oct 10, 2015 at 1:22 AM, Jimmy Xiang wrote: > Could i

Re: Dynamic partitioned parquet tables

When hive.optimize.sort.dynamic.partition is off hive opens a file writer for each new partition key as it is encountered and writes records to those appropriate files. Since the parquet writer buffers writes in memory before flushing to disk it can lead to OOMs when you have lots of partitions/ope

RE: Dynamic partitioned parquet tables

Any one tried this? Please help me if you have any knowledge on this kind of use case. From: yogesh.keshe...@outlook.com To: user@hive.apache.org Subject: Dynamic partitioned parquet tables Date: Fri, 9 Oct 2015 11:20:57 +0530 Hello, I have a question regarding parquet tables. We have

Re: HiveServer2 Goes down while parallel Query execution

Could it be because HS2 runs out of worker threads? Are you trying to open multiple sessions on the same connection? Thanks, Jimmy On Fri, Oct 9, 2015 at 12:34 PM, Vineet Mishra wrote: > Any idea about this? > > Frequent Connectivity issue to HiveServer2 > > 2015-10-10 00:23:11,070 [main] ERR

Re: HiveServer2 Goes down while parallel Query execution

Any idea about this? Frequent Connectivity issue to HiveServer2 2015-10-10 00:23:11,070 [main] ERROR (HiveConnection.java:439) - Error opening session org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) at org.apa

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congrats Ashutosh!!! Well deserved. On Mon, Oct 5, 2015 at 11:48 AM, Ashutosh Chauhan wrote: > Thanks everyone! Honored to be given a chance to serve the project in this > capacity. > > Bests, > Ashutosh > > On Sun, Oct 4, 2015 at 11:39 PM, @Sanjiv Singh > wrote: > >> Congrats Ashutosh !!! >> >

RE: Hive 1.2.1 installation troubleshooting - No known driver to handle "jdbc://hive2://:10000"

Yes, the connection syntax! Somehow I was adding the extra forward-slashes (sometimes these things require an extra pair of eyes, especially when you’re staring at it for ages!) I can now connect to hiveserver2 using beeline, many many thanks! From: Nicholas Hakobian [] Sent: 08 October 2015 1

Re: Storm HiveBolt missing records due to batching of Hive transactions

STORM-938 adds a periodic flush to the HiveBolt using tick tuples that would address this situation. From: Harshit Raikar mailto:harshit.rai...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Friday, October 9, 2015 at 4:05 AM To: "us

Re: HiveServer2 Goes down while parallel Query execution

This looks out to be the issue https://issues.apache.org/jira/browse/HIVE-2314 Any workaround or resolution to the same. Thanks! On Fri, Oct 9, 2015 at 1:24 PM, Vineet Mishra wrote: > Hi All, > > I am trying to connect to HiveServer2 to query some data in parallel and > landing up into some w

Storm HiveBolt missing records due to batching of Hive transactions

To store the processed records I am using HiveBolt in Storm topology with following arguments. - id: "MyHiveOptions" className: "org.apache.storm.hive.common.HiveOptions" - "${metastore.uri}" # metaStoreURI - "${hive.database}" # database

Re: Hive Server gets stucked with Load Data InPath

Any update around this? Thanks! On Fri, Oct 2, 2015 at 7:44 PM, Vineet Mishra wrote: > Hi Praveen, > > This is the complete exception stack I m having. > > Thanks! > On Oct 1, 2015 7:37 PM, "praveen singh" > wrote: > >> Plz send attachment >> On Oct 1, 2015 2:35 PM, "Vineet Mishra" wrote: >>

HiveServer2 Goes down while parallel Query execution

Hi All, I am trying to connect to HiveServer2 to query some data in parallel and landing up into some weird exception, stack trace mentioned below java.sql.SQLException: Error while cleaning up the server resources at org.apache.hive.jdbc.HiveConnection.close(HiveConnection.java:569) at com.sd.dw