Re: A simple insert stuck in hive

Hi Mich, I have faced same issue while inserting into table .nothing had helped me on that. Surprisingly , restarting cluster had worked for me. I am also interested in solution to this. Also can you please check if there is any lock on table causing mapper waiting for lock on table. -

Re: Unable to make Sort Merge Bucket Join work

Can someone please help me on this? I am getting the error :- FAILED: SemanticException [Error 10135]: Sort merge bucketed join could not be performed. If you really want to perform the operation, either set hive.optimize.bucketmapjoin.sortedmerge=false, or set hive.enforce.sortmergebucketmapjoi

Re: Analyze table compute statistics on wide table taking too long

Hi Gopal, Thanks for that. I'm happy to look into improving the Regex serde performance, any tips on where I should start looking?. Regards, Roger On 08/04/2015 11:44 AM, "Gopal Vijayaraghavan" wrote: > > > The table also has a large Regex serde. > > There are no stats fast paths for Regex Ser

Re: Analyze table compute statistics on wide table taking too long

> The table also has a large Regex serde. There are no stats fast paths for Regex SerDe. The statistics computation is lifting each row into memory, parsing it and throwing it away. Most of your time would be spent in GC (check the GC time millis), due to the huge expense of the Regex Serde. F

Analyze table compute statistics on wide table taking too long

Hi, I have a hive table with 300 columns that are all strings with around 180k rows, when I run analyze table compute statistics it seems to be taking about 40 minutes to complete regardless of the execution engine. The table also has a large Regex serde. I an running hive 0.13.0. Any help woul

Re: Unsubscribe Me

Ashish, Read The Friendly Manual below https://hive.apache.org/mailing_lists.html On Tue, Apr 7, 2015 at 2:15 PM, Ashish Garg wrote: > Hello Admin, > > Please unsubscribe me. > > Regards, > Ashish Garg >

Unsubscribe Me

Hello Admin, Please unsubscribe me. Regards, Ashish Garg

A simple insert stuck in hive

Hi, Today I have noticed the following issue. A simple insert into a table is sting there throwing the following hive> insert into table mytest values(1,'test'); Query ID = hduser_20150407215959_bc030fac-258f-4996-b50f-3d2d49371cca Total jobs = 3 Launching Job 1 out of 3 Number of r

Re: Hive job name

Gotta say i don't particular like this either. We run thousands of queries a day and by using a comment before the query you could manipulate the job.name hive would use. Now like the OP stated that's ignored - every job is named "hive-exec-0.13.1-cdh5.3.1.jar" Sure setting mapreduce.job.name

Re: admin user in hive

Use the new SQL standard authorization rather than the default authorization. See https://cwiki.apache.org/confluence/display/Hive/SQL+Standard+Based+Hive+Authorization Alan. Megha Garg April 6, 2015 at 4:08 Hi, I want to enable authentication+authorization on

hive-jdbc do set commands work on the connection or statement level

I am setting compression variables in multiple statements conn.createStatement().execute("set compression.type=5=snappy"); conn.createStatement().execute("select into X ..."); Does the set statement set a connection level variable or a statement level variable? Or are things set in other ways? TX

Re: Writing ORC Files

I extracted a minimal example and it works. Oops… I’m off to figure out why it’s behaving differently in Storm. Thanks much. Grant Overby Software Engineer Cisco.com grove...@cisco.com Mobile: 865 724 4910 Think before you print.This email may contain confidential

Hive drop table error

Hi, I was able to create a highly nested table in hive but for some reason now I am unable to drop it or describe it. I get an IllegalArgumentException Error and dont know how to delete the table now. Does anyone have any ideas on how I can do this? The table has more than a 100 fields. Thanks, U

Re: Writing ORC Files

Give me a bit to extract a minimal example case and I’ll send it over. Grant Overby Software Engineer Cisco.com grove...@cisco.com Mobile: 865 724 4910 Think before you print.This email may contain confidential and privileged material for the sole use of the intended

Re: Writing ORC Files

> addRow() is called in execute(). Does something look wrong with the call? Š There is no need for an explicit flush, but addRow() is rather far below the layers of useful abstraction (and barely any seatbelts). Can you try logging the category/type fields of your inspector and make sure it is r

Re: Writing ORC Files

I’ll give the ORCMapper code a go. This looks promising. We’ve tried hive streaming in 0.13 and 0.14; it has been no end of trouble. Acid tables don’t seem to work well with Tez. Compaction frequently fails leaving behind flush and tmp files. Querying a partition that is being written either do

Re: Writing ORC Files

Yep i didn't see that, my guess is that what you are passing to 'addrow' is incorrect, e.g. take a look at: https://github.com/gautamphegde/HadoopCraft/blob/master/ORCOutput/src/main/java/ORCout/ORCMapper.java It isn't the same thing, but you see there are passing a list that is first serialize. Al

Re: Writing ORC Files

addRow() is called in execute(). Does something look wrong with the call? [http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726] Grant Overby Software Engineer Cisco.com grove...@cisco.com Mobile: 865 724 4910

Re: Writing ORC Files

I think you have to call 'addRow' to the writer: https://hive.apache.org/javadocs/r0.12.0/api/org/apache/hadoop/hive/ql/io/orc/Writer.html That's just based on the javadoc, i don't have any experience doing this. On Tue, Apr 7, 2015 at 8:43 AM, Grant Overby (groverby) wrote: > I have a Storm

Writing ORC Files

I have a Storm Trident Bolt for writing ORC File. The files are created; however, they are always zero length. This code eventually causes an OOME. I suspect I am missing some sort of flushing action, but don’t see anything like that in the api. My bolt follows. Any thoughts as to what I’m doin

Re: Concurrency issue, Setting hive.txn.manager to "org.apache.hadoop.hive.ql.lockmgr.DbTxnManager"

hi Mich, Have you created the hive metastore? And can you please check the log for hivemetastore As i also faced this issue before. And let me know *Thanks & Regards,* *Srinivas T* On Tue, Apr 7, 2015 at 9:13 AM, Eugene Koifman wrote: > can you check that the schema in your metastore db ha