old version hive(0.13) failed with "File already exist"

Hi, hive users, We need help from the hive community! We are now using very old hive version(0.13) due to historical reason, and we often meet following issue: Caused by: java.io.IOException: File already exists:s3://smart-dmp/warehouse/uploaded/ad_dmp_pixel/dt=2021-06-21/key=259f3XXX We ha

complex join keys cannot be recognized in Hive 0.13

Hi Experts I am using Hive 0.13 and find a potential bug. Attached "implicit join.hql" has several join keys (for example store_sales.ss_addr_sk = customer_address.ca_address_sk) and cannot be regonized by Hive. In such cases hive won't be able to optimize and can only do a c

Re: Table level stats are not shown after insert starting in Hive 0.13?

Adding Dev user list. Could somebody help take a look? On Thu, Sep 3, 2015 at 12:25 PM, Jim Green wrote: > Also tried Hive 1.0, and the result is the same as Hive 0.13. > Is there any reason why we do not print the table level stats for > partition table? > > On Thu, Sep 3, 2

Re: Table level stats are not shown after insert starting in Hive 0.13?

Also tried Hive 1.0, and the result is the same as Hive 0.13. Is there any reason why we do not print the table level stats for partition table? On Thu, Sep 3, 2015 at 10:41 AM, Jim Green wrote: > *Hive 0.12:* > After insert SQL: > Partition default.mytablepar{id=111} stats: [num

Table level stats are not shown after insert starting in Hive 0.13?

*Hive 0.12:* After insert SQL: Partition default.mytablepar{id=111} stats: [num_files: 1, num_rows: 0, total_size: 4, raw_data_size: 0] Table default.mytablepar stats: [num_partitions: 1, num_files: 1, num_rows: 0, total_size: 4, raw_data_size: 0] *Hive 0.13:* After insert SQL: Partition

Re: Wrong results from join query in Hive 0.13 and also 1.0 with reproduce.

>>> Thanks, >>> Ashutosh >>> >>> On Tue, Sep 1, 2015 at 6:00 PM, Jim Green wrote: >>> >>>> Seems Hive 1.2 fixed this issue. But not sure what is the JIRA related >>>> and the possibility to backport this fix into Hive 0.13? >&

Re: Wrong results from join query in Hive 0.13 and also 1.0 with reproduce.

ve 1.2 fixed this issue. But not sure what is the JIRA related >>> and the possibility to backport this fix into Hive 0.13? >>> >>> >>> On Tue, Sep 1, 2015 at 5:35 PM, Jim Green wrote: >>> >>>> Hi Team, >>>> >>>> Be

Re: Wrong results from join query in Hive 0.13 and also 1.0 with reproduce.

t; Thanks, > Ashutosh > > On Tue, Sep 1, 2015 at 6:00 PM, Jim Green wrote: > >> Seems Hive 1.2 fixed this issue. But not sure what is the JIRA related >> and the possibility to backport this fix into Hive 0.13? >> >> >> On Tue, Sep 1, 2015 at 5:35 PM, Jim Green

Re: Wrong results from join query in Hive 0.13 and also 1.0 with reproduce.

https://issues.apache.org/jira/browse/HIVE-10841 Thanks, Ashutosh On Tue, Sep 1, 2015 at 6:00 PM, Jim Green wrote: > Seems Hive 1.2 fixed this issue. But not sure what is the JIRA related and > the possibility to backport this fix into Hive 0.13? > > > On Tue, Sep 1, 2015 at 5:3

Re: Wrong results from join query in Hive 0.13 and also 1.0 with reproduce.

Seems Hive 1.2 fixed this issue. But not sure what is the JIRA related and the possibility to backport this fix into Hive 0.13? On Tue, Sep 1, 2015 at 5:35 PM, Jim Green wrote: > Hi Team, > > Below is the minimum reproduce of wrong results in Hive 0.13: > > *1. Create 4 t

Wrong results from join query in Hive 0.13 and also 1.0 with reproduce.

Hi Team, Below is the minimum reproduce of wrong results in Hive 0.13: *1. Create 4 tables* CREATE EXTERNAL TABLE testjoin1( joincol string ); CREATE EXTERNAL TABLE testjoin2( anothercol string , joincol string); CREATE EXTERNAL TABLE testjoin3( anothercol string); CREATE EXTERNAL TABLE

Re: Reading tables will lock entire database in Hive 0.13

I found the answer…hive.txn.manager is added starting in hive 0.13. Thanks all. On Mon, Aug 31, 2015 at 3:54 PM, Jim Green wrote: > Hi Team, > > This issue only happens on hive 0.13, not in Hive 0.12. > Does anybody know what is the change between 0.12 and 0.13 which caused

Re: Reading tables will lock entire database in Hive 0.13

Hi Team, This issue only happens on hive 0.13, not in Hive 0.12. Does anybody know what is the change between 0.12 and 0.13 which caused this issue? Thanks. On Sat, Feb 28, 2015 at 3:47 AM, Chaoyu Tang wrote: > It was fixed for DummyTxnManager. DbTxnManager should not have this is

Re: Is hive 0.13 index working fine on partition tables?

Anyone knows the JIRAs related to this issue? On Mon, Jun 29, 2015 at 2:35 PM, Jim Green wrote: > Hi Team, > > On hive 0.13, I have a minimum reproduce for index on partition table > issue: > CREATE TABLE test_partition_index( > id1 bigint, > id2 bigint, > id3 bigint)

Is hive 0.13 index working fine on partition tables?

Hi Team, On hive 0.13, I have a minimum reproduce for index on partition table issue: CREATE TABLE test_partition_index( id1 bigint, id2 bigint, id3 bigint) PARTITIONED BY ( dt string) row format delimited fields terminated by ','; cat sampledata 111,222,333 LOAD DATA LOCAL INPATH &

Re: CamelCase using InitCap Function in Hive 0.13

;> >>> I'm a relatively new user to Hive and was trying to format a column of >>> String datatype from Uppercase to Camel-case. I could see the INITCAP() >>> function in the language manual, and also could find related notes on JIRA >>> stating it is av

Re: CamelCase using InitCap Function in Hive 0.13

ual, and also could find related notes on JIRA >> stating it is available. But for some reason when I run my query it shows >> an invalid function error, and the show functions does not list the >> function. I'm running Hive 0.13. Is there any setting I need to enable >

Re: CamelCase using InitCap Function in Hive 0.13

s > an invalid function error, and the show functions does not list the > function. I'm running Hive 0.13. Is there any setting I need to enable > this? > > Please advice what needs to be done in order to use this function. > > -- > Thanks in advance, > Vivek Veeramani > > > cell : +91-9632 975 975 > +91-9895 277 101 >

CamelCase using InitCap Function in Hive 0.13

shows an invalid function error, and the show functions does not list the function. I'm running Hive 0.13. Is there any setting I need to enable this? Please advice what needs to be done in order to use this function. -- Thanks in advance, Vivek Veeramani cell : +91-9632 975 975 +9

Re: Why hive 0.13 will initialize derby database if the metastore parameters are not set in hive-site.xml?

And Starting from hive 0.13, hive.stats.dbclass=fs by default. So I am thinking autostats may not be related here. Could be some other features need derby…. On Fri, Mar 6, 2015 at 6:37 PM, Jim Green wrote: > Hi Edward, > > No matter if I set hive.stats.autogather=false in hive-si

Re: Why hive 0.13 will initialize derby database if the metastore parameters are not set in hive-site.xml?

:34 metastore_db Thanks. On Fri, Mar 6, 2015 at 6:17 PM, Edward Capriolo wrote: > Make sure hive autogather stats is false . Or aetup the stats db > > > On Friday, March 6, 2015, Jim Green wrote: > >> Hi Team, >> >> Starting from hive 0.13, if the metastore parameters

Re: Why hive 0.13 will initialize derby database if the metastore parameters are not set in hive-site.xml?

Make sure hive autogather stats is false . Or aetup the stats db On Friday, March 6, 2015, Jim Green wrote: > Hi Team, > > Starting from hive 0.13, if the metastore parameters are not set in > hive-site.xml, but we set in .hiverc, hive will try to initialize derby > database in

Why hive 0.13 will initialize derby database if the metastore parameters are not set in hive-site.xml?

Hi Team, Starting from hive 0.13, if the metastore parameters are not set in hive-site.xml, but we set in .hiverc, hive will try to initialize derby database in current working directory. This behavior did not exist in hive 0.12. Is it a known bug? or behavior change? I have the repro as below

Re: Reading tables will lock entire database in Hive 0.13

It was fixed for DummyTxnManager. DbTxnManager should not have this issue. Thanks On Thu, Feb 26, 2015 at 1:52 PM, Jim Green wrote: > Hi Chaoyu, > > Thanks for the information. > Actually by default, if we set hive.support.concurrency=true in Hive 0.13: > >

Re: Reading tables will lock entire database in Hive 0.13

Hi Chaoyu, Thanks for the information. Actually by default, if we set hive.support.concurrency=true in Hive 0.13: hive.lock.manager=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DummyTxnManager Hive-9199 mentioned it is

Re: Reading tables will lock entire database in Hive 0.13

re is old thread about this issue: > http://qnalist.com/questions/5091386/doubt-about-locking-mechanism-in-hive > > I met the same issue that when reading one table in session A, we can not > create a table in the same database in session B. Basically it causes > database level lock in Hi

Re: Reading tables will lock entire database in Hive 0.13

A, we can not create a table in the same database in session B. Basically it causes database level lock in Hive 0.13 when hive.support.concurrency=true. Minimum reproduce: --Session A: create table passwords (col0 string, col1 string, col2 string, col3 string, col4 string, col5 string

Reading tables will lock entire database in Hive 0.13

Hi Team, Here is old thread about this issue: http://qnalist.com/questions/5091386/doubt-about-locking-mechanism-in-hive I met the same issue that when reading one table in session A, we can not create a table in the same database in session B. Basically it causes database level lock in Hive

Hive 0.13 vs LZO index vs hive.hadoop.supports.splittable.combineinputformat issue

Hello Hive support team, Happy new year to you! Quick question in regards to combining small LZO files in Hive. As some of our HDFS files are indexed (not all, but there is always a few .lzo.index files in the directory structure), we are experiencing the problematic behavior described in JIR

Re: Hive 0.13/Hadoop 0.20 ORC probleme

wrote: > Both Hadoop 2.6 and hive 0.13 use protobuf 2.5, so it runs well. > But Hadoop 2.0 and before, protobuf 2.4 is used, just as I mentioned > before, 2.4 and 2.5 are uncompatible. > > Good luck. > > On Thu, Dec 11, 2014 at 10:22 PM, Amjad ALSHABANI > wrote: >> &g

Re: Hive 0.13/Hadoop 0.20 ORC probleme

Both Hadoop 2.6 and hive 0.13 use protobuf 2.5, so it runs well. But Hadoop 2.0 and before, protobuf 2.4 is used, just as I mentioned before, 2.4 and 2.5 are uncompatible. Good luck. On Thu, Dec 11, 2014 at 10:22 PM, Amjad ALSHABANI wrote: > > Hello Jander, > > Thanx for your repl

Re: Hive 0.13/Hadoop 0.20 ORC probleme

Hello Jander, Thanx for your reply, I think it is more about hadoop CLASSPATH problem, because the same built Hive 0.13 worked well with Hadoop 2.6 I ll try to find a way to change hadoop classpath so it will use the new protobu instead of 2.4 On Thu, Dec 11, 2014 at 11:48 AM, Jander g wrote

Re: Hive 0.13/Hadoop 0.20 ORC probleme

hi，Amjad protobuf 2.4 isn't compatible with protobuf 2.5, so you should regen OrcProto.java using protobuf 2.4.0, and then rebuild hive. I hope it helps. On Wed, Dec 10, 2014 at 6:28 PM, Amjad ALSHABANI wrote: > > Hello everybody. > > I have a problem when using ORC file fo

Hive 0.13/Hadoop 0.20 ORC probleme

Hello everybody. I have a problem when using ORC file format in Hive 0.13. I have built Hive 0.13 with Hadoop 0.20. when creating a table using ORC format it is OK, but when trying to add some lines or do a simple count I got this exception: java.lang.VerifyError: class

tablesample query on bucketed ORC table needs execute access in Hive 0.13

In Hive 0.13 when I do a tablesample query on an ORC table, such as select x from orc_table tablesample (bucket 32 out of 64) where date=1106; I'll get the following error saying I'm trying to run with EXECUTE access but the files have only READ access for non owner. Why would a sim

hive 0.13 msck repair table only lists partitions not in metastore

Hi, I'm trying to use Hive(0.13) msck repair table command to recover partitions and it only lists the partitions not added to metastore instead of adding them to metastore as well. here's the ouput of the command partitions not in metastore externalexample:CreatedAt=26 04%3A50%3A5

"user" as table alias is not allowed in hive 0.13

We just upgrade our hive from hive 0.11 to hive 0.13, we find that running "select * from src1 user limit 5;" in hive 0.13 report the following errors: > ParseException line 1:14 cannot recognize input near 'src1' 'user' 'limit' > in from source

Re: UDTF "KryoException: unable create/find class" error in hive 0.13

t; > On Tue, Sep 9, 2014 at 1:31 AM, Furcy Pin wrote: > >> Hi, >> >> I think I encountered this kind of serialization problem when writing >> UDFs. >> Usually, marking every fields of the UDF as *transient* does the trick. >> >> I guess the error means

Re: UDTF "KryoException: unable create/find class" error in hive 0.13

e instantiated in the > default constructor or during the call of initialize() > > Please keep me informed if it works or not, > > Regards, > > Furcy > > > 2014-09-09 1:44 GMT+02:00 Echo Li : > >> I wrote a UDTF in hive 0.13, the function parse a column wh

Re: UDTF "KryoException: unable create/find class" error in hive 0.13

that it will not and that they will be instantiated in the default constructor or during the call of initialize() Please keep me informed if it works or not, Regards, Furcy 2014-09-09 1:44 GMT+02:00 Echo Li : > I wrote a UDTF in hive 0.13, the function parse a column which is json > stri

UDTF "KryoException: unable create/find class" error in hive 0.13

I wrote a UDTF in hive 0.13, the function parse a column which is json string and return a table. The function compiles successfully by adding hive-exec-0.13.0.2.1.2.1-471.jar to classpath, however when the jar is added to hive and a function created using the jar then I try to run a query using

Re: Reading and Writing with Hive 0.13 from a Yarn application

gt; -- > *From:* Ashutosh Chauhan > *Sent:* Wednesday, September 3, 2014 9:16 AM > *To:* user@hive.apache.org > *Subject:* Re: Reading and Writing with Hive 0.13 from a Yarn application > > Hi Nathan, > > This was done in https://issues.apach

RE: Reading and Writing with Hive 0.13 from a Yarn application

hanks, Nathan From: Ashutosh Chauhan Sent: Wednesday, September 3, 2014 9:16 AM To: user@hive.apache.org Subject: Re: Reading and Writing with Hive 0.13 from a Yarn application Hi Nathan, This was done in https://issues.apache.org/jira/browse/HIVE-6248 Reas

Re: Reading and Writing with Hive 0.13 from a Yarn application

Hi Nathan, This was done in https://issues.apache.org/jira/browse/HIVE-6248 Reasoning was to minimize api surface area to users so that they are immune of incompatible changes in internal classes and thus making it easier for them to consume this and not get worried about version upgrade. Seems li

Reading and Writing with Hive 0.13 from a Yarn application

Hi, My company has been working on a Yarn application for a couple of years-- we essentially take the place of MapReduce and split our data and processing ourselves. One of the things we've been working to support is Hive access, and the HCatalog interfaces and API seemed perfect. Using th

Hive 0.13 count(*) query issue for S3 data storage

Hello, I am using Hadoop 2.5 and Hive 0.13 setup. I have an external partitioned Hive table with files stored in S3 in RCFile format. When I perform a 'select *', I get the rows correctly but aggregation queries are failing with the following exception:- Caused by: java.io.EO

Re: Issue while running Hive 0.13

.0.4. Suspecting some compatibility issues I moved from > Hive 0.13 to Hive 0.12. > But the exceptions related to SL4J still persist. > > Unable to move forward with hive to finalize a critical product design. > Can somebody please help me? > > > On Wed, Jul 9, 2014 at 11:25 A

Re: Issue while running Hive 0.13

specting some compatibility issues I moved from > Hive 0.13 to Hive 0.12. > But the exceptions related to SL4J still persist. > > Unable to move forward with hive to finalize a critical product design. Can > somebody please help me? > > > On Wed, Jul 9, 2014 at 11

Re: Issue while running Hive 0.13

I'm using Hadoop 1.0.4. Suspecting some compatibility issues I moved from Hive 0.13 to Hive 0.12. But the exceptions related to SL4J still persist. Unable to move forward with hive to finalize a critical product design. Can somebody please help me? On Wed, Jul 9, 2014 at 11:25 AM, S

Re: Issue while running Hive 0.13

osh.tho...@yahoo.com> wrote: >> >>> how did you start hive? Use hive-server2 >>> >>> -- >>> *From:* Sarath Chandra >>> *To:* user@hive.apache.org >>> *Sent:* Tuesday, July 8, 2014 4:02 PM >>> *Subj

Re: Issue while running Hive 0.13

> >> how did you start hive? Use hive-server2 >> >> -- >> *From:* Sarath Chandra >> *To:* user@hive.apache.org >> *Sent:* Tuesday, July 8, 2014 4:02 PM >> *Subject:* Issue while running Hive 0.13 >> >> Hi, >&

Re: Issue while running Hive 0.13

n Tue, Jul 8, 2014 at 4:16 PM, Santhosh Thomas wrote: > how did you start hive? Use hive-server2 > > -- > *From:* Sarath Chandra > *To:* user@hive.apache.org > *Sent:* Tuesday, July 8, 2014 4:02 PM > *Subject:* Issue while running Hive 0.13 &

Re: Issue while running Hive 0.13

how did you start hive? Use hive-server2 From: Sarath Chandra To: user@hive.apache.org Sent: Tuesday, July 8, 2014 4:02 PM Subject: Issue while running Hive 0.13 Hi, I'm a newbie to Hive. Facing an issue while installing hive stable version (0.1

Issue while running Hive 0.13

Hi, I'm a newbie to Hive. Facing an issue while installing hive stable version (0.13). I downloaded the tar file from the site ( apache-hive-0.13.1-bin.tar.gz ) and followed the instructions given on Hive Wiki

Re: Hive 0.13 map 100 % reduce 100% and the reduce decrise to 75 % ( in join or lag function)

No task failed in log I suspect the skewed join problem (skewed table using lag fonction ). How can I avoid this ( skewed data)? Le 26 juin 2014 00:40, "Stéphane Verlet" a écrit : > if reduce is decreasing is probably mean it failed. > It typically retries and goes back up > > > On Mon, Jun 23, 2

Re: Hive 0.13 map 100 % reduce 100% and the reduce decrise to 75 % ( in join or lag function)

if reduce is decreasing is probably mean it failed. It typically retries and goes back up On Mon, Jun 23, 2014 at 3:15 AM, Matouk IFTISSEN wrote: > > My HDFS space is so big I dont thiks this isthe cause of the problem. > I will test to increase java heap memory in hive-env.sh file > > 2014-06

Hive 0.13 map 100 % reduce 100% and the reduce decrise to 75 % ( in join or lag function)

My HDFS space is so big I dont thiks this isthe cause of the problem. I will test to increase java heap memory in hive-env.sh file 2014-06-23 11:06 GMT+02:00 Nagarjuna Vissarapu : > Can you please check your hdfs space once? If it is fine please increase > java heap memory in hive-env.sh file >

Hive-0.13 java.io.FileNotFoundException: HIVE_PLAN not found

Hi, I run Hadoop-2.2.0 + Hive-0.13.0 on a cluster. WordCount example succeeds running and it's ok to create table in hive cli. But when i run hive query with mapreduce jobs, then i keep getting errors like: Diagnostic Messages for this Task:Error: java.lang.RuntimeException: java.io.FileNotFo

Hive-0.13 java.io.FileNotFoundException: HIVE_PLAN not found

Hi, I run Hadoop-2.2.0 + Hive-0.13.0 on a cluster. WordCount example succeeds running and it's ok to create table in hive cli. But when i run hive query with mapreduce jobs, then i keep getting errors like: Diagnostic Messages for this Task:Error: java.lang.RuntimeException: java.io.FileNotFo

Re: Hive 0.13 - Yarn - Tez application not shutting down

.mo...@thinkbiganalytics.com> wrote: > I'm on HDP 2.1 Hive 0.13/Tez > > I run this query: > > hive -v --database=ORC_db -e `select * from store_sales where > ss_ticket_number=5741230 and ss_item_sk=4825` > > The yarn application runs Tez for a few seconds, generates the results and >

Hive 0.13 - Yarn - Tez application not shutting down

I'm on HDP 2.1 Hive 0.13/Tez I run this query: hive -v --database=ORC_db -e `select * from store_sales where ss_ticket_number=5741230 and ss_item_sk=4825` The yarn application runs Tez for a few seconds, generates the results and shuts down and goes away as reported by `yarn application

Re: Hive 0.13 Metastore => MySQL BoneCP issue

2014 at 8:00 PM, Vaibhav Gumashta < >> vgumas...@hortonworks.com> wrote: >> >>> Soam, >>> >>> What version of BoneCP are you using? >>> >>> Thanks, >>> --Vaibhav >>> >>> >>> On Tue, Jun 10, 2014 at 12:41 PM, Soam A

Re: Hive 0.13 Metastore => MySQL BoneCP issue

2014 at 12:41 PM, Soam Acharya >> wrote: >> >>> Hi folks, >>> >>> we're seeing an intermittent issue between our Hive 0.13 metastore and >>> mysql instance. After being idle for about 5 minutes or so, any >>

Re: Hive 0.13 Metastore => MySQL BoneCP issue

, 2014 at 12:41 PM, Soam Acharya wrote: > >> Hi folks, >> >> we're seeing an intermittent issue between our Hive 0.13 metastore and >> mysql instance. After being idle for about 5 minutes or so, any >> transactions involving the metastore and mysql causes the fol

Re: Hive 0.13 Metastore => MySQL BoneCP issue

Soam, What version of BoneCP are you using? Thanks, --Vaibhav On Tue, Jun 10, 2014 at 12:41 PM, Soam Acharya wrote: > Hi folks, > > we're seeing an intermittent issue between our Hive 0.13 metastore and > mysql instance. After being idle for about 5 minutes or so, a

Hive 0.13 Metastore => MySQL BoneCP issue

Hi folks, we're seeing an intermittent issue between our Hive 0.13 metastore and mysql instance. After being idle for about 5 minutes or so, any transactions involving the metastore and mysql causes the following error to appear in the metastore log: 2014-06-09 05:13:52,066

RE: Hive 0.13/Hcatalog : Mapreduce Exception : java.lang.IncompatibleClassChangeError

Hi, Thanks .. do I need to run this as -Phadoop-1. As I am using Hadoop 2.4.0 , I thought of running it with –Phadoop-2 ? Please advise .. -malli From: Navis류승우 [mailto:navis@nexr.com] Sent: Wednesday, June 04, 2014 11:44 PM To: user@hive.apache.org Subject: Re: Hive 0.13/Hcatalog

Re: Hive 0.13/Hcatalog : Mapreduce Exception : java.lang.IncompatibleClassChangeError

2014-06-05 9:08 GMT+09:00 Sundaramoorthy, Malliyanathan < > malliyanathan.sundaramoor...@citi.com>: > > Hi, >> >> I am using Hadoop 2.4.0 with Hive 0.13 + included package of HCatalog . >> Wrote a simple map-reduce job from the example and runnin

Re: Hive 0.13/Hcatalog : Mapreduce Exception : java.lang.IncompatibleClassChangeError

It's fixed in HIVE-6432. I think you should rebuild your own hcatalog from source with profile -Phadoop-1. 2014-06-05 9:08 GMT+09:00 Sundaramoorthy, Malliyanathan < malliyanathan.sundaramoor...@citi.com>: > Hi, > > I am using Hadoop 2.4.0 with Hive 0.13 + included package o

Hive 0.13/Hcatalog : Mapreduce Exception : java.lang.IncompatibleClassChangeError

Hi, I am using Hadoop 2.4.0 with Hive 0.13 + included package of HCatalog . Wrote a simple map-reduce job from the example and running the code below .. getting "Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobCon

Hive 0.13/Hcatalog : Mapreduce Exception : java.lang.IncompatibleClassChangeError

Hi, I am using Hadoop 2.4.0 with Hive 0.13 + included package of HCatalog . Wrote a simple map-reduce job from the example and running the code below .. getting "Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobCon

Re: Python version compatibility for hive 0.13

do you mean python hiveserver client library? I would recommend you to upgrade to python 2.6 to the least On Wed, May 21, 2014 at 9:54 PM, Hari Rajendhran wrote: > Hi Team, > > Does Python 2.4.3 supports apache hive 0.13 version ? > > > > Best Regards > Hari Krishnan R

Python version compatibility for hive 0.13

Hi Team, Does Python 2.4.3 supports apache hive 0.13 version ? Best Regards Hari Krishnan Rajendhran Hadoop Admin DESS-ABIM ,Chennai BIGDATA Galaxy Tata Consultancy Services Cell:- 9677985515 Mailto: hari.rajendh...@tcs.com Website: http://www.tcs.com

Re: ORC file in Hive 0.13 throws Java heap space error

Jayachandran < pjayachand...@hortonworks.com> wrote: > With Hive 0.13 the ORC memory issue is mitigated because of this > optimization https://issues.apache.org/jira/browse/HIVE-6455. This > optimization is enabled by default. > But having 3283 columns is still huge. So I would still

Re: ORC file in Hive 0.13 throws Java heap space error

With Hive 0.13 the ORC memory issue is mitigated because of this optimization https://issues.apache.org/jira/browse/HIVE-6455. This optimization is enabled by default. But having 3283 columns is still huge. So I would still recommend reducing the default compression (256KB) buffer size to a

Re: ORC file in Hive 0.13 throws Java heap space error

When I created the table, I had to reduce the orc.compress.size quite a bit to make my table with many columns work. This was on Hive 0.12 (I thought it was supposed to be fixed on Hive 0.13, but 3k+ columns is huge) The default of orc.compress size is quite a bit larger ( think in the 268k range

Re: ORC file in Hive 0.13 throws Java heap space error

Sorry for the double post. I did not show up for a while and then I could not get to the archives page, so I thought I'd needed to resend. On Fri, May 16, 2014 at 12:54 AM, Premal Shah wrote: > I have a table in hive stored as text file with 3283 columns. All columns > are of string data type. >

ORC file in Hive 0.13 throws Java heap space error

I have a table in hive stored as text file with 3283 columns. All columns are of string data type. I'm trying to convert that table into an orc file table using this command *create table orc_table stored as orc as select * from text_table;* This is the setting under mapred-site.xml mapred.

ORC file in Hive 0.13 throws Java heap space error

I have a table in hive stored as text file with 3283 columns. All columns are of string data type. I'm trying to convert that table into an orc file table using this command *create table orc_table stored as orc as select * from text_table;* This is the setting under mapred-site.xml mapred.

Re: Hive 0.13

The release process is currently scheduled to begin on March 4th. It takes a couple of weeks, minimum, so if all goes well Hive 0.13 will be ready sometime in the second half of March. Here's the message thread on dev@hive: Timeline for the Hive 0.13 release?<http://mail-archives.ap

Hive 0.13

Hi, when is hive 0.13 getting released? Thanks Bhaskie