Re: Quick Question

Here's the documentation: Parquet . -- Lefty On Fri, Dec 4, 2015 at 5:03 PM, Xuefu Zhang wrote: > Create a table with the file and query the table. Parquet is fully > supported in Hive. > > --Xuefu > > On Fri, Dec 4, 2015 at 10:58 AM, S

Re: Why there are two different stages on the same query when i use hive on spark.

The first stage for 1st query is to build a hash table for map join. It took 7s to finish. Why do you think it's slow? Of course, it seemed you had many small files, since there were 100 mappers, so each file would be very small. This is not good for performance. Also consider using other data form

Re: Quick Question

Create a table with the file and query the table. Parquet is fully supported in Hive. --Xuefu On Fri, Dec 4, 2015 at 10:58 AM, Siva Kanth Sattiraju (ssattira) < ssatt...@cisco.com> wrote: > Hi All, > > Is there a way to read “parquet” file through Hive? > > Regards, > Siva > >

SerDe, InputFormat, and OutputFormat

Hi. I am confused on the difference between the Serializer/Deserializer and InputFormat/OutputFormat in the CREATE TABLE command. For example, let=E2=80=99s say I am using Sequence files, but my records are of some unknown type not known to Hive (i.e. not Thrift, Protocol Buffer, etc.). Could I st

Issue: Hive with Tez on CDH-5.4.2

Hi All, I have installed Tez (0.7.0) on Cloudera VM CDH 5.4.2 (hadoop-2.6.0, hive-1.1.0). Execution of demo orderedWordCount example got executed successfully. But hive queries on Tez execution engine is throwing below error. Any help is appreciated. Thanks!! ERROR LOGS: hive> set hive.executio

Re: Cannot drop a table after creating an index and then renaming to a different database

That looks like a bug in rename. Can you please file a JIRA? From: Toby Allsopp mailto:toby.alls...@wherescape.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, December 3, 2015 at 18:24 To: "user@hive.apache.org

Quick Question

Hi All, Is there a way to read "parquet" file through Hive? Regards, Siva

Re: FW: Getting error when trying to start master node after building spark 1.3

1.3.1 is what officially supported by Hive 1.2.1. 1.3.0 might be okay too. On Fri, Dec 4, 2015 at 9:34 AM, Mich Talebzadeh wrote: > Appreciated the response. Just to clarify the build will be spark 1.3 and > the pre-build download will be 1.3. this is the version I am attempting to > make it wor

RE: FW: Getting error when trying to start master node after building spark 1.3

Appreciated the response. Just to clarify the build will be spark 1.3 and the pre-build download will be 1.3. this is the version I am attempting to make it work. Thanks Mich From: Xuefu Zhang [mailto:xzh...@cloudera.com] Sent: 04 December 2015 17:03 To: user@hive.apache.org Subject:

Re: FW: Getting error when trying to start master node after building spark 1.3

My last attempt: 1. Make sure the spark-assembly.jar from your own build doesn't contain hive classes, using "jar -tf spark-assembly.jar | grep hive" command. Copy it to Hive's /lib directory. After this, you can forget everything about this build. 2. Download prebuilt tarball from Spark download

Re: how to search the archive

2) Sometimes I find that managed tables are not removed from HDFS even after I drop them from the Hive shell. After a "drop table foo", foo does not show up in a "show tables" listing however that table is present in HDFS. These are not external tables. I have noticed this as well. Sometimes this

RE: how to search the archive

No, definitely not. A Hive table with Sequence Files stored in hdfs: /user/warehouse/ Kind Regards Timothy Garza Data Integration Developer Collinson Technology Services Skype: timothy.garza.cts collinsongroup.com [Collinson Group]

Re: how to search the archive

Could a table be an external table? On Fri, Dec 4, 2015 at 5:56 AM, Timothy Garza < timothy.ga...@collinsongroup.com> wrote: > I find the same thing, especially with Hive v1.2.1 that I am currently > trialling. It does lead to issues with the Metastore when trying to re-use > the same Hive Table

RE: how to search the archive

I find the same thing, especially with Hive v1.2.1 that I am currently trialling. It does lead to issues with the Metastore when trying to re-use the same Hive Table name and I find manually deleting the files in HDFS serves as a workaround. Q. What does that have to do with the text in the Sub

Re: Hive Support for Unicode languages

What operating system are you using? > On 04 Dec 2015, at 01:25, mahender bigdata > wrote: > > Hi Team, > > Does hive supports Hive Unicode like UTF-8,UTF-16 and UTF-32. I would like to > see different language supported in hive table. Is there any serde which can > show exactly japanese, ch

Re: Storing the Hive Query Results into Variable

You can certainly do that with pig. On Dec 3, 2015 7:18 PM, "mahender bigdata" wrote: > Hi, > Is there option available to store hive results into variable like > > select @i= count(*) from HiveTable. > > or > > Storing Table Results into variable and make use of it later stage of > Query. I tire

FW: Getting error when trying to start master node after building spark 1.3

I sent this one to Spark user group but no response Hi, I am trying to make Hive work with Spark. I have been told that I need to use Spark 1.3 and build it from source code WITHOUT HIVE libraries. I have built it as follows: ./make-distribution.sh --name "hadoop2-without-

how to search the archive

Hey all! I have two questions: 1) How do I search the entire mailing list archive? 2) Sometimes I find that managed tables are not removed from HDFS even after I drop them from the Hive shell. After a "drop table foo", foo does not show up in a "show tables" listing however that table is present

Re: Handling LZO files

You can put several small files packed in one Hadoop archive (HAR). The other alternative was to set the split size of the execution engine (TEZ, mr,...), which you probably do not want to do on a global level. In general, one should replace xml, json etc with Avro where possible and then use fo

Re: Does Hive 0.14.0. support registering permanent function during hive thrift server is running

I've actually had this issue, the way I solved it, I am not sure if that's the correct way, I"ve added my function definitions to .bashrc file in $hive_home/bin. That file is called once before every hive session is created so you have to create the functions as temporary functions, creating the