Data Staging exp

2014-08-14 Thread Sri kripa
Hi Friends, Do anyone of you have Data Staging exp using *Rest API* for hadoop project. Please share you exp. Thanks Kripa

RE: request write access to Hive Wiki

2014-08-14 Thread Li, Chengxiang
Thanks, Ashutosh, very appreciated. Cheers, chengxiang From: Ashutosh Chauhan [mailto:hashut...@apache.org] Sent: Thursday, August 14, 2014 11:24 PM To: user@hive.apache.org Subject: Re: request write access to Hive Wiki Hi Chengxiang, Granted write access to wiki to you. Thanks, Ashutosh On

Re: Learn Java for Hadoop

2014-08-14 Thread Nishant Kelkar
Hi Saurabh, Welcome to the world of Apache Hadoop! Here are a few good places to start: 1. Apache Hadoop Definitive Guide book: http://shop.oreilly.com/product/0636920021773.do (you could find a free e-copy if you Google some :) ) 2. Hadoop Javadocs: https://hadoop.apache.org/docs/current/api/ 3.

Re: Altering the Metastore on EC2

2014-08-14 Thread Stephen Sprague
i'll take a stab at this. - probably no reason. - if you can. is there a derby client s/t you can issue the command: "alter table COLUMNS_V2 modify TYPE_NAME varchar(32672)". otherwise maybe use the mysql or postgres metastores (instead of derby) and run that alter command after the install. - t

Learn Java for Hadoop

2014-08-14 Thread Db-Blog
Greetings to everyone. I am a newbie in Java and seeks guidance in learning "Java specifically required for Hadoop". It will be really helpful if someone can pass on the links/topics/online-courses which can be helpful to get started on it. I come from ETL & DB- SQL background and currently wo

Re: Data in Hive

2014-08-14 Thread Nishant Kelkar
Hi there! So Hive stores it's data in HDFS. That means, it is distributed by default. The distribution factor is controlled by parameters, specifically the block size(dfs.block.size). The file splits are also replicated, meaning that if a data node were to fail, it's replicas on other nodes would

Re: ArrayWritableGroupConverter

2014-08-14 Thread Raymond Lau
Original Thrift schema: struct teststruct { 1: optional string field1; 2: optional string field2; 3: optional string field3; } struct mainstruct { 1: optional list teststructs; } This parquet file schema was generated: message ParquetSchema { optional group teststructs { repeated

Re: SerDe errors

2014-08-14 Thread Roberto Congiu
Can you provide the CREATE statement used to create the table and a sample of the json that's causing the error ? It sounds like you have a field declared as bigint on the schema, but it's actually an object. On Wed, Aug 13, 2014 at 5:05 AM, Charles Robertson < charles.robert...@gmail.com> wrote:

Re: ArrayWritableGroupConverter

2014-08-14 Thread Brock Noland
Hi, Can you share your parquet schema? Brock On Tue, Aug 12, 2014 at 5:06 PM, Raymond Lau wrote: > Hello. (First off, sorry if I accidentally posted to the wrong mailing > list before - dev - and you are getting this again) > > Regarding the ArrayWritableGroupConverter class: I was just wond

Re: request write access to Hive Wiki

2014-08-14 Thread Ashutosh Chauhan
Hi Chengxiang, Granted write access to wiki to you. Thanks, Ashutosh On Thu, Aug 14, 2014 at 2:38 AM, Li, Chengxiang wrote: > Hi, > > I'm working on HIVE-7142 > which should document some information on Hive wiki, while I didn't have > write

Data in Hive

2014-08-14 Thread CHEBARO Abdallah
My target is to perform a SELECT query using Hive When I have a small data on a single machine (namenode), I start by: 1-Creating a table that contains this data: create table table1 (int col1, string col2) 2-Loading the data from a file path: load data local inpath 'path' into table table1; 3-P

Re: Difference between Hive and HCat table?

2014-08-14 Thread Peyman Mohajerian
Other tools, e.g. Pig can access HCat and find out what the schema is. At Teradata we look up the meta-data directly from HCat and then read the data in parallel from HDFS rather than the slower route that is Hiverserver2. So HCat is an important tool for vendors who want to import/export data to H

request write access to Hive Wiki

2014-08-14 Thread Li, Chengxiang
Hi, I'm working on HIVE-7142 which should document some information on Hive wiki, while I didn't have write access to Hive wiki yet, could someone help me about this? My Confluence usename: chengxiang.li Thanks chengxiang