Re: Loading data into hive table from stdin

2011-09-12 Thread Adriaan Tijsseling
Thanks, that seems to be the proper alternative. Adriaan On 2011/09/12, at 16:05, Vikas Srivastava wrote: > No, > but what you can do is to write a general script to read files from the > folder and store it into list then retrive the file from list and load them > into desire path. > > On Mon

Re: Loading data into hive table from stdin

2011-09-12 Thread Vikas Srivastava
No, but what you can do is to write a general script to read files from the folder and store it into list then retrive the file from list and load them into desire path. On Mon, Sep 12, 2011 at 7:24 PM, Adriaan Tijsseling wrote: > Sorry, I wasn't clear. What I meant was if the data in path $path

Re: Loading data into hive table from stdin

2011-09-12 Thread Adriaan Tijsseling
Sorry, I wasn't clear. What I meant was if the data in path $path can itself be a script that feeds the data in streaming fashion? Something like "load data using script 'loader.py' into table foo". On 2011/09/12, at 15:36, Vikas Srivastava wrote: > hive -e "load data local in path '$path' into

Re: Loading data into hive table from stdin

2011-09-12 Thread Vikas Srivastava
hive -e "load data local in path '$path' into table $table partition(date='$date')" On Mon, Sep 12, 2011 at 7:04 PM, Adriaan Tijsseling wrote: > Do you have the syntax for the proper hive QL command? > > Thanks! > > On 2011/09/12, at 15:23, Vikas Srivastava wrote: > > > ya you can simple load the

Re: Loading data into hive table from stdin

2011-09-12 Thread Adriaan Tijsseling
Do you have the syntax for the proper hive QL command? Thanks! On 2011/09/12, at 15:23, Vikas Srivastava wrote: > ya you can simple load the data by a simple script without using any api or > anything!! > > On Mon, Sep 12, 2011 at 6:29 PM, Adriaan Tijsseling > wrote: > >> Is it possible to loa

Re: Loading data into hive table from stdin

2011-09-12 Thread Vikas Srivastava
ya you can simple load the data by a simple script without using any api or anything!! On Mon, Sep 12, 2011 at 6:29 PM, Adriaan Tijsseling wrote: > Is it possible to load data into a hive table that is fed in using a unix > pipe or streamed via a script? I've only seen streaming options when usin

Loading data into hive table from stdin

2011-09-12 Thread Adriaan Tijsseling
Is it possible to load data into a hive table that is fed in using a unix pipe or streamed via a script? I've only seen streaming options when using SELECT TRANSFORM. Thanks in advance, Adriaan