RE: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congratulations Mithun ☺ -Regards Rohith Sharma K S From: cwsteinb...@gmail.com [mailto:cwsteinb...@gmail.com] On Behalf Of Carl Steinbach Sent: 15 April 2015 03:25 To: d...@hive.apache.org; user@hive.apache.org; mit...@apache.org Subject: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan Th

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun! On Wed, Apr 15, 2015 at 11:34 AM, Mohammad Islam wrote: > Congrats Mithun! > > --Mohammad > > > > On Tuesday, April 14, 2015 9:10 PM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > > > Congrats Mithun! > > Thanks > Prasanth > > > > > On Tue, Apr 14, 2015 a

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun! --Mohammad On Tuesday, April 14, 2015 9:10 PM, Prasanth Jayachandran wrote: Congrats Mithun! Thanks Prasanth On Tue, Apr 14, 2015 at 8:51 PM -0700, "Jimmy Xiang" wrote: Congrats! On Tue, Apr 14, 2015 at 8:46 PM, Lefty Leverenz wrote: Congrats Mithun -- whe

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun! Thanks Prasanth On Tue, Apr 14, 2015 at 8:51 PM -0700, "Jimmy Xiang" mailto:jxi...@cloudera.com>> wrote: Congrats! On Tue, Apr 14, 2015 at 8:46 PM, Lefty Leverenz mailto:leftylever...@gmail.com>> wrote: Congrats Mithun -- when they gave me the cape, they called it a cloak

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats! On Tue, Apr 14, 2015 at 8:46 PM, Lefty Leverenz wrote: > Congrats Mithun -- when they gave me the cape, they called it a cloak of > invisibility. But the only thing it makes invisible is itself. Maybe I > should open a jira > > -- Lefty > > On Tue, Apr 14, 2015 at 9:03 PM, Xu, Ch

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun -- when they gave me the cape, they called it a cloak of invisibility. But the only thing it makes invisible is itself. Maybe I should open a jira -- Lefty On Tue, Apr 14, 2015 at 9:03 PM, Xu, Cheng A wrote: > Congrats Mithun! > > > > *From:* Gunther Hagleitner [mailto:gh

Re: partition and bucket

+1 quite well explained. liked it much regards Dev On Mon, Apr 13, 2015 at 1:34 AM, Mich Talebzadeh wrote: > Hi, > > > > I will try to have a go at your points but I am sure there are many > experts around. > > > > As you may know already in RDBMS partitioning (dividing a very large table > int

RE: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun! From: Gunther Hagleitner [mailto:ghagleit...@hortonworks.com] Sent: Wednesday, April 15, 2015 8:10 AM To: d...@hive.apache.org; Chris Drome; user@hive.apache.org Cc: mit...@apache.org Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan Congrats Mithun! Thanks,

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Thank you, chaps. :] One is happy to contribute. This is an honour, and more than a little daunting. Many thanks, Mithun P.S. Where do I pick up my cape? I was told there were capes... On Tue, Apr 14, 2015 at 5:10 PM Gunther Hagleitner < ghagleit...@hortonworks.com> wrote: > Congrats Mithun!

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun! Thanks, Gunther. From: Chao Sun Sent: Tuesday, April 14, 2015 3:48 PM To: d...@hive.apache.org; Chris Drome Cc: user@hive.apache.org; mit...@apache.org Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan Congrats Mithun! On Tue,

Re: Default schema

For the following I suggested: "…or setting param file (like hive-env.sh, hiverc or hive-site.xml…)?" I don't know what property or variable to set up? Would you provide an example excerpt? Thank you, Kind Regards ~Maciek On Tue, Apr 14, 2015 at 10:43 PM, Bala Krishna Gangisetty < b...@altiscal

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun! On Tue, Apr 14, 2015 at 3:29 PM, Chris Drome wrote: > Congratulations Mithun! > > > > On Tuesday, April 14, 2015 2:57 PM, Carl Steinbach > wrote: > > > The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on > the Apache Hive Project. > Please join me in

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congratulations Mithun! On Tuesday, April 14, 2015 2:57 PM, Carl Steinbach wrote: The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on the Apache Hive Project.  Please join me in congratulating Mithun. Thanks. - Carl

Re: External Table with unclosed orc files.

IIRC the HW Trucking Demo creates a temporary table from csv files of the new data then issues a select … insert into an orc table. For the love of google, I can’t find this demo atm, and I’m out of time. If I recall correctly, this strikes me as suboptimal compared to writing orc files directly

Re: External Table with unclosed orc files.

Submitting patches or test cases is tricky business for a Cisco employee. I’ll put in the legal admin effort to get approval to do this. :/ The majority of the issues I mentioned /should/ find their way to apache via hortonworks. Additional responses are inline. On 4/14/15, 5:28 PM, "Gop

[ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on the Apache Hive Project. Please join me in congratulating Mithun. Thanks. - Carl

Re: Default schema

You can also specify it in "*.hiverc*" file. .hiverc is executed automatically when Hive CLI is launched. The file can be located at "$HIVE_CONF_DIR/.hiverc", or "$HOME/.hiverc". It may vary based on distribution you're on. The below 2 Hive JIRAs can provide more details. HIVE-1414

Re: External Table with unclosed orc files.

The remainder of my ranting paragraph is intended as an expansion on that comment. Sorry, I wasn’t clear. Grant Overby Software Engineer Cisco.com grove...@cisco.com Mobile: 865 724 4910 Think before you print.This email may contain confidential and privileged materia

Re: External Table with unclosed orc files.

unsubscribe On Tue, Apr 14, 2015 at 4:28 PM, Gopal Vijayaraghavan wrote: > > >0.14 . Acid tables have been a real pain for us. We don¹t believe they are > >production ready. At least in our use cases, Tez crashes for assorted > >reasons or only assigns 1 mapper to the partition. Having delta fil

Re: External Table with unclosed orc files.

>0.14 . Acid tables have been a real pain for us. We don¹t believe they are >production ready. At least in our use cases, Tez crashes for assorted >reasons or only assigns 1 mapper to the partition. Having delta files and >no base files borks mapper assignments. Some of the chicken-egg problems f

Re: Default schema

Thought about that but not sure if it's the most suitable one Would you mind sharing those other ways? Thanks! On Tue, Apr 14, 2015 at 9:49 PM, Bala Krishna Gangisetty wrote: > Yes, certainly. There are couple of ways to do this. > > One such way is to define an alias for "hive --database > **"

RE: External Table with unclosed orc files.

Hi Grant, Thanks for insight. You mentioned and I quote " Acid tables have been a real pain for us. We don’t believe they are production ready.. " Can you please elaborate on this/ Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books "A Practitioner’s Guide to Upgr

Re: External Table with unclosed orc files.

Thanks for the link to the hive streaming bolt. We rolled our own bolt many moons ago to utilize hive streaming. We’ve tried it against 0.13 and 0.14 . Acid tables have been a real pain for us. We don’t believe they are production ready. At least in our use cases, Tez crashes for assorted reasons o

Re: Default schema

Yes, certainly. There are couple of ways to do this. One such way is to define an alias for "hive --database **" --Bala G. On Tue, Apr 14, 2015 at 1:30 PM, Maciek wrote: > Is it possible to customize the schema user logs on to? > I was thinking of setting some bash environment variable > or se

Default schema

Is it possible to customize the schema user logs on to? I was thinking of setting some bash environment variable or setting param file (like hive-env.sh, hiverc or hive-site.xml…)?

Re: External Table with unclosed orc files.

> What will Hive do if querying an external table containing orc files >that are still being written to? Doing that directly won¹t work at all. Because ORC files are only readable after the Footer is written out, which won¹t be for any open files. > I won¹t be able to test these scenarios till t

Re: External Table with unclosed orc files.

It will fail. Orc writes info in the footers that are required to properly read the file. If close hasn't been called, then that footer hasn't been written yet. Alan. Grant Overby (groverby) April 14, 2015 at 20:46 What will Hive do if querying an external table

RE: External Table with unclosed orc files.

Hi, I believe in the same way as UNIX file/partitions behave. If the file is opened by the first process writing to it, a swap file will be created. If the second process is querying it only, then it will see the data at the time of last save by the first process but not the changes after l

External Table with unclosed orc files.

What will Hive do if querying an external table containing orc files that are still being written to? If the process writing the orc files exits without calling .close()? Sorry for taking the cheap way out and asking instead of testing. I couldn’t find anything on this via google. I won’t be a

Re: [Hive] Slow Loading Data Process with Parquet over 30k Partitions

That is too many partitions. Way to much overhead in anything that has that many partitions. On Tue, Apr 14, 2015 at 12:53 PM, Tianqi Tong wrote: > Hi Slava and Ferdinand, > > Thanks for the reply! Later when I was looking at the hive.log, I found > Hive was indeed calculating the partition sta

RE: [Hive] Slow Loading Data Process with Parquet over 30k Partitions

Hi Slava and Ferdinand, Thanks for the reply! Later when I was looking at the hive.log, I found Hive was indeed calculating the partition stats, and the log looks like: …. 2015-04-14 09:38:21,146 WARN [main]: hive.log (MetaStoreUtils.java:updatePartitionStatsFast(296)) - Updating partition stats

Re: partition and bucket

Thank you sir. Much appreciated On Sunday, 12 April 2015, 21:05, Mich Talebzadeh wrote: #yiv0994893552 #yiv0994893552 -- _filtered #yiv0994893552 {panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv0994893552 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv0994893552