Re: HIVE Server multiple instances

2011-05-04 Thread V.Senthil Kumar
have similar problems (but I may have got >>>that wrong :) >>> >>> >>> On 3 May 2011, at 18:59, Matthew Rathbone wrote: >>> >>>> Even if it is single threaded it certainly seems to support multiple >>>>connections. >>>&

Re: HIVE Server multiple instances

2011-05-03 Thread V.Senthil Kumar
per worker). > > > > Hope that helps > > > > Matthew > > On Tuesday, May 3, 2011 at 1:40 PM, V.Senthil Kumar wrote: > > Thanks Matthew. The wiki page http://wiki.apache.org/hadoop/Hive/HiveServer >says > > > > its single threaded. I have

Re: HIVE Server multiple instances

2011-05-03 Thread V.Senthil Kumar
. We run 5 workers all connected at the same time executing a different query each ( with a different connection per worker). Hope that helps Matthew On Tuesday, May 3, 2011 at 1:40 PM, V.Senthil Kumar wrote: Thanks Matthew. The wiki page http://wiki.apache.org/hadoop/Hive/HiveServer says

Re: HIVE Server multiple instances

2011-05-03 Thread V.Senthil Kumar
wo? I think it is multithreaded, so you can query it from two different connections -- Matthew Rathbone Foursquare | Software Engineer | Server Engineering Team matt...@foursquare.com | @rathboma | 4sq On Monday, May 2, 2011 at 6:41 PM, V.Senthil Kumar wrote: Hello, > > I have one insta

HIVE Server multiple instances

2011-05-02 Thread V.Senthil Kumar
Hello, I have one instance of HIVE JDBC server running on port 1. Can I run another instance on different port ? Would it cause a concurrency issue on the underlying data warehouse files ? Please clarify. Thanks, V.Senthil Kumar

Re: How to configure Hive to use CombineFileInputFormat in case of too many small files

2011-04-08 Thread V.Senthil Kumar
You can add these lines in hive-site.xml. It creates only one file at the end. Hope it helps. hive.merge.mapredfiles true Merge small files at the end of a map-reduce job hive.input.format org.apache.hadoop.hive.ql.io.CombineHiveInputFormat The default input format, if it is not s

Re: INSERT OVERWRITE LOCAL DIRECTORY -- Why it creates multiple files

2011-03-30 Thread V.Senthil Kumar
LOCAL DIRECTORY -- Why it creates multiple files try add limit: INSERT OVERWRITE LOCAL DIRECTORY '/home/hdp-user/hiveadmin_dirs/outbox/apachetest' Select host, identity, user, time, request from raw_apachelog where ds = '2011-03-22-001500' limit 32; 2011/3/30 V.Senthil Ku

INSERT OVERWRITE LOCAL DIRECTORY -- Why it creates multiple files

2011-03-29 Thread V.Senthil Kumar
Hello, I have a hive query which does a simple select and writes the results to a local file system. For example, a query like this, INSERT OVERWRITE LOCAL DIRECTORY '/home/hdp-user/hiveadmin_dirs/outbox/apachetest' Select host, identity, user, time, request from raw_apachelog where ds