Congratulations! Well done :)
cheers,
ALex
On Aug 10, 2012, at 11:58 AM, John Sichi wrote:
> The Apache Hive PMC has passed a vote to make Navis Ryu a new
> committer on the project.
>
> JIRA is currently down, so I can't send out a link with his
> contribution list at the moment, but if you
https://cwiki.apache.org/Hive/languagemanual-udf.html#LanguageManualUDF-DateFunctions
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
On Jun 26, 2012, at 2:05 AM, sonia gehlot wrote:
> Hi All,
>
> A simple question on dates, how can I con
Hi,
try to use _ instead -
UA_Platform STRING,
and so on.
- Alex
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
On May 31, 2012, at 5:35 PM, Alex Barrera wrote:
> Hi there,
>
> I'm looking for help with the following error: I keep r
For our german speaking folks,
we want to start a Hadoop-BI Usergroup in Stuttgart (Germany), if you have
interest in please visit our LinkedIn Group
(http://www.linkedin.com/groups/Hadoop-Germany-4325443) and our Doodle poll
(http://www.doodle.com/aqwsg4snbwimrsfc). If we figure out a real int
> Business Solutions
> Outsourcing
> ____________
>
> -alo alt wrote: -
> To: user@hive.apache.org
> From: alo alt
> Date: 05/23/2012 03:25PM
> Subject: Re:
>
> Ah, 24 mappers are really high. Did you tried to use only one mapper?
>
> --
> Alexander Alt
...@tcs.com
> Website: http://www.tcs.com
>
> Experience certainty. IT Services
> Business Solutions
> Outsourcing
> ____________
>
> -alo alt wrote: -
> To: user@hive.apache.org
>
ncy Services
> Mailto: debarshi.ba...@tcs.com
> Website: http://www.tcs.com
>
> Experience certainty. IT Services
> Business Solutions
> Outsourcing
> ________
>
> -alo alt wrote: -
&g
Hi,
http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html#Memory+management
This message means that for some reason the garbage collector is taking an
excessive amount of time (by default 98% of all CPU time of the process) and
recovers very little memory in each run (by default 2%
Folks,
for our German / Switzerland / Austria people:
Thu, May 24 NoSQL Meetup in Munich, Bavaria, Germany:
http://www.nosqlmunich.de/
eCircle GmbH
Nymphenburger Höfe NY II
Dachauer Str. 63
80335 München
register here: http://www.doodle.com/7e5a6ecizinaznbu
Entry free
Speaker:
Doug (Hypertable
You have to use fb303 and libthrift jars, and putting them into the classpath
or export them.
- Alex
--
Alexander Lorenz
http://mapredit.blogspot.com
On Apr 26, 2012, at 8:14 AM, Bhavesh Shah wrote:
> Hello all,
> I have written this small program But I am getting error.
>
> Program:
> -
HI,
we've setup few days ago a German UG:
http://mapredit.blogspot.com/2012/03/hadoop-ug-germany.html
Deutsch / german:
Wir haben eine UHG gegruendet, erstmal Gruppen in XING / LinkedIn und eine
Website, die aber wirklich recht neu ist :) Wenn Du mitmachen willst, melden!
Danke und bis bald,
-
o be half an hour, then at the end of hour, it
> may still cause the data delivery latency problem.
>
> this seems not a very good solution, am I making some mistakes or
> misunderstanding here?
>
> thank you very much!
>
>
>
>
>
> 2012/2/7 alo alt
> H
Btw, welcome on the list, JC!
:)
--
Alexander Lorenz
http://mapredit.blogspot.com
On Feb 7, 2012, at 10:57 AM, Jean-Charles Thomas wrote:
> Hi,
>
> thanks for the replies, I get it now to work, the jar file was not correctly
> done.
> Now it works like a charm.
>
> Regards,
>
> Jean-Char
Hi,
a first start with flume:
http://mapredit.blogspot.com/2011/10/centralized-logfile-management-across.html
Facebook's scribe could also be work for you.
- Alex
--
Alexander Lorenz
http://mapredit.blogspot.com
On Feb 7, 2012, at 11:03 AM, Xiaobin She wrote:
> Hi all,
>
> Sorry if it is not
check the rights in hdfs for the table
hadoop dfs -fsck /path/to/warehouse/dir/table
The table was created with the right of the user guest, so only guest can write
in.
- Alex
--
Alexander Lorenz
http://mapredit.blogspot.com
On Feb 3, 2012, at 8:58 AM, Manish.Bhoge wrote:
> Thanks Mark,
>
0.80
>
> thx
>
>
> 2012/2/1 alo alt
> Hi,
>
> + hdfs-user (bcc'd)
>
> which jre version u use?
>
> - Alex
>
> --
> Alexander Lorenz
> http://mapredit.blogspot.com
>
> On Feb 1, 2012, at 8:16 AM, Xiaobin She wrote:
>
>
0.80
>
> thx
>
>
> 2012/2/1 alo alt
> Hi,
>
> + hdfs-user (bcc'd)
>
> which jre version u use?
>
> - Alex
>
> --
> Alexander Lorenz
> http://mapredit.blogspot.com
>
> On Feb 1, 2012, at 8:16 AM, Xiaobin She wrote:
>
>
Hi,
+ hdfs-user (bcc'd)
which jre version u use?
- Alex
--
Alexander Lorenz
http://mapredit.blogspot.com
On Feb 1, 2012, at 8:16 AM, Xiaobin She wrote:
> hi ,
>
>
> I'm using hive to do some log analysis, and I have encountered a problem.
>
> My cluster have 3 nodes, one for NameNode/Job
SET hive.exec.compress.output=true;
SET io.seqfile.compression.type=BLOCK;
SET mapred.output.compression.codec = com.hadoop.compression.lzo.LzopCodec;
CREATE EXTERNAL TABLE tmp_hive(domain string,url string) ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t' STORED AS INPUTFORMAT
"com.hadoop.mapre
sounds interesting, but more as a website I didn't found..
- Alex
--
Alexander Lorenz
http://mapredit.blogspot.com
On Jan 26, 2012, at 9:49 AM, Dalia Sobhy wrote:
>
> www.rainstor.com
> Subject: Re: rainstor
> From: swil...@monetate.com
> Date: Wed, 25 Jan 2012 22:14:12 -0500
> To: user@hive
How you described the table? And how do you load them into?
- Alex
--
Alexander Lorenz
http://mapredit.blogspot.com
On Jan 26, 2012, at 11:00 PM, rk vishu wrote:
> Hello All,
>
> I have a mapred job that does transfermation and outputs to a compresses
> SequenceFile (by using org.apache.had
+common user BCC
please post to the correct mailing lists. Added common users.
that mean that some DN daemons not running. FIrst place for that are the logs
of the DNs. What says that?
- Alex
--
Alexander Lorenz
http://mapredit.blogspot.com
On Jan 24, 2012, at 7:55 AM, hadoop hive wrote:
>
Please note:
LOAD DATA LOCAL assumes the data in the given local path (maybe /tmp/data) and
copy the data into hive's warehouse-dir
LOAD DATA /path moves the date from an given path in HDFS into hive's
warehouse-dir
When you want to append data into an table you have to use partitioning.
best,
-0.8?).
>> Check and compare the classpath with the other installation that you have.
>>
>> Thanks,
>> Aniket
>>
>>
>> On Fri, Dec 30, 2011 at 2:01 AM, alo alt wrote:
>>>
>>> Try to disable security.
>>>
>>> - Alex
>&g
Try to disable security.
- Alex
sent from my mobile device
On Fri, Dec 30, 2011 at 10:54 AM, praveenesh kumar wrote:
> How to resolve this thing ?
>
> Thanks,
> Praveenesh
>
>
> On Fri, Dec 30, 2011 at 3:21 PM, alo alt wrote:
>>
>> Hi,
>>
>> I thin
Hi,
I think thats a typo, I was grepping 0.20.2-737 and did not found
Lorg/apache/hadoop/security/UserGroupInformation. Should be
org/apache/hadoop/security/UserGroupInformation. Correct me please if
I wrong.
- Alex
On Fri, Dec 30, 2011 at 10:39 AM, praveenesh kumar wrote:
> Hi,
>
> I am using
Hi,
depends on the memory you configured for hive (xms, xmx).
- Alex
2011/12/14 王锋 :
> when hiveserver is executing sql, it throws an exception:
>
> 2011-12-14 00:40:43,762 Stage-1 map = 90%, reduce = 13%
> 2011-12-14 00:40:45,771 Stage-1 map = 92%, reduce = 13%
> 2011-12-14 00:40:46,777 Stage
Hi,
looks like the user who uses the statement has not the correct rights.
org.apache.hadoop.fs.permission.FsPermission$2.())'
- Alex
On Fri, Dec 16, 2011 at 8:59 AM, jingjung Ng wrote:
> Hi,
>
> I have simple hive select count(*) query,which results in the following
> exception. I am using Clo
generation is large enough ,so each ygc can
> be clean the data.
>
>
> 在 2011-12-12 19:20:35，"王锋" 写道：
>
>
> yes,we using jdk 1. 0.26
>
> [hdfs@d048049 conf]$ java -version
> java version "1.6.0_26"
> Java(TM) SE Runtime Environment (build 1.6.0_26
Argh, increase! sry, to fast typing
2011/12/12 alo alt :
> Did you update your JDK in last time? A java-dev told me that could be
> a issue in JDK _26
> (https://forums.oracle.com/forums/thread.jspa?threadID=2309872), some
> devs report a memory decrease when they use GC - flags. I
mp/hdfs/hive_job_log_hdfs_201112121842_1930999319.txt
>
> Now we have 3 hiveservers and I set the concurrent job num to 4,but the Mem
> still be so large .I'm mad, God
>
> have other suggestions ?
>
> 在 2011-12-12 17:59:52，"alo alt" > 写道：
>>When you start a
7;s stacks .Can it be watched by jobId?
>
> use ps -Lf hiveserverPId| wc -l ,
> the threads num of one hiveserver has 132 theads.
> [root@d048049 logs]# ps -Lf 15511|wc -l
> 132
> [root@d048049 logs]#
>
> every stack size is 10m the mem will be 1320M,1g.
>
> so hive'
When you start a high-load hive query can you watch the stack-traces?
Its possible over the webinterface:
http://jobtracker:50030/stacks
- Alex
2011/12/12 王锋
>
> hiveserver will throw oom after several hours .
>
>
> At 2011-12-12 17:39:21,"alo alt" wrote:
>
&g
what happen when you set xmx=2048m or similar? Did that have any negative
effects for running queries?
2011/12/12 王锋
> I have modify hive jvm args.
> the new args is -Xmx15000m -XX:NewRatio=1 -Xms2000m .
>
> but the memory used by hiveserver is still large.
>
>
>
>
>
> At 2011-12-12 16:20:54,
ing jobs and gc quickly.
>
>
> At 2011-12-12 16:09:05,"alo alt" wrote:
>
> Hi,
>
> see I right you set java with -xmx=15000M? And you set minimum heap size
> (xms) = 15000M?
> Here you give java no chance to use less than 15GB memory, because min
> says 15000M
Hi,
see I right you set java with -xmx=15000M? And you set minimum heap size
(xms) = 15000M?
Here you give java no chance to use less than 15GB memory, because min says
15000M, and max too. I wondering why any java-process have to need 15G of
memory. Could be in large tomcat od jboss environments
u welcome :)
On Fri, Dec 9, 2011 at 9:44 AM, Aditya Singh30
wrote:
> Thanks a lot. It is the very thing I was looking for.. J
>
> ** **
>
> *From:* alo alt [mailto:wget.n...@googlemail.com]
> *Sent:* Friday, December 09, 2011 1:27 PM
> *To:* user@hive.apache.or
Adithya,
Here small articles about:
MS SQL => Sqoop
http://mapredit.blogspot.com/2011/10/sqoop-and-microsoft-sql-server.html
And to use the self-generated classes:
http://mapredit.blogspot.com/2011/10/speedup-sqoop.html
- Alex
On Fri, Dec 9, 2011 at 5:51 AM, wrote:
> Adithya
> The answer is y
: AA] [Location of device: DFW] [User:
> 550393] [user_role: ] [CorelationId: 248] [Component: Crossplane] [Server:
> server01] [Request: seats=5] [Response: yes] [Status: pass] - Entering
> Method = getKey()
>
> How to specify the delimiter, while describing the table?
>
> Tha
Hi,
I hope I understood your question correct - did you describe your table?
Like
"create TABLE YOURTABLE (row1 STRING, row2 STRING, row3 STRING) ROW FORMAT
DELIMITED FIELDS TERMINATED BY 'YOUR TERMINATOR' STORED AS TEXTFILE;"
row* = a name of your descision, Datatype look @documentation.
After
40 matches
Mail list logo
