Re: how to store EOL characters in String field?

2011-09-07 Thread Wojciech Langiewicz
Thanks, This is one of the solutions I have in mind, but this requires input to change it's format, it will be very unreadable by human. Another solution I'm considering is to just remove \n from fields and replace them with for example '' or anything. On 07.09.2011 18:55, Travis Powell wrote:

Re: Hive thrift interface and user permissions / user auditing

2011-09-07 Thread Koert Kuipers
ah sorry the user "thrift" that was a typo by me. it actually says ugi=hive in my logs. i missed that the first time you asked. regarding JDBC, i was mainly interested if JDBC would be able to make a connection to a secure cluster at all, and if so yes then my question would be if it uses the cred

RE: how to store EOL characters in String field?

2011-09-07 Thread Travis Powell
RE: line breaks Don't use \n to terminate lines if your fields contain them. Use something else like \002 or \001 ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LINES TERMINATED BY '\002'; ...or something like that. Travis Powell / tpow...@tealeaf.com Tealeaf Technology / http://www.tealeaf.co

Re: Hive thrift interface and user permissions / user auditing

2011-09-07 Thread Ashutosh Chauhan
I assume when you say thrift interface, you mean a separate metastore process running. If so, >> Do i understand it correctly that in the thrift interface does provide a way to communicate the identity but in unsecured mode it is not being used? Yes. Better way to say this is identity is communica

hive zookeeper locks.

2011-09-07 Thread Bennie Schut
I've been trying to play with locks in hive using zookeeper but can't find documentation on how to configure it. I now have: hive.supports.concurrency true hive.zookeeper.quorum localhost But I keep getting errors like this: 11/09/07 15:47:57 ERROR exec.DDLTask: FAILED: Error in metadata:

how to store EOL characters in String field?

2011-09-07 Thread Wojciech Langiewicz
Hello, How can I store EOL characters in Hive in String field? I'm using Hive 0.7 and I couldn't find anything about escaping or enclosing field values. I want to use as field delimiter and lines are terminated by '\n'. That causes issues, because part of text after '\n' is loaded as next line

Loading XML data

2011-09-07 Thread Adriaan Tijsseling
Hi, I'm very new to Hadoop+Hive. I've worked through the Hadoop in Action book and understand the basic principles. However, I've had a hard time finding information on loading xml data into a hive table. CSV and TSV are straightforward, but for XML it seems you either need to write some custom

Re: hi .... any one know how to solv the result run in hive and script hive

2011-09-07 Thread Jasper Knulst
Hi, 2011/9/7 Harold(陳春宏) > Hello: > > I have analysis apache log from hive, but there is a problem > > When I write hive command in Script file and use crontab for schedule it * > *** > > The result is different with run in hive container > > The attachment file is 2 way process

hi .... any one know how to solv the result run in hive and script hive

2011-09-07 Thread 陳春宏
Hello: I have analysis apache log from hive, but there is a problem When I write hive command in Script file and use crontab for schedule it The result is different with run in hive container The attachment file is 2 way process detail Hive_error.txt is run hive command in script Hiv

Re: Custom Serde with thorn

2011-09-07 Thread Jasper Knulst
have you tried? 2011/5/9 Jasper Knulst > Hi Ankit, > > > I got this in my java mapper code > > String oldSeperator = "�"; //the thorn as java sees it > String newSeperator = "~"; > > In Eclipse it shows as �, which is the standard java way of saying "I don't > know this multibyte character". > >

Re: Unique users analysis

2011-09-07 Thread Radek Maciaszek
Hello, In case anyone will be looking for a similar solution in future I put a short blog post on this subject: http://www.dataminelab.com/blog/calculating-unique-visitors-in-hadoop-and-hive/ Best, Radek On 14 January 2011 12:50, Radek Maciaszek wrote: > Hi Itai, > > I did not think about samp