Hi, Is there an easier way to do this with a Serde? The data volumes could easily reach multi-terabyte level so it would be nice if Hive could handle this.
Thanks, Michael From: Vikas Parashar [mailto:para.vi...@gmail.com] Sent: 21 October 2015 16:29 To: user@hive.apache.org Subject: Re: Double quotes in csv data Hi Micheal, You can write some python/perl script and can transform the csv. On Wed, Oct 21, 2015 at 8:57 PM, <michael.engl...@nomura.com<mailto:michael.engl...@nomura.com>> wrote: Hi, I have some CSV data which is encompassing each field in double quotes e.g. “hello”, “”, “test”, “aaaa”. I noticed that there is a CSV Serde now available in Hive 0.14. Is it possible to use this to strip the quotes when querying an external Hive table? https://cwiki.apache.org/confluence/display/Hive/CSV+Serde e.g. select * from table limit 5 should return: hello test aaaa This e-mail (including any attachments) is private and confidential, may contain proprietary or privileged information and is intended for the named recipient(s) only. Unintended recipients are strictly prohibited from taking action on the basis of information in this e-mail and must contact the sender immediately, delete this e-mail (and all attachments) and destroy any hard copies. Nomura will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in, this e-mail. If verification is sought please request a hard copy. Any reference to the terms of executed transactions should be treated as preliminary only and subject to formal written confirmation by Nomura. Nomura reserves the right to retain, monitor and intercept e-mail communications through its networks (subject to and in accordance with applicable laws). No confidentiality or privilege is waived or lost by Nomura by any mistransmission of this e-mail. Any reference to "Nomura" is a reference to any entity in the Nomura Holdings, Inc. group. Please read our Electronic Communications Legal Notice which forms part of this e-mail: http://www.Nomura.com/email_disclaimer.htm This e-mail (including any attachments) is private and confidential, may contain proprietary or privileged information and is intended for the named recipient(s) only. Unintended recipients are strictly prohibited from taking action on the basis of information in this e-mail and must contact the sender immediately, delete this e-mail (and all attachments) and destroy any hard copies. Nomura will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in, this e-mail. If verification is sought please request a hard copy. Any reference to the terms of executed transactions should be treated as preliminary only and subject to formal written confirmation by Nomura. Nomura reserves the right to retain, monitor and intercept e-mail communications through its networks (subject to and in accordance with applicable laws). No confidentiality or privilege is waived or lost by Nomura by any mistransmission of this e-mail. Any reference to "Nomura" is a reference to any entity in the Nomura Holdings, Inc. group. Please read our Electronic Communications Legal Notice which forms part of this e-mail: http://www.Nomura.com/email_disclaimer.htm
