hive csv serde is available for all hive versions
https://github.com/ogrodnek/csv-serde
DEFAULT_ESCAPE_CHARACTER \
DEFAULT_QUOTE_CHARACTER "
DEFAULT_SEPARATOR,
add jar path/to/csv-serde.jar; (or put it to hive/hadoop/mr
classpath on all boxes on cluster)
-- you can use custom separ
Hi Furcy,
Thats lot of information.Thanks a lot
On Feb 13, 2015 3:40 PM, "Furcy Pin" wrote:
> Hi Sreeman,
>
> Unfortunately, I don't think that Hive built-in format can currently read
> csv files with fields enclosed in double quotes.
> More generally, for having ingested quite a lot of messy csv
Hi Sreeman,
Unfortunately, I don't think that Hive built-in format can currently read
csv files with fields enclosed in double quotes.
More generally, for having ingested quite a lot of messy csv files myself,
I would recommend you to write a MapReduce (or Spark) job
for cleaning your csv before g
You can use lazy simple serde with ROW FORMAT DELIMITED FIELDS TERMINATED
BY ',' ESCAPED BY '\'. Check the DDL for details
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL
On Thu, Feb 12, 2015 at 8:19 PM, Sreeman wrote:
> Hi All,
>
> How all of you are creating hive/Impala
Hi All,
How all of you are creating hive/Impala table when the CSV file has some
values with COMMA in between. it is like
sree,12345,"payment made,but it is not successful"
I know opencsv serde is there but it is not available in lower versions of
Hive 14.0
