Re: Can hive strip '#' comments in input data?

[Edward Capriolo]

2011/4/4 Bjørn Remseth <la3...@gmail.com>:
> Hi guys.
>
> I've got some input data with comment lines starting with '#' and lasting to
> the end of line, like:
>      #this is a comment ....
> Is there a way to make hive ignore these comments when importing data
> into a table?
>
> --
>
>                                                  (Rmz)
>

You can create your own InputFormat or Serde. An easy way:

create table source(string row);
Load your data into source
create table destination as select row from source where substring(row,1)!='#';