hello, I've got a table in Hive(path located to csv formatted files) which is configured to skip the header row using TBLPROPERTIES("skip.header.line.count"="1"). When querying from Hive the header row is not included in the data, but when running the same query via HiveContext I get the header row. "show create table " via the HiveContext confirms that it is aware of the setting. I found a related jira https://issues.apache.org/jira/browse/SPARK-11374 about this problem, it is for spark 1.5.1 and it is closed without fixing. I want to whether this problem will be fixed in spark 2.1?
sunerhan1...@sina.com