Taraka Rama Rao Lethavadla created HIVE-26784:
-------------------------------------------------
Summary: Provide an option to skip malformed json entries and
process the rest of the data in case JSON Serde
Key: HIVE-26784
URL: https://issues.apache.org/jira/browse/HIVE-26784
Project: Hive
Issue Type: Improvement
Components: Hive
Reporter: Taraka Rama Rao Lethavadla
We may want to create hive tables on top of audit data generated by ranger (not
only HDFS audit but other services as well) to be able to analyze the same.
Based on this case, some audit records may become corrupt. Improving the hive
built-in json serde to provide an option (in tblproperties and via session
configurations for example) to allow ignoring malformed records (or to provide
empty rows) would assist users achieve this goal without using
third-party/custom serdes,
for example:
#see ignore.malformed.json
[https://aws.amazon.com/premiumsupport/knowledge-center/error-json-athena/#:~:text=you%20can%20ignore%20malformed%20records]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
