Re: Parquet schema evolution, column conversion not supported

2018-07-27 Thread Patrick Duin
Replying to myself as I found my issue, I hadn't updated the schema of my partitions correctly, I've only updated the table schema, the error went away when I updated my partitions. All data was query-able old and newly landed data. Op do 26 jul. 2018 om 11:22 schreef Patrick Duin : > > I'm enc

Parquet schema evolution, column conversion not supported

2018-07-26 Thread Patrick Duin
I'm encountering errors in Hive 2.3.2 when reading sets of Parquet files, where the schema has evolved. The error I'm seeing is : Failed with exception java.io.IOException:java.lang.RuntimeException: Hive internal error: conversion of string to arraynot supported yet. My schema has a top-level co