I have tried to persist Generic Avro records in a parquet file and then read it via ParquetTablesource – using SQL. Seems that the SQL I not executed properly !
The persisted records are : Id , type 3333333,Type1 222222,Type2 3333333,Type1 222222,Type2 3333333,Type1 222222,Type2 3333333,Type1 222222,Type2 3333333,Type1 222222,Type2 3333333,Type1 222222,Type2 While SQL of SELECT id ,recordType_ FROM ParquetTable - return the above ( which is correct) Running : "SELECT id ,recordType_ FROM ParquetTable where recordType_='Type1' " Will result in : 3333333,Type1 222222,Type1 3333333,Type1 222222,Type1 3333333,Type1 222222,Type1 3333333,Type1 222222,Type1 3333333,Type1 222222,Type1 3333333,Type1 222222,Type1 As if the equal sign is assignment and not equal … am I doing something wrong ? is it an issue of Generic record vs SpecificRecords ?
