Re: How to remove an Iceberg partition that only contains parquet files with 0 record

2023-06-29 Thread Manu Zhang
You may try following SQL which is supported by Spark alter table identifier drop partition(partition_col_name=partition_col_value) Pucheng Yang 于2023年6月30日 周五11:13写道: > Iceberg version: 1.3.0 > Spark version: 3.2.1 > > Hi community, > > I have an interesting situation where I migrated a Hive t

How to remove an Iceberg partition that only contains parquet files with 0 record

2023-06-29 Thread Pucheng Yang
Iceberg version: 1.3.0 Spark version: 3.2.1 Hi community, I have an interesting situation where I migrated a Hive table to Iceberg and this original Hive table has a partition containing parquet files without any record. The delete statement can not get rid of this partition, any suggestion on ho

Re: [VOTE] Release PyIceberg 0.4.0 RC2

2023-06-29 Thread Eduard Tudenhoefner
+1 (non-binding) Verified sigs/sums/license/test. Eduard On Thu, Jun 29, 2023 at 3:34 AM Jonas Jiang wrote: > +1 (non-binding) > > Verified signature, checksum, license. > > Ran test, test-coverage, and some checks for conversion from parquet > schema to iceberg schema. > > Best regards, > Jo