Re: Using partition evolution in code

2019-10-30 Thread Ryan Blue
Sorry for the late reply. There is no public API for updating a table's partition spec right now. Tables can handle multiple specs, but you would have to use an approach like Thippana suggested. We also have a few internal things that we need to fix to avoid collisions in metadata tables. Right n

Re: Using partition evolution in code

2019-10-25 Thread Thippana Vamsi Kalyan
One approach is to extend BaseTable and HadoopTableOperations classes. public static class IcebergTable extends BaseTable { private final IcebergTableOperations ops; private IcebergTable(IcebergTableOperations ops, String name) { super(ops, name); this.ops = ops; } IcebergTableO

Using partition evolution in code

2019-10-25 Thread Christine Mathiesen
Hey Iceberg devs! I've been following along the discussion about how the partition spec evolution in Iceberg works, and recently I've been trying to implement this in some code I've been writing. However, I've been trying to implement it using the HadoopTables API and haven't been able to figure