Hi All,
I am trying to append data files to an existing iceberg table in
Athena. I wrote a Java app that uses the Iceberg apis to do this. Attached
below is a sample source code. I do see parquet files being placed on s3
however I cannot read those files in Athena. Am I missing something?
```
//Use glueCatalog and loaded table
Table table =
catalog.loadTable(TableIdentifier.of(Namespace.of("tpc_ds"),"store_sales"));
//created a file appender
FileAppender<Record> appender
=factory.newAppender(S3OutputFile.fromLocation(path,s3Client),
FileFormat.PARQUET);
//Added records to appender
appender.add(record);
//get len and close appender
long fileLen = appender.length();
appender.close();
//get metrics
appender.metrics();
//register datafiles with table
Transaction transaction = table.newTransaction();
//Append data file
AppendFiles appendFiles = transaction.newAppend();
appendFiles.appendFile(DataFiles.builder(spec)
.withMetrics(metrics)
.withPath(location)
.withFormat(FileFormat.PARQUET)
.withRecordCount(metrics.recordCount())
.withFileSizeInBytes(fileLen).
build());
//commit append
appendFiles.commit();
//commit transaction
transaction.commitTransaction();
--program end
```
Regards,
Taher Koitawala