I think I found the root cause of the issue: Although initially the table
is created as a TestTable, when setting up the task writer in the Flink
test (in TestDeltaTaskWriter) the table is turned into a SerializableTable.
This doesn't look correct to me because the metadataLocation will always be
n
Switching to HadoopTables wouldn't hurt, although if you're having trouble
with TestTables, then it could easily be that the state of the helper is
being cleared. I think you're probably better off trying to figure out why
the table is missing or was deleted, rather than switching.
On Fri, Feb 24,
Hi Ryan,
Thanks for the reply. I'm working on some new features in the Flink
connector
and the changes caused a lot of tests to fail (for example
in TestDeltaTaskWriter)
because these test classes use TestTables. As you said that this is an
internal
helper class, I assume the Flink connector shoul