Re: Re: Issue when trying to read from table created using TestTables class

2023-02-24 Thread Tamas Sule
I think I found the root cause of the issue: Although initially the table is created as a TestTable, when setting up the task writer in the Flink test (in TestDeltaTaskWriter) the table is turned into a SerializableTable. This doesn't look correct to me because the metadataLocation will always be n

Re: Re: Issue when trying to read from table created using TestTables class

2023-02-24 Thread Ryan Blue
Switching to HadoopTables wouldn't hurt, although if you're having trouble with TestTables, then it could easily be that the state of the helper is being cleared. I think you're probably better off trying to figure out why the table is missing or was deleted, rather than switching. On Fri, Feb 24,

RE: Re: Issue when trying to read from table created using TestTables class

2023-02-24 Thread Tamas Sule
Hi Ryan, Thanks for the reply. I'm working on some new features in the Flink connector and the changes caused a lot of tests to fail (for example in TestDeltaTaskWriter) because these test classes use TestTables. As you said that this is an internal helper class, I assume the Flink connector shoul