We just ran out of time and didn't get a chance to discuss this in the
community sync meeting today. Hence, I am raising the discussion here.

We added JSON parsers for content file and file scan task a year ago [1].
Recently, I just realized the implementation only handles BaseFileScanTask.
It would fail if the FileScanTask is some other implementation (like
StaticDataTask).

Eduard, Anton, and I have been discussing a solution in issue-9597 [2]. We
reached a consensus that we need to define a new `task-type` enum field to
indicate the implementation class/type [3]. For backward compatibility, the
lack of this new `task-type` field should be interpreted as
`base-file-task`.

Since this is a spec change, Anton suggested more visibility. Hence I am
starting this discussion thread.

[1] https://github.com/apache/iceberg/pull/6934
[2] https://github.com/apache/iceberg/issues/9597
[3] https://github.com/apache/iceberg/pull/9728

Reply via email to