Thanks, Jungtaek! I agree it would be great to fix that problem. I took a quick look at the PR and it is a little big to go into a patch release since it refactors quite a few places to consolidate the list copy. What do you think about making a PR that just fixes the problem with BaseCombinedScanTask and Kryo, then doing the remainder of the refactor in master?
On Fri, Jul 31, 2020 at 5:29 PM Jungtaek Lim <kabhwan.opensou...@gmail.com> wrote: > If we still have some more days I think #1280 > <https://github.com/apache/iceberg/pull/1280>: "fix serialization issue > in BaseCombinedScanTask with Kyro" is a good candidate to be included. The > bug affects both Spark and Flink (according to #1279 > <https://github.com/apache/iceberg/pull/1279>). > > On Sat, Aug 1, 2020 at 8:04 AM Ryan Blue <b...@apache.org> wrote: > >> Hi everyone, >> >> We’ve accumulated a few bug fixes in the last couple of weeks and I think >> it might make sense to get some of them out in an 0.9.1 release since they >> make it harder to work with Iceberg. Here are the ones I know about: >> >> - #1282 <https://github.com/apache/iceberg/pull/1282>: rewriteNot >> fails for binary and unary predicates >> - #1278 <https://github.com/apache/iceberg/pull/1278>: Bad import >> from commons-compress causes query failures >> - #1251 <https://github.com/apache/iceberg/pull/1251>: Fixes more >> imports from non-Iceberg Guava >> - #1283 <https://github.com/apache/iceberg/pull/1283>: Query >> descriptions fail when IN predicates are pushed >> - #1228 <https://github.com/apache/iceberg/pull/1228>: Data imports >> fail when paths include whitespace >> - #1194 <https://github.com/apache/iceberg/pull/1194>: USING should >> set format when used in a CTAS command >> - #1203 <https://github.com/apache/iceberg/pull/1203>: Table cache >> should not expire >> >> If there are no objections, I’ll get started and create a release branch. >> And please reply if there are other issues you’ve seen that should also be >> included in a patch release. >> >> rb >> -- >> Ryan Blue >> > -- Ryan Blue Software Engineer Netflix
