Re: [DISCUSS] 0.9.1 release

2020-08-03 Thread OpenInx
> Does anyone know if we can recover existing data affected by it? In the PR #1271, there are two data types which have correctness bugs: decimal18 and timestampZone. For decimal18, we actually write the correct decimal value, but read it in an incorrect way. saying the decimal(10,3) and value =

Re: [DISCUSS] 0.9.1 release

2020-08-03 Thread Ryan Blue
Yes, we should get #1269 into a patch release as well since it is a correctness bug. Does anyone know if we can recover existing data affected by it? On Mon, Aug 3, 2020 at 11:08 AM Anton Okolnychyi wrote: > I see a few open issues for ORC. Some of them seem critical (like issue > #1269). Do we

Re: [DISCUSS] 0.9.1 release

2020-08-03 Thread Anton Okolnychyi
I see a few open issues for ORC. Some of them seem critical (like issue #1269). Do we want to fix those before the release? Or is ORC support still experimental? - Anton > On 1 Aug 2020, at 20:04, Jungtaek Lim wrote: > > Sure! I just submitted #1285

Re: [DISCUSS] 0.9.1 release

2020-08-01 Thread Jungtaek Lim
Sure! I just submitted #1285 to exclude the refactor. Once #1285 is merged I'll rebase the existing PR to do the refactor. Thanks for the input! On Sun, Aug 2, 2020 at 4:41 AM Ryan Blue wrote: > Thanks, Jungtaek! I agree it would be great to fix that

Re: [DISCUSS] 0.9.1 release

2020-08-01 Thread Ryan Blue
Thanks, Jungtaek! I agree it would be great to fix that problem. I took a quick look at the PR and it is a little big to go into a patch release since it refactors quite a few places to consolidate the list copy. What do you think about making a PR that just fixes the problem with BaseCombinedScanT

Re: [DISCUSS] 0.9.1 release

2020-07-31 Thread Jungtaek Lim
If we still have some more days I think #1280 : "fix serialization issue in BaseCombinedScanTask with Kyro" is a good candidate to be included. The bug affects both Spark and Flink (according to #1279 ). On S

[DISCUSS] 0.9.1 release

2020-07-31 Thread Ryan Blue
Hi everyone, We’ve accumulated a few bug fixes in the last couple of weeks and I think it might make sense to get some of them out in an 0.9.1 release since they make it harder to work with Iceberg. Here are the ones I know about: - #1282 : rewriteN