Thanks @ Robert! @Fabian @Jack do you think the PRs are good to merged. I think we should try to merge these two PRs today.
Best, SunJincheng 2017-06-19 20:56 GMT+08:00 Robert Metzger <rmetz...@apache.org>: > Thanks everybody for the testing of the RC1! > > I'm hereby cancelling the first RC due to a critical bug in the serializer > stack, reported by Till. > > I'll create the next RC once the fix is in. > > On Mon, Jun 19, 2017 at 2:20 PM, Tzu-Li (Gordon) Tai <tzuli...@apache.org> > wrote: > > > I looked at the changes in the PRs [1, 2]. > > I agree that it would be better to include the fixes in 1.3.1. > > > > If we agree to cancel RC1 for RC2 (with shorter voting period), I’ll > start > > massaging the PRs to be merged for 1.3.1 (currently the changes in the > PRs > > are targeted for 1.3.2). > > They should be ready before tomorrow, so that we can start RC2 soon. > > > > > > On 19 June 2017 at 8:06:11 PM, Robert Metzger (rmetz...@apache.org) > wrote: > > > > If we really have to introduce a special path in the serializer config > for > > 1.3.1 to 1.3.2, then I would indeed suggest to cancel the RC1. > > > > If only this one commit is different between RC1 and RC2, we can do a > > reduced voting period for RC2. > > > > On Mon, Jun 19, 2017 at 2:02 PM, Till Rohrmann <trohrm...@apache.org> > > wrote: > > > > > I think this actually not true, since in 1.3.0 the field > `enumConstants` > > in > > > `ScalaEnumSerializerConfigSnapshot` was always serialized as `null`. > > Thus, > > > due to this we wouldn't have to bump the format if we included > FLINK-6948 > > > in 1.3.1. If this weren't the case, we would have to bump it also for > > 1.3.1 > > > (excluding FLINK-6948). > > > > > > Cheers, > > > Till > > > > > > On Mon, Jun 19, 2017 at 1:39 PM, Tzu-Li (Gordon) Tai < > > tzuli...@apache.org> > > > wrote: > > > > > > > No, I meant that if we include FLINK-6921 / FLINK-6948 in 1.3.1, we > > also > > > > still need to bump the version due to changes in FLINK-6948. > > > > So, that the version needs to be bumped would not be a reason to > block > > > > 1.3.1 on it, because we have to do it either way. > > > > > > > > On 19 June 2017 at 7:33:25 PM, Till Rohrmann (trohrm...@apache.org) > > > wrote: > > > > > > > > Do you mean that we have to bump the version also without including > > > > FLINK-6921 and FLINK-6948? Wouldn't that be a release blocker then? > > > > > > > > I think that we actually introduced FLINK-6921 with [1]. Thus, the > > > > `ArrayIndexOutOfBoundsException` is specific to this release. > > However, I > > > > agree that the serializer was broken before as well, however, in a > > > > different way. > > > > > > > > [1] > > > > https://github.com/apache/flink/commit/ > 5281dd6598f17c8dfe0c7b091c90c8 > > > > 721d305375 > > > > > > > > Cheers, > > > > Till > > > > > > > > On Mon, Jun 19, 2017 at 1:22 PM, Tzu-Li (Gordon) Tai < > > > tzuli...@apache.org> > > > > wrote: > > > > > > > > > The ScalaEnumSerializerConfigSnapshot would need a version bump > > > > > regardless of whether or not the fixes are included in 1.3.1. > > > > > In other words, we still need to bump the version if we include it > > for > > > > > 1.3.1. > > > > > > > > > > I’m not against including FLINK-6921 and FLINK-6948 in for 1.3.1, > but > > > > then > > > > > as usual the argument would be that the problem had always been > there > > > and > > > > > is not specific to this release. > > > > > I’m personally usually favorable of delaying the release a bit more > > to > > > > get > > > > > fixes for issues we know of in. > > > > > > > > > > I’ll look at the PRs for FLINK-6921 and FLINK-6948 now, and merge > > them > > > > > soon. We could probably have a RC2 with a shorter vote duration? > > > > > > > > > > Best, > > > > > Gordon > > > > > > > > > > On 19 June 2017 at 7:10:11 PM, Till Rohrmann (trohrm...@apache.org > ) > > > > wrote: > > > > > > > > > > I think the EnumValueSerializer [1, 2] is broken in the current RC. > > > This > > > > > basically means that Flink programs won’t properly notice that > state > > > > > migration is required and or fail with obscure exceptions at > > migration > > > > > check or runtime. > > > > > > > > > > This definitely will be enough reason for another bug fix release > if > > we > > > > > don’t want to include fixes in 1.3.1. If we include the fixes in > > 1.3.2, > > > > > then this will require a version bump for the > > > > > ScalaEnumSerializerConfigSnapshot because we have to change the > > > format. > > > > > This also entails code for backwards compatibility. > > > > > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-6921 > > > > > [2] https://issues.apache.org/jira/browse/FLINK-6948 > > > > > > > > > > Cheers, > > > > > Till > > > > > > > > > > > > > > > On Mon, Jun 19, 2017 at 10:34 AM, Dawid Wysakowicz < > > > > > wysakowicz.da...@gmail.com> wrote: > > > > > > > > > > > +1 > > > > > > > > > > > > - built from source (2.10, 2.11) > > > > > > - checked aggregate function with AggregateFunction return type > > > > different > > > > > > than stream type > > > > > > > > > > > > Z pozdrowieniami! / Cheers! > > > > > > > > > > > > Dawid Wysakowicz > > > > > > > > > > > > *Data/Software Engineer* > > > > > > > > > > > > Skype: dawid_wys | Twitter: @OneMoreCoder > > > > > > > > > > > > <http://getindata.com/> > > > > > > > > > > > > 2017-06-19 7:15 GMT+02:00 Tzu-Li (Gordon) Tai < > tzuli...@apache.org > > >: > > > > > > > > > > > > > +1 > > > > > > > > > > > > > > Tested the following blockers of 1.3.1: > > > > > > > > > > > > > > Serializers & checkpointing > > > > > > > - Verified Scala jobs using Scala types as state (Scala > > > collections, > > > > > case > > > > > > > classes, Either, Try, etc.) can restore from savepoints taken > > with > > > > > Flink > > > > > > > 1.2.1 & 1.3.1. Tested with Scala 2.10 & 2.11. > > > > > > > - Tested restore of POJO types as state, behavior & error > > messages > > > > for > > > > > > > changed POJO types consistent across different state backends > > > > > > > - Tested stream join with checkpointing enabled > > > > > > > - Sharing static state descriptor (w/ stateful KryoSerializer) > > > across > > > > > > > tasks did not reveal any issues > > > > > > > > > > > > > > Elasticsearch connector > > > > > > > - ES 5 connector artifacts exists in staging repo > > > > > > > - Tested cluster execution with ES sink (2.3.5, 2.4.1, 5.1.2), > no > > > > > > > dependency conflicts, successful > > > > > > > > > > > > > > Flink CEP > > > > > > > - Out-of-order matched events is now resolved > > > > > > > > > > > > > > - Ran local build + test on MacOS (-Dscala-2.10, -Dscala-2.11), > > > > > > successful > > > > > > > - LICENSES untouched since 1.3.0 > > > > > > > - No new dependencies > > > > > > > > > > > > > > Best, > > > > > > > Gordon > > > > > > > > > > > > > > On 14 June 2017 at 10:14:39 PM, Robert Metzger ( > > > rmetz...@apache.org) > > > > > > > wrote: > > > > > > > > > > > > > > Dear Flink community, > > > > > > > > > > > > > > Please vote on releasing the following candidate as Apache > Flink > > > > > version > > > > > > > 1.3.1. > > > > > > > > > > > > > > The commit to be voted on: > > > > > > > http://git-wip-us.apache.org/repos/asf/flink/commit/7cfe62b9 > > > > > > > > > > > > > > Branch: > > > > > > > release-1.3.1-rc1 > > > > > > > > > > > > > > The release artifacts to be voted on can be found at: > > > > > > > *http://people.apache.org/~rmetzger/flink-1.3.1-rc1/ > > > > > > > <http://people.apache.org/~rmetzger/flink-1.3.1-rc1/>* > > > > > > > > > > > > > > The release artifacts are signed with the key with fingerprint > > > > > D9839159: > > > > > > > http://www.apache.org/dist/flink/KEYS > > > > > > > > > > > > > > The staging repository for this release can be found at: > > > > > > > https://repository.apache.org/content/repositories/ > > > > orgapacheflink-1124 > > > > > > > > > > > > > > > > > > > > > ------------------------------------------------------------- > > > > > > > > > > > > > > > > > > > > > The vote ends on Monday (5pm CEST), June 19rd, 2016. > > > > > > > > > > > > > > [ ] +1 Release this package as Apache Flink 1.3.1 > > > > > > > [ ] -1 Do not release this package, because ... > > > > > > > > > > > > > > > > > > > > > > > > > > > >