[jira] [Created] (FLINK-9015) Upgrade Calcite dependency to 1.17

2018-03-16 Thread Shuyi Chen (JIRA)
Shuyi Chen created FLINK-9015: - Summary: Upgrade Calcite dependency to 1.17 Key: FLINK-9015 URL: https://issues.apache.org/jira/browse/FLINK-9015 Project: Flink Issue Type: Task Repor

Re: Flip 6 mesos support

2018-03-16 Thread Shuyi Chen
Hi Till, For FLINK-8562, the test is passing now because it's not really checking the right thing. Yes, I can help with the Kerberos integration ticket. Is there an example on how the e2e test should be structured and invoked? Thanks Shuyi On Fri, Mar 16, 2018 at 6:51 AM, Till Rohrmann wrote:

Re: Yarn deployment takes long on some networks

2018-03-16 Thread Gyula Fóra
Hi! Sorry for not following up on this, turned out some ports were blocked by some random firewall change. So no issue on Flinks side. Gyula On Fri, Mar 16, 2018, 17:41 Aljoscha Krettek wrote: > Hi Gyula, > > Is there any news on this? > > @Nico or @Gary you recently also did stuff with YARN, d

[jira] [Created] (FLINK-9014) Adapt BackPressureStatsTracker to work with credit-based flow control

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9014: -- Summary: Adapt BackPressureStatsTracker to work with credit-based flow control Key: FLINK-9014 URL: https://issues.apache.org/jira/browse/FLINK-9014 Project: Flink

Re: Yarn deployment takes long on some networks

2018-03-16 Thread Aljoscha Krettek
Hi Gyula, Is there any news on this? @Nico or @Gary you recently also did stuff with YARN, do you maybe have an idea of what could be going on? Best, Aljoscha > On 21. Nov 2017, at 06:42, Gyula Fóra wrote: > > Hi all! > > Today we started noticing that deploying our jobs took over 3 minutes

[jira] [Created] (FLINK-9013) Document yarn.containers.vcores only being effective when adapting YARN config

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9013: -- Summary: Document yarn.containers.vcores only being effective when adapting YARN config Key: FLINK-9013 URL: https://issues.apache.org/jira/browse/FLINK-9013 Project: Fli

[jira] [Created] (FLINK-9012) Shaded Hadoop S3A end-to-end test failing with S3 bucket in Ireland

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9012: -- Summary: Shaded Hadoop S3A end-to-end test failing with S3 bucket in Ireland Key: FLINK-9012 URL: https://issues.apache.org/jira/browse/FLINK-9012 Project: Flink

[jira] [Created] (FLINK-9011) YarnResourceManager spamming log file at INFO level

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9011: -- Summary: YarnResourceManager spamming log file at INFO level Key: FLINK-9011 URL: https://issues.apache.org/jira/browse/FLINK-9011 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9010) NoResourceAvailableException with FLIP-6

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9010: -- Summary: NoResourceAvailableException with FLIP-6 Key: FLINK-9010 URL: https://issues.apache.org/jira/browse/FLINK-9010 Project: Flink Issue Type: Improvement

[ANNOUNCE] Flink 1.5 release testing effort

2018-03-16 Thread Till Rohrmann
Dear community, as it probably has gone a little bit unnoticed, I wanted to bring up that the Flink community is currently preparing the Flink 1.5 release. The release branch has already been created [1]. Currently, the remaining bugs are being fixed and the release is being tested. I hope that we

Re: Flip 6 mesos support

2018-03-16 Thread Till Rohrmann
Hi Shuyi, thanks for the working on FLINK-8562. Once this issue is fixed, it will automatically be executed on the Flip-6 components. In fact it is already being executed on Flip-6. But what you could help the community with is setting up an automated end-to-end test for the Kerberos integration

Re: [ANNOUNCE] Apache Flink 1.3.3 released

2018-03-16 Thread Stephan Ewen
This release fixed a quite critical bug that could lead to loss of checkpoint state: https://issues.apache.org/jira/browse/FLINK-7783 We recommend all users on Flink 1.3.2 to upgrade to 1.3.3 On Fri, Mar 16, 2018 at 10:31 AM, Till Rohrmann wrote: > Thanks for managing the release Gordon and al

[jira] [Created] (FLINK-9009) Error| You are creating too many HashedWheelTimer instances. HashedWheelTimer is a shared resource that must be reused across the application, so that only a few instanc

2018-03-16 Thread Pankaj (JIRA)
Pankaj created FLINK-9009: - Summary: Error| You are creating too many HashedWheelTimer instances. HashedWheelTimer is a shared resource that must be reused across the application, so that only a few instances are created. Key: FLINK-900

[jira] [Created] (FLINK-9008) End-to-end test: Quickstarts

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9008: Summary: End-to-end test: Quickstarts Key: FLINK-9008 URL: https://issues.apache.org/jira/browse/FLINK-9008 Project: Flink Issue Type: Sub-task Com

[jira] [Created] (FLINK-9007) Cluster test: Kinesis connector

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9007: Summary: Cluster test: Kinesis connector Key: FLINK-9007 URL: https://issues.apache.org/jira/browse/FLINK-9007 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-9006) Cluster test: Run general purpose job with failures with Yarn and per-job mode

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9006: Summary: Cluster test: Run general purpose job with failures with Yarn and per-job mode Key: FLINK-9006 URL: https://issues.apache.org/jira/browse/FLINK-9006 Project:

[jira] [Created] (FLINK-9005) Cluster test: Run general purpose job with failures with Mesos

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9005: Summary: Cluster test: Run general purpose job with failures with Mesos Key: FLINK-9005 URL: https://issues.apache.org/jira/browse/FLINK-9005 Project: Flink

[jira] [Created] (FLINK-9004) Cluster test: Run general purpose job with failures with Yarn session

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9004: Summary: Cluster test: Run general purpose job with failures with Yarn session Key: FLINK-9004 URL: https://issues.apache.org/jira/browse/FLINK-9004 Project: Flink

[jira] [Created] (FLINK-9003) Add operators with input type that goes through custom, stateful serialization

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9003: - Summary: Add operators with input type that goes through custom, stateful serialization Key: FLINK-9003 URL: https://issues.apache.org/jira/browse/FLINK-9003 Projec

[jira] [Created] (FLINK-9002) Add operators with input type that goes through Avro serialization (with schema/generic)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9002: - Summary: Add operators with input type that goes through Avro serialization (with schema/generic) Key: FLINK-9002 URL: https://issues.apache.org/jira/browse/FLINK-9002

[jira] [Created] (FLINK-9001) Add operators with input type that goes through Kryo serialization (registered/generic/custom)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9001: - Summary: Add operators with input type that goes through Kryo serialization (registered/generic/custom) Key: FLINK-9001 URL: https://issues.apache.org/jira/browse/FLINK-9001

[jira] [Created] (FLINK-9000) Add automated cluster framework tests

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9000: Summary: Add automated cluster framework tests Key: FLINK-9000 URL: https://issues.apache.org/jira/browse/FLINK-9000 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-8999) Ensure the job has an operator with operator state.

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8999: - Summary: Ensure the job has an operator with operator state. Key: FLINK-8999 URL: https://issues.apache.org/jira/browse/FLINK-8999 Project: Flink Issue Typ

[jira] [Created] (FLINK-8998) Add user-defined watermark assigner and timestamp extractor to the test job

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8998: - Summary: Add user-defined watermark assigner and timestamp extractor to the test job Key: FLINK-8998 URL: https://issues.apache.org/jira/browse/FLINK-8998 Project:

[jira] [Created] (FLINK-8997) Add sliding window aggregation to the job

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8997: - Summary: Add sliding window aggregation to the job Key: FLINK-8997 URL: https://issues.apache.org/jira/browse/FLINK-8997 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-8996) Include an operator with broadcast and union state

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8996: - Summary: Include an operator with broadcast and union state Key: FLINK-8996 URL: https://issues.apache.org/jira/browse/FLINK-8996 Project: Flink Issue Type

[jira] [Created] (FLINK-8995) Add a test operator with keyed state that uses custom, stateful serializer

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8995: - Summary: Add a test operator with keyed state that uses custom, stateful serializer Key: FLINK-8995 URL: https://issues.apache.org/jira/browse/FLINK-8995 Project: F

[jira] [Created] (FLINK-8994) Add a test operator with keyed state that uses Avro serializer (from schema/by reflection)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8994: - Summary: Add a test operator with keyed state that uses Avro serializer (from schema/by reflection) Key: FLINK-8994 URL: https://issues.apache.org/jira/browse/FLINK-8994

[jira] [Created] (FLINK-8993) Add a test operator with keyed state that uses Kryo serializer (registered/unregistered)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8993: - Summary: Add a test operator with keyed state that uses Kryo serializer (registered/unregistered) Key: FLINK-8993 URL: https://issues.apache.org/jira/browse/FLINK-8993

[jira] [Created] (FLINK-8992) Implement source and operator that validate exactly-once

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8992: - Summary: Implement source and operator that validate exactly-once Key: FLINK-8992 URL: https://issues.apache.org/jira/browse/FLINK-8992 Project: Flink Issu

[jira] [Created] (FLINK-8991) End-to-end test: Ganglia metrics reporter

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8991: Summary: End-to-end test: Ganglia metrics reporter Key: FLINK-8991 URL: https://issues.apache.org/jira/browse/FLINK-8991 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8990) End-to-end test: Dynamic Kafka partition discovery

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8990: Summary: End-to-end test: Dynamic Kafka partition discovery Key: FLINK-8990 URL: https://issues.apache.org/jira/browse/FLINK-8990 Project: Flink Issue Type:

[jira] [Created] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8989: Summary: End-to-end test: ElasticSearch connector Key: FLINK-8989 URL: https://issues.apache.org/jira/browse/FLINK-8989 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8988) End-to-end test: Cassandra connector

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8988: Summary: End-to-end test: Cassandra connector Key: FLINK-8988 URL: https://issues.apache.org/jira/browse/FLINK-8988 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8987) End-to-end test: Avro state evolution

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8987: Summary: End-to-end test: Avro state evolution Key: FLINK-8987 URL: https://issues.apache.org/jira/browse/FLINK-8987 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8986) End-to-end test: REST

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8986: Summary: End-to-end test: REST Key: FLINK-8986 URL: https://issues.apache.org/jira/browse/FLINK-8986 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-8985) End-to-end test: CLI

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8985: Summary: End-to-end test: CLI Key: FLINK-8985 URL: https://issues.apache.org/jira/browse/FLINK-8985 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-8984) Disabling credit based flow control deadlocks Flink on checkpoint

2018-03-16 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-8984: - Summary: Disabling credit based flow control deadlocks Flink on checkpoint Key: FLINK-8984 URL: https://issues.apache.org/jira/browse/FLINK-8984 Project: Flink

[jira] [Created] (FLINK-8983) End-to-end test: Confluent schema registry

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8983: Summary: End-to-end test: Confluent schema registry Key: FLINK-8983 URL: https://issues.apache.org/jira/browse/FLINK-8983 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8982) End-to-end test: Queryable state

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8982: Summary: End-to-end test: Queryable state Key: FLINK-8982 URL: https://issues.apache.org/jira/browse/FLINK-8982 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8981) End-to-end test: Kerberos security

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8981: Summary: End-to-end test: Kerberos security Key: FLINK-8981 URL: https://issues.apache.org/jira/browse/FLINK-8981 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8980) End-to-end test: BucketingSink

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8980: Summary: End-to-end test: BucketingSink Key: FLINK-8980 URL: https://issues.apache.org/jira/browse/FLINK-8980 Project: Flink Issue Type: Sub-task C

[jira] [Created] (FLINK-8979) Extend Kafka end-to-end tests to run with different versions

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8979: Summary: Extend Kafka end-to-end tests to run with different versions Key: FLINK-8979 URL: https://issues.apache.org/jira/browse/FLINK-8979 Project: Flink I

[jira] [Created] (FLINK-8978) End-to-end test: Job upgrade

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8978: Summary: End-to-end test: Job upgrade Key: FLINK-8978 URL: https://issues.apache.org/jira/browse/FLINK-8978 Project: Flink Issue Type: Sub-task Com

[jira] [Created] (FLINK-8977) End-to-end test: Manually resume job after terminal failure

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8977: Summary: End-to-end test: Manually resume job after terminal failure Key: FLINK-8977 URL: https://issues.apache.org/jira/browse/FLINK-8977 Project: Flink Is

[jira] [Created] (FLINK-8976) End-to-end test: Resume with different parallelism

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8976: Summary: End-to-end test: Resume with different parallelism Key: FLINK-8976 URL: https://issues.apache.org/jira/browse/FLINK-8976 Project: Flink Issue Type:

[jira] [Created] (FLINK-8975) End-to-end test: Resume from savepoint

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8975: Summary: End-to-end test: Resume from savepoint Key: FLINK-8975 URL: https://issues.apache.org/jira/browse/FLINK-8975 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8974) End-to-end test: Run general purpose DataSet job with failures in standalone mode

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8974: Summary: End-to-end test: Run general purpose DataSet job with failures in standalone mode Key: FLINK-8974 URL: https://issues.apache.org/jira/browse/FLINK-8974 Proje

[jira] [Created] (FLINK-8973) End-to-end test: Run general purpose job with failures in standalone mode

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8973: Summary: End-to-end test: Run general purpose job with failures in standalone mode Key: FLINK-8973 URL: https://issues.apache.org/jira/browse/FLINK-8973 Project: Flin

[jira] [Created] (FLINK-8972) Create general purpose DataSet testing job

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8972: Summary: Create general purpose DataSet testing job Key: FLINK-8972 URL: https://issues.apache.org/jira/browse/FLINK-8972 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-8971) Create general purpose testing job

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8971: Summary: Create general purpose testing job Key: FLINK-8971 URL: https://issues.apache.org/jira/browse/FLINK-8971 Project: Flink Issue Type: Task C

[jira] [Created] (FLINK-8970) Add more automated end-to-end tests

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8970: Summary: Add more automated end-to-end tests Key: FLINK-8970 URL: https://issues.apache.org/jira/browse/FLINK-8970 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Apache Flink 1.3.3 released

2018-03-16 Thread Till Rohrmann
Thanks for managing the release Gordon and also thanks to the community! Cheers, Till On Fri, Mar 16, 2018 at 9:05 AM, Fabian Hueske wrote: > Thanks for managing this release Gordon! > > Cheers, Fabian > > 2018-03-15 21:24 GMT+01:00 Tzu-Li (Gordon) Tai : > >> The Apache Flink community is very

Re: [ANNOUNCE] Apache Flink 1.3.3 released

2018-03-16 Thread Fabian Hueske
Thanks for managing this release Gordon! Cheers, Fabian 2018-03-15 21:24 GMT+01:00 Tzu-Li (Gordon) Tai : > The Apache Flink community is very happy to announce the release of Apache > Flink 1.3.3, which is the third bugfix release for the Apache Flink 1.3 > series. > > Apache Flink® is an open-s