[jira] [Created] (FLINK-7509) Refactorings to AggregateCodeGenerator

2017-08-24 Thread Jark Wu (JIRA)
Jark Wu created FLINK-7509: -- Summary: Refactorings to AggregateCodeGenerator Key: FLINK-7509 URL: https://issues.apache.org/jira/browse/FLINK-7509 Project: Flink Issue Type: Improvement Co

[jira] [Created] (FLINK-7508) switch FlinkKinesisProducer to use KPL's ThreadingMode to ThreadedPool mode rather than Per_Request mode

2017-08-24 Thread Bowen Li (JIRA)
Bowen Li created FLINK-7508: --- Summary: switch FlinkKinesisProducer to use KPL's ThreadingMode to ThreadedPool mode rather than Per_Request mode Key: FLINK-7508 URL: https://issues.apache.org/jira/browse/FLINK-7508

[jira] [Created] (FLINK-7507) Fence Dispatcher

2017-08-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7507: Summary: Fence Dispatcher Key: FLINK-7507 URL: https://issues.apache.org/jira/browse/FLINK-7507 Project: Flink Issue Type: Sub-task Components: Dis

[jira] [Created] (FLINK-7506) Fence JobMaster

2017-08-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7506: Summary: Fence JobMaster Key: FLINK-7506 URL: https://issues.apache.org/jira/browse/FLINK-7506 Project: Flink Issue Type: Sub-task Components: Dist

[jira] [Created] (FLINK-7505) Use lambdas in suppressed exception idiom

2017-08-24 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7505: - Summary: Use lambdas in suppressed exception idiom Key: FLINK-7505 URL: https://issues.apache.org/jira/browse/FLINK-7505 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-7504) Fence ResourceManager

2017-08-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7504: Summary: Fence ResourceManager Key: FLINK-7504 URL: https://issues.apache.org/jira/browse/FLINK-7504 Project: Flink Issue Type: Sub-task Components

Optional vs Nullable

2017-08-24 Thread Piotr Nowojski
Hi, Since we switched to Java 8, I would like to start a discussion about a deprecating usage of @Nullable parameters and return values in Flink and enforcing strict ban on nulls in those places. I just think that having a very explicit way, enforced by a static type checking mechanism of optio

[jira] [Created] (FLINK-7503) Config options taskmanager.log.path and jobmanager.web.log.path are misleading, if not broken

2017-08-24 Thread Felix Dreissig (JIRA)
Felix Dreissig created FLINK-7503: - Summary: Config options taskmanager.log.path and jobmanager.web.log.path are misleading, if not broken Key: FLINK-7503 URL: https://issues.apache.org/jira/browse/FLINK-7503

[jira] [Created] (FLINK-7502) PrometheusReporter improvements

2017-08-24 Thread Maximilian Bode (JIRA)
Maximilian Bode created FLINK-7502: -- Summary: PrometheusReporter improvements Key: FLINK-7502 URL: https://issues.apache.org/jira/browse/FLINK-7502 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7501) Generalize leader id of RegisteredRpcConnection

2017-08-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7501: Summary: Generalize leader id of RegisteredRpcConnection Key: FLINK-7501 URL: https://issues.apache.org/jira/browse/FLINK-7501 Project: Flink Issue Type: Bug

Re: Support for multiple HDFS

2017-08-24 Thread Vijay Srinivasaraghavan
I think it may not work in scenario where Hadoop security is enabled and each HCFS setup is configured differently, unless if there is a way to isolate the Hadoop configurations used in this case? Regards, Vijay Sent from my iPhone > On Aug 24, 2017, at 2:51 AM, Stephan Ewen wrote: > > Hi! >

[jira] [Created] (FLINK-7500) Set JobMaster leader session id in main thread

2017-08-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7500: Summary: Set JobMaster leader session id in main thread Key: FLINK-7500 URL: https://issues.apache.org/jira/browse/FLINK-7500 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-7499) double buffer release in SpillableSubpartitionView

2017-08-24 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7499: -- Summary: double buffer release in SpillableSubpartitionView Key: FLINK-7499 URL: https://issues.apache.org/jira/browse/FLINK-7499 Project: Flink Issue Type: Bug

Re: Support for multiple HDFS

2017-08-24 Thread Stephan Ewen
Hi! I think it can work if you fully qualify the URIs. For the checkpoint configuration, specify one namenode (in the flink-config.yml or in the constructor of the state backend). Example: statebackend.fs.checkpoint.dir: hdfs://dfsOneNamenode:port/flink/checkpoints For the result (for example

Re: Support for multiple HDFS

2017-08-24 Thread Stefan Richter
Hi, I don’t think that this is currently supported. If you see a use case for this (over creating different root directories for checkpoint data and result data) then I suggest that you open a JIRA issue with a new feature request. Best, Stefan > Am 23.08.2017 um 20:17 schrieb Vijay Srinivasar

[jira] [Created] (FLINK-7498) Bind together state fields of TwoPhaseCommitSinkFunction

2017-08-24 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-7498: - Summary: Bind together state fields of TwoPhaseCommitSinkFunction Key: FLINK-7498 URL: https://issues.apache.org/jira/browse/FLINK-7498 Project: Flink Issu

[jira] [Created] (FLINK-7497) Allow users to add custom user context stored in state in TwoPhaseCommitSinkFunction

2017-08-24 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-7497: - Summary: Allow users to add custom user context stored in state in TwoPhaseCommitSinkFunction Key: FLINK-7497 URL: https://issues.apache.org/jira/browse/FLINK-7497