[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-07-03 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 cc @dawidwys ---

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-30 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 cc @dawidwys introduced `MemoryUnit` and refactor `MemorySize`, please review~ ---

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-20 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 cc @dawidwys the third suggestion has finished, the others has supported before. can you review this? ---

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-18 Thread dawidwys
Github user dawidwys commented on the issue: https://github.com/apache/flink/pull/5448 Hi @yanghua, I am afraid Stephan won't be able to reply any time soon. I would suggest to - add the default unit to the parse method of `MemorySize` and use MB for `MANAGED_MEMORY

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-10 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 @StephanEwen any opinion about this PR? ---

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-05 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5448 There is no problem reusing old keys, if their default unit was "bytes", because the `MemorySize.parse(...)` interprets a number as bytes, if there is no unit attached to it. I did not r

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-05 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 @StephanEwen for the `taskmanager.memory.segment-size` because of it's default unit is `byte`, so whether there is a unit or not, the behavior is consistent. So we just need to handle `t

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-05 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 @StephanEwen for the open question, this PR's implementation has used some new key and deprecated the old key, such as `jobmanager.heap.mb -> jobmanager.heap.size` , `taskmanager.heap.mb -> taskmanag

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-06-04 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5448 Okay, after taking a look, I think we need to add a few changes: - We need to add an additional `MemoryUnit.parse()` method that takes the "default" unit, so that we parse the old heap

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-05-30 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5448 Will try and take a look at this soon... Sorry for the delay. What I would consider very important is that users who don't change their configuration do not get different behavior all of

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-05-28 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 hi @dawidwys thanks for your review suggestion, I have refactored the PR code except the `MANAGED_MEMORY_SIZE `. The problem you concerned is exists, the key is suitable for this PR, and it seems we

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-05-28 Thread dawidwys
Github user dawidwys commented on the issue: https://github.com/apache/flink/pull/5448 Hi @yanghua I think those changes look overall good. The biggest concern I had with handling `MANAGED_MEMORY_SIZE` as I think if used with old style configuration file, the resulting value will

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-05-26 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 cc @dawidwys and @StephanEwen , I have fixed the conflicts and some issues in new files, please review it. ---

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-05-25 Thread dawidwys
Github user dawidwys commented on the issue: https://github.com/apache/flink/pull/5448 @yanghua Could you rebase this PR on top of the master? I could have a look then. Thanks! ---

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-02-12 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5448 Thanks, I think this is a really nice change! Given that we are approaching feature freeze for 1.5 and already have a very big backlog, I would try and get to this for the 1.6 release. Ho

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

2018-02-11 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 Hi @StephanEwen , with the help of your `MemorySize` (sub task of FLINK-6469),I finished the remained work, replaced the old memory config (in code、config file and shell script) with the memory s