[GitHub] flink pull request: [FLINK-1725]- New Partitioner for better load ...

2015-08-31 Thread anisnasir
Github user anisnasir commented on the pull request: https://github.com/apache/flink/pull/1069#issuecomment-136496310 @tillrohrmann Yes, we can design a system that adapts to the load imbalance and increases the number of partitions per key in real time. However, this comes with few

[GitHub] flink pull request: [FLINK-1725]- New Partitioner for better load ...

2015-08-28 Thread anisnasir
Github user anisnasir commented on the pull request: https://github.com/apache/flink/pull/1069#issuecomment-135905274 @tillrohrmann you are absolutely right with your observation that high skews require more than two workers to process the most frequent keys. However, most of the

[GitHub] flink pull request: [FLINK-1725]- New Partitioner for better load ...

2015-08-27 Thread anisnasir
Github user anisnasir commented on the pull request: https://github.com/apache/flink/pull/1069#issuecomment-135452679 Thank you very much for the feedback. 1. I have updated the constructor and removed the dependency of number of channels. Now the constructs are similar to

[GitHub] flink pull request: New Partitioner for better load balancing for ...

2015-08-27 Thread anisnasir
GitHub user anisnasir opened a pull request: https://github.com/apache/flink/pull/1069 New Partitioner for better load balancing for skewed data You can merge this pull request into a Git repository by running: $ git pull https://github.com/anisnasir/flink master

[GitHub] flink pull request: New Partitioner for better load balancing for ...

2015-04-01 Thread anisnasir
GitHub user anisnasir reopened a pull request: https://github.com/apache/flink/pull/561 New Partitioner for better load balancing for skewed data Can you please review the code and comment You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] flink pull request: New Partitioner for better load balancing for ...

2015-04-01 Thread anisnasir
Github user anisnasir closed the pull request at: https://github.com/apache/flink/pull/561 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: New Partitioner for better load balancing for ...

2015-04-01 Thread anisnasir
GitHub user anisnasir reopened a pull request: https://github.com/apache/flink/pull/561 New Partitioner for better load balancing for skewed data Can you please review the code and comment You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] flink pull request: New Partitioner for better load balancing for ...

2015-04-01 Thread anisnasir
Github user anisnasir closed the pull request at: https://github.com/apache/flink/pull/561 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: New Partitioner for better load balancing for ...

2015-04-01 Thread anisnasir
Github user anisnasir closed the pull request at: https://github.com/apache/flink/pull/561 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: New Partitioner for better load balancing for ...

2015-04-01 Thread anisnasir
GitHub user anisnasir opened a pull request: https://github.com/apache/flink/pull/561 New Partitioner for better load balancing for skewed data Can you please review the code and comment You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] flink pull request: Added a PARTIAL StreamPartitioner

2015-04-01 Thread anisnasir
Github user anisnasir closed the pull request at: https://github.com/apache/flink/pull/560 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: Added a PARTIAL StreamPartitioner

2015-04-01 Thread anisnasir
GitHub user anisnasir opened a pull request: https://github.com/apache/flink/pull/560 Added a PARTIAL StreamPartitioner You can merge this pull request into a Git repository by running: $ git pull https://github.com/anisnasir/flink local Alternatively you can review and