GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/648
[FLINK-19698[FLINK-1672][FLINK-1969] Various major fixes Cleaning up the Distributed Cache - Gives a proper exception when a non-cached file is accessed - Forwards I/O exceptions that happen during file transfer, rather than only returning null when transfer failed - Consistently keeps reference counts and copies only when needed - Properly removes all files when shutdown - Uses a shutdown hook to remove files when process is killed Unifying Task Bootstrap and Execution - This simplifies and hardens the failure handling during task startup - Guarantees that no actor system threads are blocked by task bootstrap, or task canceling - Corrects some previously erroneous corner case state transitions - Adds simple and robust tests Removes deprecated profiler code Various minor fixes in addition You can merge this pull request into a Git repository by running: $ git pull https://github.com/StephanEwen/incubator-flink combined_fixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/648.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #648 ---- commit 60d1e141d625f4e431e9cda7a2fc246a25d8816a Author: Stephan Ewen <se...@apache.org> Date: 2015-04-30T20:05:27Z [streaming] New Source and state checkpointing interfaces that allow operations to interact with the state checkpointing in a more precise manner. commit 04969b380cdafaa1d63dbb2740b6092d237dbaab Author: Stephan Ewen <se...@apache.org> Date: 2015-05-02T23:15:39Z [FLINK-1968] [runtime] Clean up and improve the distributed cache. - Gives a proper exception when a non-cached file is accessed - Forwards I/O exceptions that happen during file transfer, rather than only returning null when transfer failed - Consistently keeps reference counts and copies only when needed - Properly removes all files when shutdown - Uses a shutdown hook to remove files when process is killed commit bba8504c125c1f81c448cb2d4a6fbad7e79f4e7e Author: Stephan Ewen <se...@apache.org> Date: 2015-05-02T23:57:37Z [runtime] Fix TaskExecutionState against non-serializable exceptions. commit d4d6caca0b12136c2beeaf333a3790622a1e0c13 Author: Stephan Ewen <se...@apache.org> Date: 2015-05-03T02:41:03Z [FLINK-1672] [runtime] Unify Task and RuntimeEnvironment into one class. - This simplifies and hardens the failure handling during task startup - Guarantees that no actor system threads are blocked by task bootstrap, or task canceling - Corrects some previously erroneous corner case state transitions - Adds simple and robust tests commit 477d3e2d3d118c894b53ba311d889300a1ba0dbe Author: Stephan Ewen <se...@apache.org> Date: 2015-05-03T12:10:35Z [FLINK-1969] [runtime] Remove deprecated profiler code commit f9bdd0627fc88a3deef768507a1abe74a0fede79 Author: Stephan Ewen <se...@apache.org> Date: 2015-05-03T12:10:58Z Update build target path in README.md ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---