GitHub user xinyuiscool opened a pull request:
https://github.com/apache/samza/pull/225
SAMZA-1321: Propagate end-of-stream messages
The patch completes the end-of-stream propagation across intermediate
streams. It does the following:
1) EndOfStreamManager aggregates the end-of-stream control messages,
propagate the result to the task;
2) StreamOperatorTask will send end-of-stream to downstream intermediate
topics based on the topology of the IO in the StreamGraph.
Tested with unit tests and integration test. Works as expected.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xinyuiscool/samza SAMZA-1321
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/225.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #225
----
commit f0bb67f26204fc5698f5d9b5fbdac8b90c70fabe
Author: Xinyu Liu <[email protected]>
Date: 2017-05-26T22:01:05Z
Add control message types and serde
commit 2d79ed7a8a6f4698904232899ef485c4f3a1e627
Author: Xinyu Liu <[email protected]>
Date: 2017-05-30T22:41:12Z
Clean up the ControlMessage class and some enhancements
commit f0e32d517942fb119253e2d4f06fc921c34ec0ba
Author: Xinyu Liu <[email protected]>
Date: 2017-05-31T00:52:49Z
Merge branch 'master' into SAMZA-1312
commit 80f6255a57715501c667450606af8b24595f7df5
Author: Xinyu Liu <[email protected]>
Date: 2017-05-31T01:05:15Z
remove unused file
commit 319cffdaca86e422c0a6c8f022cf931ad67404c7
Author: Xinyu Liu <[email protected]>
Date: 2017-05-31T17:01:54Z
Fix checkstyle issues
commit 276410188069ab84b78f3cf3328aa3c64a10976e
Author: Xinyu Liu <[email protected]>
Date: 2017-06-01T18:30:04Z
Updates to address Jagadish's feedback
commit 12c686ad42cd84a8bd87731319cf193fc0f7ab55
Author: Xinyu Liu <[email protected]>
Date: 2017-06-07T00:59:39Z
progagate end-of-stream
commit bdaa5126ff6bee4335253fd9d357e5bcd026b1ba
Author: Xinyu Liu <[email protected]>
Date: 2017-06-07T01:28:57Z
Add end-of-stream message to initial envelope from the consumer
commit 948fd925ca0889c4fe28f38573630363307789a4
Author: Xinyu Liu <[email protected]>
Date: 2017-06-07T20:54:59Z
Add dispatcher
commit a797372ab815b61475793ae708d8b8f568fb6d78
Author: Xinyu Liu <[email protected]>
Date: 2017-06-07T20:55:32Z
Merge branch 'master' into SAMZA-1321
commit 9cc5e10ba86334d1f77de90a3327d3ce7b3fcb06
Author: Xinyu Liu <[email protected]>
Date: 2017-06-08T17:33:17Z
Add logic to handle and dispatch eos messages
commit c691d0a81f403a8c303e15e41dd16dc8fb7cd19d
Author: Xinyu Liu <[email protected]>
Date: 2017-06-08T18:42:26Z
Wire up the eos processing inside the runloop
commit fd05bc721c9314fc37967bede0f41d96e01aa8c8
Author: Xinyu Liu <[email protected]>
Date: 2017-06-08T20:43:51Z
Clean up
commit 224c7d78d0a7d8bcf821280c2bcf3dbc40ef935b
Author: Xinyu Liu <[email protected]>
Date: 2017-06-13T00:18:33Z
Fix bugs found in the integration tests
commit 898aadccce48744c26998f3875d8f4dc2be63cbb
Author: Xinyu Liu <[email protected]>
Date: 2017-06-13T16:44:04Z
Fix check style errors
commit 9937d2429be3b3215a8d75763c9cfd7ebed79bee
Author: Xinyu Liu <[email protected]>
Date: 2017-06-13T16:49:31Z
Merge branch 'master' into SAMZA-1321
commit d6fa550fa0703ec0dff40e08bef53def43aa41fb
Author: Xinyu Liu <[email protected]>
Date: 2017-06-14T01:27:41Z
Add unit tests
commit dcc6d79d415102c009cf3ccffc98c46323bca6c7
Author: Xinyu Liu <[email protected]>
Date: 2017-06-14T19:04:37Z
Add more tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
