Review Request 35241: refactoring the code for coordinator stream writer

/TestCoordinatorStreamWriter.java PRE-CREATION Diff: https://reviews.apache.org/r/35241/diff/ Testing --- Thanks, Shadi A. Noghabi

Re: Review Request 35241: refactoring the code for coordinator stream writer

g/r/35241/#review87309 --- On June 9, 2015, 1:58 a.m., Shadi A. Noghabi wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://revie

Re: Review Request 35241: refactoring the code for coordinator stream writer

samza-core/src/test/java/org/apache/samza/coordinator/stream/TestCoordinatorStreamWriter.java PRE-CREATION Diff: https://reviews.apache.org/r/35241/diff/ Testing --- Thanks, Shadi A. Noghabi

Review Request 36006: refactoring the code for coordinator stream writer

/yarn/TestSamzaAppMaster.scala 7b7d86a43c69e72c47eaa91f68be24e0f4022891 Diff: https://reviews.apache.org/r/36006/diff/ Testing --- Thanks, Shadi A. Noghabi

Re: Review Request 35241: refactoring the code for coordinator stream writer

samza deployment}/samza/bin/run-coordinator-stream-writer.sh --config-factory={config-factory} --config-path={path to config file of a job} --type={type of the message} --key={[optional] key of the message} --value={[optional] value of the message} Thanks, Shadi A. Noghabi

Re: Review Request 35241: refactoring the code for coordinator stream writer

added run-coordinator-stream-writer.sh script - Shadi --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35241/#review88174 -------------

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

s://reviews.apache.org/r/36006/diff/ Testing --- Thanks, Shadi A. Noghabi

Review Request 36471: added stream for auto scaling, consumer to read from the stream in profiler, sliding window metric

--- Thanks, Shadi A. Noghabi

Re: Review Request 36471: Autoscaling for samza (work in progress)

/SlidingWindowMetricTest.java PRE-CREATION Diff: https://reviews.apache.org/r/36471/diff/ Testing --- Thanks, Shadi A. Noghabi

Re: Review Request 35241: refactoring the code for coordinator stream writer

}/samza/bin/run-coordinator-stream-writer.sh --config-factory={config-factory} --config-path={path to config file of a job} --type={type of the message} --key={[optional] key of the message} --value={[optional] value of the message} Thanks, Shadi A. Noghabi

Re: Review Request 35241: A tool to write to the coordinator stream

} Thanks, Shadi A. Noghabi

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

/samza/job/yarn/TestSamzaAppMaster.scala 7b7d86a43c69e72c47eaa91f68be24e0f4022891 Diff: https://reviews.apache.org/r/36006/diff/ Testing --- Thanks, Shadi A. Noghabi

Re: Review Request 36471: Autoscaling for samza (work in progress)

/test/scala/org/apache/samza/job/yarn/TestSamzaAppMaster.scala 7b7d86a43c69e72c47eaa91f68be24e0f4022891 Diff: https://reviews.apache.org/r/36471/diff/ Testing --- Thanks, Shadi A. Noghabi

Re: Review Request 36471: Autoscaling for samza (work in progress)

--- Thanks, Shadi A. Noghabi

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

a/job/yarn/SamzaAppMasterService.scala ce88698c12c4bf6f4cf128f92d60b0b9496997d7 settings.gradle 19bff971ad221084dac10d3f7f3facfa42b829a7 Diff: https://reviews.apache.org/r/36006/diff/ Testing --- Thanks, Shadi A. Noghabi

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

vice.scala ce88698c12c4bf6f4cf128f92d60b0b9496997d7 settings.gradle 19bff971ad221084dac10d3f7f3facfa42b829a7 Diff: https://reviews.apache.org/r/36006/diff/ Testing (updated) --- Tested with hello samza and works properly. Thanks, Shadi A. Noghabi

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

uestion: can we move this code into the JobCoordinator.start()? I > > don't see any reason why this has to be outside JobCoordinator? It cannot be moved to there since the server url is not set yet in JobCoordinator.start(). I have moved this to SamzaAppMasterService.onInit() On July 22,

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36006/#review92625 ----------- On July 28, 2015, 2:39 a.m., Shadi A. Noghabi wrote: > >

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

tps://reviews.apache.org/r/36006/#review92227 ------- On July 28, 2015, 2:39 a.m., Shadi A. Noghabi wrote: > > --- > This is an automatically generated e-mail.

Re: Review Request 36471: Autoscaling for samza (work in progress)

/yarn/SamzaAppMaster.scala af42c6a6636953a95f79837fe372e0dbd735df70 samza-yarn/src/test/scala/org/apache/samza/job/yarn/TestSamzaAppMaster.scala 7b7d86a43c69e72c47eaa91f68be24e0f4022891 Diff: https://reviews.apache.org/r/36471/diff/ Testing --- Thanks, Shadi A. Noghabi

Re: Review Request 36471: Autoscaling for samza (work in progress)

(updated) --- tested with hello samza Thanks, Shadi A. Noghabi

Re: Review Request 36006: SAMZA-704: Writing a tool to read from the coordinator stream and react to config changes accordingly.

rg/r/36006/diff/ Testing --- Tested with hello samza and works properly. Thanks, Shadi A. Noghabi

Re: Review Request 36006: SAMZA-704: Writing a tool to read from the coordinator stream and react to config changes accordingly.

-- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36006/#review93820 --- On Aug. 8, 2015, 1:26 a.m., Shadi A. Noghabi wrote: > > ---

Re: Review Request 36006: SAMZA-704: Writing a tool to read from the coordinator stream and react to config changes accordingly.

a/job/yarn/SamzaAppMasterService.scala ce88698c12c4bf6f4cf128f92d60b0b9496997d7 settings.gradle 19bff971ad221084dac10d3f7f3facfa42b829a7 Diff: https://reviews.apache.org/r/36006/diff/ Testing --- Tested with hello samza and works properly. Thanks, Shadi A. Noghabi

Re: Review Request 36006: SAMZA-704: Writing a tool to read from the coordinator stream and react to config changes accordingly.

t; The file directory name is still autoScaling. Isn't it a problem? > > Shadi A. Noghabi wrote: > I have fixed it to autoscaling not "autoScaling". I don't know why the RB > is showing so. This was due to an issue in mac, where it is n

Re: Review Request 36006: SAMZA-724: Writing a tool to read from the coordinator stream and react to config changes accordingly.

iff: https://reviews.apache.org/r/36006/diff/ Testing --- Tested with hello samza and works properly. Thanks, Shadi A. Noghabi

Re: Review Request 36006: SAMZA-724: Writing a tool to read from the coordinator stream and react to config changes accordingly.

ache/samza/job/yarn/SamzaAppMasterService.scala ce88698c12c4bf6f4cf128f92d60b0b9496997d7 settings.gradle 19bff971ad221084dac10d3f7f3facfa42b829a7 Diff: https://reviews.apache.org/r/36006/diff/ Testing --- Tested with hello samza and works properly. Thanks, Shadi A. Noghabi

Re: Review Request 36006: SAMZA-724: Writing a tool to read from the coordinator stream and react to config changes accordingly.

ache/samza/job/yarn/SamzaAppMasterService.scala ce88698c12c4bf6f4cf128f92d60b0b9496997d7 settings.gradle a8d2c885254ca3994327fda18e09c49bc9c5e830 Diff: https://reviews.apache.org/r/36006/diff/ Testing --- Tested with hello samza and works properly. Thanks, Shadi A. Noghabi

Re: Review Request 36006: SAMZA-724: Writing a tool to read from the coordinator stream and react to config changes accordingly.

org/apache/samza/job/yarn/SamzaAppMasterService.scala ce88698c12c4bf6f4cf128f92d60b0b9496997d7 settings.gradle a8d2c885254ca3994327fda18e09c49bc9c5e830 Diff: https://reviews.apache.org/r/36006/diff/ Testing --- Tested with hello samza and works properly. Thanks, Shadi A. Noghabi

Re: Review Request 36006: SAMZA-724: Writing a tool to read from the coordinator stream and react to config changes accordingly.

s properly. Thanks, Shadi A. Noghabi

Re: Review Request 36471: Autoscaling for samza (work in progress)

://reviews.apache.org/r/36471/diff/ Testing --- tested with hello samza Thanks, Shadi A. Noghabi