[GitHub] samza pull request #871: SAMZA-2056 : Adding a TaskMode in the TaskModel

2019-01-08 Thread rmatharu
GitHub user rmatharu opened a pull request: https://github.com/apache/samza/pull/871 SAMZA-2056 : Adding a TaskMode in the TaskModel This PR adds a TaskMode (an enum) to the TaskModel. This assignment is persisted to the metastore using a SetTaskModeMapping type. You can merge

InMemorySystemDescriptor ignores serde

2019-01-08 Thread Tom Davis
I am in the process of updating a project to 1.0 and spent today debugging a rather odd test failure. When using input/output streams with IntegerSerde, things worked fine -- however, using LongSerde, every message value was 0! I eventually found that InMemorySystemDescriptor#getInputDescriptor ig

[GitHub] samza pull request #872: StandbyTaskGenerator interface and a BuddyContainer...

2019-01-08 Thread rmatharu
GitHub user rmatharu opened a pull request: https://github.com/apache/samza/pull/872 StandbyTaskGenerator interface and a BuddyContainerBased implementation This PR adds * StandbyTaskGenerator that is used to populate StandbyTasks once the SSP and TaskName groupers have ge

Re: InMemorySystemDescriptor ignores serde

2019-01-08 Thread Sanil Jain
Hi Tom, InMemorySystem is a system that is supposed to only support NoOpSerde since all the associated steams for this system are maintained in memory. In addition to this if your test is using the Samza's Test Framework, it will override any explicit serde configs specified for streams to NoO

Re: InMemorySystemDescriptor ignores serde

2019-01-08 Thread Sanil Jain
In addition to that In your email you mentioned: Apparently that *was* respected by some part of the system because integers were deserialized properly! Removing this configuration value results in my operator receiving a byte array since the in-memory system only uses NoOpSerde. Can you send