Hi , I wanted to start a samza job with container count as 10. When I deploy , I see only 7 containers have been spawned. I did restart the job after killing it.
I do not see any errors in the ApplicationMaster logs nor anywhere in the container. Any pointers will be helpful. Below is my properties file. # Job job.factory.class=org.apache.samza.job.yarn.YarnJobFactory job.name=samza-poc # YARN yarn.package.path=file:///x/home/bmcuser/hello-samza/target/hello-samza-0.10.0-dist.tar.gz # Task task.class=samza.examples.poc.task.SamzaPOCTask task.inputs=kafka.poc-data1 task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory task.checkpoint.system=kafka # Normally, this would be 3, but we have only one broker. task.checkpoint.replication.factor=1 # Metrics metrics.reporters=snapshot,jmx metrics.reporter.snapshot.class=org.apache.samza.metrics.reporter.MetricsSnapshotReporterFactory metrics.reporter.snapshot.stream=kafka.metrics metrics.reporter.jmx.class=org.apache.samza.metrics.reporter.JmxReporterFactory # Serializers serializers.registry.json.class=org.apache.samza.serializers.StringSerdeFactory serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory serializers.registry.integer.class=org.apache.samza.serializers.IntegerSerdeFactory serializers.registry.string.class=org.apache.samza.serializers.StringSerdeFactory # Systems systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory systems.kafka.samza.msg.serde=string systems.kafka.streams.metrics.samza.msg.serde=metrics systems.kafka.consumer.zookeeper.connect=localhost:2181/ systems.kafka.consumer.auto.offset.reset=smallest systems.kafka.producer.bootstrap.servers=localhost:9092 systems.kafka.streams.logging_stream.samza.reset.offset=true systems.kafka.streams.logging_stream.samza.offset.default=oldest # Job Coordinator job.coordinator.system=kafka # Add configuration to disable checkpointing for this job once it is available in the Coordinator Stream model # See https://issues.apache.org/jira/browse/SAMZA-465?focusedCommentId=14533346&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14533346 for more details job.coordinator.replication.factor=1 job.container.count=10 Thanks, Tushar
