Sorry forget properties below is my test properties
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
# Job
job.factory.class=org.apache.samza.job.yarn.YarnJobFactory
job.name=MonitorDataTask
job.id=8
# YARN file://${basedir}/target/${project.artifactId}-${pom.version}-dist.tar.gz
yarn.package.path=file:///home/shou/codes/hello-samza/target/pandora-samza-${pom.version}-dist.tar.gz
#yarn.package.path=http://yarn01:9000/samza/1.0.0/pandora-samza-1.0.0-dist.tar.gz
# Task
task.class=com.chinaway.samza.obtain.kafka.task.impl.MonitorDataTask
task.inputs=kafka.metrics
task.monitor.out.stream=monitor-result
# Serializers
serializers.registry.json.class=org.apache.samza.serializers.JsonSerdeFactory
serializers.registry.string.class=org.apache.samza.serializers.StringSerdeFactory
# Kafka System
systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory
systems.kafka.samza.msg.serde=json
systems.kafka.consumer.zookeeper.connect=127.0.0.1:2181/
systems.kafka.producer.bootstrap.servers=127.0.0.1:9092
# Job Coordinator
job.coordinator.system=kafka
job.coordinator.replication.factor=1
task.opts=-agentlib:jdwp=transport=dt_socket,address=127.0.0.1:9105,server=y,suspend=y
#=============================================================================================
task.window.ms=10000
task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory
task.checkpoint.system=kafka
task.commit.ms=600000
# Normally, this would be 3, but we have only one broker.
task.checkpoint.replication.factor=1
# Define a metrics reporter called "snapshot", which publishes metrics
# every 60 seconds.
metrics.reporters=snapshot
metrics.reporter.snapshot.class=org.apache.samza.metrics.reporter.MetricsSnapshotReporterFactory
metrics.reporter.snapshot.stream=kafka.metrics
# Encode metrics data as JSON.
serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory
systems.kafka.streams.metrics.samza.msg.serde=metrics
发件人: 吴少东
发送时间: 2016年6月29日 15:59
收件人: 'dev@samza.apache.org' <dev@samza.apache.org>
主题: A magic question
Hello everyone:
When use
Metrics<http://samza.apache.org/learn/documentation/0.10/container/metrics.html>
model find the BUG???
This is some time TaskInstanceMetrics Monitor Metric
Why Data value not zero?!!!
[cid:image001.png@01D1D21F.E3F46980]
The configuration is after last snapshot basis of create new 60s snapshot ?
[cid:image002.png@01D1D21F.E3F46980]
How can to use metrics zero operate? Or myself create local metricsFactory?!
This workload is big very big!
My dev development<app:ds:development> environment<app:ds:environment>:
<samza.version>0.10.0</samza.version>
<hadoop.version>2.6.1</hadoop.version>
<java.version>1.8</java.version>
