Hi, Shaodong,
Could you clarify what's your specific question? I can see that you
configured your job to use snapshot metrics reporter and you are getting
the JSON format snapshot report as expected. What's wrong here?
On Tue, May 10, 2016 at 1:25 AM, SSHOU <wushaod...@huoyunren.com> wrote:
> Sorry, forget Task config file
>
> # Job
> job.factory.class=org.apache.samza.job.yarn.YarnJobFactory
> job.name=AnalyzeTask
>
> # YARN file://$
> {basedir}/target/${project.artifactId}-${pom.version}-dist.tar.gz
> yarn.package.path=
> file:///home/shou/codes/hello-samza/target/pandora-samza-$
> {pom.version}-dist.tar.gz
>
> # Task
> task.class=com.chinaway.samza.obtain.kafka.task.impl.AnalyzeDataTask
> task.inputs=kafka.interface-result
> systems.remote.analyze.out.stream=analyze-result
>
> # Serializers
>
> serializers.registry.json.class=org.apache.samza.serializers.JsonSerdeFactory
>
> serializers.registry.string.class=org.apache.samza.serializers.StringSerdeFactory
>
> # Remote System
>
> systems.remote.spring.path=META-INF/spring/dubbo-demo-consumer.xml,META-INF/spring/dubbo-demo-action.xml
> systems.remote.spring.bean.name=localCodeService
>
> # Kafka System
>
> systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory
> systems.kafka.samza.msg.serde=json
> systems.kafka.consumer.zookeeper.connect=127.0.0.1:2181/
> systems.kafka.consumer.group.id=interface-result-consumer
> systems.kafka.producer.bootstrap.servers=127.0.0.1:9092
>
> # Job Coordinator
> job.coordinator.system=kafka
> job.coordinator.replication.factor=1
>
> task.opts=-agentlib:jdwp=transport=dt_socket,address=127.0.0.1:9101
> ,server=y,suspend=y
>
> task.window.ms=10000
>
> task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory
> task.checkpoint.system=kafka
> task.commit.ms=600000
>
> task.checkpoint.replication.factor=1
>
> metrics.reporters=snapshot
>
> metrics.reporter.snapshot.class=org.apache.samza.metrics.reporter.MetricsSnapshotReporterFactory
>
> metrics.reporter.snapshot.stream=kafka.metrics
>
>
> serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory
> systems.kafka.streams.metrics.samza.msg.serde=metrics
>
>
> 在 2016年05月10日 15:54, SSHOU 写道:
>
> hello everyone:
> I according to metrics configuration use samza but result data not
> show metrics page format!!!
> I'm getting metrics data format see accessory photo or copy down JSON
> data.
>
> Thanks everyone help me!
> -------------------DOWN JSON---------------
> {"header":{"job-id":"1","samza-version":"0.10.0","job-name":"AnalyzeTask","host":"172.21.9.150","reset-time":1462864635447,"container-name":"ApplicationMaster","source":"ApplicationMaster","time":1462865846296,"version":"0.0.1"},"metrics":{"org.apache.samza.system.kafka.KafkaSystemProducerMetrics":{"kafka-producer-send-failed":0,"kafka-flush-ns":0.0,"kafka-producer-send-success":1,"kafka-flush-failed":0,"kafka-producer-sends":1,"kafka-producer-retries":0,"kafka-flushes":0},"org.apache.samza.system.kafka.KafkaSystemConsumerMetrics":{"no-more-messages-SystemStreamPartition
> [kafka, __samza_coordinator_AnalyzeTask_1,
> 0]":true,"kafka-__samza_coordinator_analyzetask_1-0-high-watermark":61,"kafka-jakewoo-9092-messages-read":12292,"kafka-__samza_coordinator_analyzetask_1-0-messages-behind-high-watermark":0,"blocking-poll-count-SystemStreamPartition
> [kafka, __samza_coordinator_AnalyzeTask_1,
> 0]":4,"kafka-jakewoo-9092-bytes-read":11225,"kafka-jakewoo-9092-topic-partitions":1,"kafka-__samza_coordinator_analyzetask_1-0-bytes-read":11225,"buffered-message-count-SystemStreamPartition
> [kafka, __samza_coordinator_AnalyzeTask_1,
> 0]":0,"kafka-jakewoo-9092-skipped-fetch-requests":0,"kafka-__samza_coordinator_analyzetask_1-0-offset-change":61,"kafka-jakewoo-9092-reconnects":0,"kafka-__samza_coordinator_analyzetask_1-0-messages-read":61,"blocking-poll-timeout-count-SystemStreamPartition
> [kafka, __samza_coordinator_AnalyzeTask_1,
> 0]":0,"poll-count":11},"org.apache.samza.metrics.JvmMetrics":{"mem-heap-committed-mb":372.5,"threads-waiting":5,"mem-non-heap-max-mb":-9.536743E-7,"threads-timed-waiting":25,"mem-heap-used-mb":178.19217,"threads-runnable":16,"ps
> scavenge-gc-count":7,"ps
> scavenge-gc-time-millis":101,"mem-heap-max-mb":683.0,"gc-count":9,"mem-non-heap-used-mb":51.82807,"threads-new":0,"ps
> marksweep-gc-count":2,"threads-blocked":3,"gc-time-millis":176,"mem-non-heap-committed-mb":52.6875,"ps
> marksweep-gc-time-millis":75,"threads-terminated":0},"org.apache.samza.job.yarn.SamzaAppMasterMetrics":{"job-healthy":1,"http-port":49137,"locality-matched":0,"completed-containers":0,"needed-containers":0,"running-containers":1,"failed-containers":0,"rpc-port":51252,"released-containers":0,"app-attempt-id":"appattempt_1462864278075_0010_000001","container-count":1,"http-host":"JakeWoo"}}}
>
>
>
>
> {"header":{"job-id":"1","samza-version":"0.10.0","job-name":"AnalyzeTask","host":"172.21.9.150","reset-time":1462864635447,"container-name":"ApplicationMaster","source":"MetricsSnapshotReporterFactory","time":1462865846297,"version":"0.0.1"},"metrics":{"org.apache.samza.system.kafka.KafkaSystemProducerMetrics":{"kafka-producer-send-failed":0,"kafka-flush-ns":1072401.5555555555,"kafka-producer-send-success":39,"kafka-flush-failed":0,"kafka-producer-sends":39,"kafka-producer-retries":0,"kafka-flushes":39}}}
>
>
>
>
>
>
>
