Hi, there is no need to apologize :)
If I understand you correctly, you need access to RuntimeContext within FlinkTopologyContext. FlinkTopologyContext in created within StormWrapperSetupHelper.convertToTopologyContext which has already access to StreamingRuntimeContext (which is just a special RuntimeContext). So just extend the constructor of FlinkTopologyContext by a RuntimeContext parameter an add a member to FlinkTopologyContext that hold a refrence to the RuntimeContext. -Matthias On 09/19/2015 10:28 AM, huangwei (G) wrote: > Hi Matthias, > > Very sorry for the email in weekend. > I try to add a wrapper(FlinkCountMetric) for the Storm-CountMetric and it's > also easy to do it. > But I get a trouble in `FlinkTopologyContext.registerMetric` method that I > don't know how to use the `getRuntimeContext` in this class since I want to > register the CountMetric into Flink. > Do you have any idea? > > Greetings, > Wei Huang. > > =========================================================================== > > I personally never used Metrics in Storm. It would be best, if you design an > own example. > > I guess you are familiar with > https://storm.apache.org/documentation/Metrics.html > > As a first step, I would try to include the predefined Storm metric and work > on custom metrics later. As the Storm documentation points out, the metrics > are used to get the value for Storm UI. Maybe, you can start to add > Tuple-count metrics for whole topologies to be collected and displayed in > Flink WebUI. > > -Matthias > > > On 09/07/2015 02:51 PM, huangwei (G) wrote: >> Hi Kostas, >> >> Thanks for your support! >> I created the JIRA and pushed a PR for it. >> >> @Matthias >> Could you give me a storm example in using the cust metrics? >> Since it is needed for follow-up development. >> Many thanks! >> >> Greetings, >> Huang Wei >> >> ===================================== >> >> Sounds great. It is easy to create an AverageAccumulator by implementing the >> org.apache.flink.api.common.accumulators.Accumulator interface, accumulating >> the sum and the count internally, and dividing in the end. >> >> This would be something useful also outside of Storm compatibility. >> >> Then, MultiReduceMetrics can be implemented on top of that. >> >> Looking forward to the JIRA. >> >> On Wed, Sep 2, 2015 at 8:36 AM, huangwei (G) <huangwei...@huawei.com> wrote: >> >>> Dear all, >>> >>> I focused on the Flink-accumulator and found that there is not any >>> feature to count the average of values. >>> And there is a MultiReducedMetric class in storm that calculates the >>> average. >>> This class can be used internally to get the latency in storm. >>> So as the first step, I`d like to add a class like MultiReducedMetric. >>> And the detail about design I`ll describe in a new JIRA if you agree >>> this above. >>> Please let me know if I`m wrong. >>> Thank you! >>> >>> ======================================== >>> >>> Hi Kostas, >>> Thank you for the information. >>> I`ll take a look. >>> And I`m comparing the storm metrics with Flink accumulators. >>> I`ll let you know if I have some ideas. >>> >>> ======================================== >>> >>> Flink accumulators are documented here: >>> >>> https://ci.apache.org/projects/flink/flink-docs-master/apis/programmi >>> n >>> g_guide.html#accumulators--counters >>> >>> I think Aljoscha's idea is to implement Storm metrics on top of those. >>> >>> Huangwei, perhaps you can look whether the interfaces match >>> (basically if Flink accumulators have all the features needed to >>> support the kinds of metrics that Storm exposes, or if there is a >>> significant impedance mismatch). >>> >>> On Mon, Aug 31, 2015 at 2:06 PM, Matthias J. Sax < >>> mj...@informatik.hu-berlin.de> wrote: >>> >>>> I did not look into it and I am not super familiar with Flink's >>>> accumulators... Can not provide much help right now. Sorry :( >>>> >>>> -Matthias >>>> >>>> On 08/31/2015 01:01 PM, huangwei (G) wrote: >>>>> Hi, >>>>> I think I can take a simple design for it. >>>>> Do you have any idea? >>>>> >>>>> ======================================== >>>>> >>>>> Maybe. I did not put any thoughts into this... >>>>> >>>>> On 08/31/2015 12:25 PM, Aljoscha Krettek wrote: >>>>>> Hi, >>>>>> could the metrics not be implemented on top of Flink accumulators? >>>>>> They would even be live-updated in the new web front-end. >>>>>> >>>>>> Cheers, >>>>>> Aljoscha >>>>>> >>>>>> On Mon, 31 Aug 2015 at 11:32 Matthias J. Sax >>>>>> <mj...@informatik.hu-berlin.de> >>>>>> wrote: >>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> custom metrics are currently not supported by the compatibility >>> layer. >>>>>>> See README here: >>>>>>> >>>>>>> https://github.com/apache/flink/tree/master/flink-contrib/flink- >>>>>>> st orm -compatibility/flink-storm-compatibility-core >>>>>>> >>>>>>> It is an open question, if/how Flink can support this feature. >>>>>>> >>>>>>> -Matthias >>>>>>> >>>>>>> On 08/31/2015 09:53 AM, huangwei (G) wrote: >>>>>>>> Hi Matthias and all, >>>>>>>> >>>>>>>> I`d like to do the custom metrics in flink-storm-compatibility. >>>>>>>> And there are some questions following: >>>>>>>> Is there anything like storm metrics in Flink? >>>>>>>> If not, does Flink need to have metrics mechanism in internal first? >>>>>>>> Or just let the metrics use in flink-storm-compatibility? >>>>>>>> >>>>>>>> >>>>>>>> Greetings, >>>>>>>> Huang Wei >>>>>>>> 华为技术有限公司 Huawei Technologies Co., Ltd. >>>>>>>> >>>>>>>> >>>>>>>> Tel:+86 18106512602 >>>>>>>> Email:huangwei...@huawei.com >>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>> >>>> >>> >
signature.asc
Description: OpenPGP digital signature