Re:Re:Re:Re: Re: [Discuss][DSIP] Improve Doris observability

2022-05-17 Thread 陈明雨
t; >Step2. Execute Profile and data integration >>>> >Step3. Doris topology >>>> >Step4. Doris fe and be metrics >>>> >Step5. Doris log >>>> > >>>> > >>>> >by stalary >>>> > >&g

Re:Re:Re: Re: [Discuss][DSIP] Improve Doris observability

2022-05-17 Thread luozenglin
2:27，Zhou Minghong wrote： >>> >Hi Stalary, >>> >What kind of data will be visualized first? >>> >Could you integrate profile data and sql plan together？ >>> >Any way, this is a good idea! >>> > >>> > >>> >Minghong >>

Re:Re: Re: [Discuss][DSIP] Improve Doris observability

2022-05-16 Thread 陈明雨
e profile data and sql plan together？ >> >Any way, this is a good idea! >> > >> > >> >Minghong >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >>

Re: Re: [Discuss][DSIP] Improve Doris observability

2022-05-16 Thread Willem Jiang
u integrate profile data and sql plan together？ > >Any way, this is a good idea! > > > > > >Minghong > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > &

Re:Re: [Discuss][DSIP] Improve Doris observability

2022-05-16 Thread luozenglin
> > > > > >At 2022-05-15 19:26:05, "41108453" <41108...@qq.com.INVALID> wrote: >nice work！ > > > > > > > >-- Original -- >From: stalary Date: Sun,May 15,2022 7:13 PM >To: dev@doris.apache.org Subje

Re: [Discuss][DSIP] Improve Doris observability

2022-05-16 Thread stalary
Thank you very much, I will communicate with Luozenglin. by stalary On 05/16/2022 17:49，zhg yang wrote： Hi stalary luozenglin has done a lot of work on OpenTelemetry and trace before, and has made some progress, I think you can work with him to develop this thing

Re: [Discuss][DSIP] Improve Doris observability

2022-05-16 Thread zhg yang
41108453" <41108...@qq.com.INVALID> wrote: > nice work！ > > > > > > > > -- Original -- > From: stalary Date: Sun,May 15,2022 7:13 PM > To: dev@doris.apache.org Subject: Re: [Discuss][DSIP] Improve Doris observability > &g

Re: [Discuss][DSIP] Improve Doris observability

2022-05-15 Thread stalary
I will split it for five steps, step1 will be visualized first. Step1. Sql Plan Step2. Execute Profile and data integration Step3. Doris topology Step4. Doris fe and be metrics Step5. Doris log by stalary On 05/15/2022 22:27，Zhou Minghong wrote： Hi Stalary, What kind of data will be visualized

Re:Re: [Discuss][DSIP] Improve Doris observability

2022-05-15 Thread Zhou Minghong
; > > >-- Original -- >From: stalary Date: Sun,May 15,2022 7:13 PM >To: dev@doris.apache.org Subject: Re: [Discuss][DSIP] Improve Doris observability > > > > >Dear All, > >I’d like to improve Doris observability. This is achieved by

Re: [Discuss][DSIP] Improve Doris observability

2022-05-15 Thread 41108453
nice work！ -- Original -- From: stalary https://github.com/apache/incubator-doris/issues/9577 Here are the results of my preliminary research 1. Currently OpenTelemetry is very convincing in terms of protocol specifications, including traces, metrics, logs a

[Discuss][DSIP] Improve Doris observability

2022-05-15 Thread stalary
Dear All, I’d like to improve Doris observability. This is achieved by introducing Skywalking and OpenTelemetry. Parameters allow users to decide which monitoring tool to use. First I want to support trace on the FE, implement tracing of SQL statements. The associated issue：https://github.com