Re: Pipleline portable proto visualizaiton

2022-11-08 Thread Robert Bradshaw via dev
OK, I put this together as a PR: https://github.com/apache/beam/pull/24037 (I think I've written this beam proto -> dot code half a dozen times by now...it'll be good to have it checked in and reusable.) On Mon, Nov 7, 2022 at 11:06 AM Matt Casters wrote: > > Apache Hop pipelines are actually jus

Re: Pipleline portable proto visualizaiton

2022-11-07 Thread Matt Casters
Apache Hop pipelines are actually just XML files. So if you know how the source pipeline looks you can convert it and visualize and edit it using the Hop GUI. On Mon, Nov 7, 2022 at 6:19 PM Valentyn Tymofieiev via dev < dev@beam.apache.org> wrote: > I'd like to visualize a DAG for a Beam portable

Re: Pipleline portable proto visualizaiton

2022-11-07 Thread Valentyn Tymofieiev via dev
Thanks a lot, sounds like that would help avoid reinventing the wheel. On Mon, Nov 7, 2022 at 9:28 AM Robert Bradshaw wrote: > I've got one I use in Python too (including drilling down into > composites). It's a portable runner. I should clean it up and make it > generally available. > > On Mon,

Re: Pipleline portable proto visualizaiton

2022-11-07 Thread Robert Bradshaw via dev
I've got one I use in Python too (including drilling down into composites). It's a portable runner. I should clean it up and make it generally available. On Mon, Nov 7, 2022 at 9:25 AM Robert Burke wrote: > > The Go SDK has a "dot" runner to visualize pipeline protos as a dot graph but > it's it

Re: Pipleline portable proto visualizaiton

2022-11-07 Thread Robert Burke
The Go SDK has a "dot" runner to visualize pipeline protos as a dot graph but it's it's not set up as a portable runner. Probably wouldn't be too hard to get it to operate as a stand alone tool, for someone motivated enough. On Mon, Nov 7, 2022, 9:19 AM Valentyn Tymofieiev via dev < dev@beam.apach