Re: Introducing beam.MLTransform

2023-05-15 Thread Ahmet Altay via dev
Thank you for writing this, Anand! I think this is a good way to leverage existing libraries and also a good usability improvement. On Wed, May 10, 2023 at 11:04 AM XQ Hu via dev wrote: > Agree with Danny. Thanks for writing this! > > On Wed, May 10, 2023 at 10:35 AM Danny McCormick via dev < >

Re: Introducing beam.MLTransform

2023-05-10 Thread XQ Hu via dev
Agree with Danny. Thanks for writing this! On Wed, May 10, 2023 at 10:35 AM Danny McCormick via dev < dev@beam.apache.org> wrote: > Thanks Anand! I left a few comments, but overall I think this is a > great/well constructed proposal - this is a good way to quickly bring a > suite of preprocessing

Re: Introducing beam.MLTransform

2023-05-10 Thread Danny McCormick via dev
Thanks Anand! I left a few comments, but overall I think this is a great/well constructed proposal - this is a good way to quickly bring a suite of preprocessing operations to Beam. Thanks, Danny On Tue, May 9, 2023 at 12:52 PM Anand Inguva via dev wrote: > Hi all, > > In Apache Beam, we plan t

Introducing beam.MLTransform

2023-05-09 Thread Anand Inguva via dev
Hi all, In Apache Beam, we plan to introduce a *beam.MLTransform* for carrying out common ML centric processing tasks. Using the tensorflow_transform as the backend, we will introduce several data processing transforms in Beam. These can be easily utilized by simply wrapping them with the beam.ML