Re: Integrating LLMs as PTransform in beam pipeline

Hi, Thank you for contributing! You may also want to look at working with RunInference, for example: https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.vllm_inference.html#module-apache_beam.ml.inference.vllm_inference Cheers Reza On Sun, 1 Dec 2024 at 14:55, LDesire wrot

Re: Integrating LLMs as PTransform in beam pipeline

Hi Ganesh, I'm very excited to see this new PTransform for Beam's Java SDK. Thank you for sharing this valuable contribution. Best regards > 2024. 12. 1. 오후 11:46, Ganesh 작성: > > Hi All, > > I've been working on a custom Ptransform that integrates large language > models as a PTransform