Re: Integrating LLMs as PTransform in beam pipeline

Hi, Thank you for contributing! You may also want to look at working with RunInference, for example: https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.vllm_inference.html#module-apache_beam.ml.inference.vllm_inference Cheers Reza On Sun, 1 Dec 2024 at 14:55, LDesire wrot

Re: Integrating LLMs as PTransform in beam pipeline

Hi Ganesh, I'm very excited to see this new PTransform for Beam's Java SDK. Thank you for sharing this valuable contribution. Best regards > 2024. 12. 1. 오후 11:46, Ganesh 작성: > > Hi All, > > I've been working on a custom Ptransform that integrates large language > models as a PTransform

Integrating LLMs as PTransform in beam pipeline

Hi All, I've been working on a custom Ptransform that integrates large language models as a PTransform in an Apache beam pipeline using Langchain. The aim of this integration is to leverage the capabilities of LLMs for data processing and transformations of unstructured data. It treats language m