Hi everyone, I came across this github issue( https://github.com/apache/beam/issues/36253) for developing a Java native remote inference.
To address it. I've put together a short design doc that talks about a new RemoteInference transform for java sdk to perform inference with models provider APIs like Vertex ai, open ai, anthropic and other model endpoints. I would like to kindly request feedback and suggestions on transform design and internals. Document - https://docs.google.com/document/d/1b_JbiZoMJbjqi5ae0jnTaBr2gvvzbnWfxCRPvNdICVY/edit?usp=sharing Thanks, Ganesh.
