[
https://issues.apache.org/jira/browse/FLINK-40411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiqian Yu reassigned FLINK-40411:
---------------------------------
Assignee: Mao Jiayi
> Introduce an OpenAI-compatible model client for Flink CDC Pipeline
> ------------------------------------------------------------------
>
> Key: FLINK-40411
> URL: https://issues.apache.org/jira/browse/FLINK-40411
> Project: Flink
> Issue Type: New Feature
> Components: Flink CDC
> Reporter: Mao Jiayi
> Assignee: Mao Jiayi
> Priority: Major
> Labels: pull-request-available
>
> h3. Motivation
> FLINK-39568 introduced the generic AI model client API and the
> {{AI_COMPLETE}} and {{AI_EMBED}} functions. This issue adds a concrete
> OpenAI-compatible model client so that Flink CDC Pipeline jobs can use model
> services exposing OpenAI-compatible completion and embedding APIs.
> h3. Scope
> * Add an independent {{openai-compatible}} model module discovered through
> the Factory SPI.
> * Support configurable model name, endpoint, and API key.
> * Support configurable system and user prompts and input text, including
> English and Chinese.
> * Support common request parameters such as temperature, top-p, token limits,
> penalties, response format, additional headers, and additional body
> properties.
> * Support text completion and text embedding.
> * Support retry, backoff, response validation, and error handling.
> * Package the required client dependencies and ensure that the model provider
> JAR is available to TaskManagers.
> * Add English and Chinese documentation.
> h3. Compatibility
> The OpenAI-compatible client is added alongside the existing legacy model
> API. This issue does not remove or migrate the legacy API.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
