henrikdukefoss opened a new issue, #13205: URL: https://github.com/apache/seatunnel/issues/13205
### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description Disclosure: I work on Standard Compute, so this is a vendor proposal. I'd like to contribute it to SeaTunnel the same way OrcaRouter was added in #11997. Add Standard Compute as an `AI_PROVIDER` option for `seatunnel-cli`. Standard Compute is an OpenAI-compatible API (`https://api.stdcmpt.com/v1`). Its routed model `StandardCompute` picks one of the user's enabled models for each request, based on a quality preference, and falls back automatically if an upstream fails. Users can opt in to Europe-only or US-only processing per key, and prompts aren't stored or used for training. Proposed scope, kept to parity with #11997 so it doesn't clash with #12552: - `StandardComputeProvider(OpenAIProvider)` in `llm_provider.py`, with the default base URL and the `StandardCompute` model. - Env vars: `STANDARDCOMPUTE_API_KEY` (required, and it never falls back to `OPENAI_API_KEY`), `STANDARDCOMPUTE_MODEL`, `STANDARDCOMPUTE_SMALL_FAST_MODEL` and `STANDARDCOMPUTE_ECHO_REASONING_CONTENT` (to match `OPENAI_ECHO_REASONING_CONTENT`). - `--init` setup, `env.example.sh`, `setup.sh`, the CLI READMEs, and `docs/{en,zh}/ai-cli/{overview,quickstart}.md`. - Tests: a new `test_llm_provider_standardcompute.py` for defaults, the missing-key error, env overrides and the no-`OPENAI_API_KEY` case. The routing tests go in the existing `test_cli_provider_routing.py` class. Acceptance checks I'll paste into the PR: 1. A real multi-turn session (for example "MySQL CDC to Doris") that makes tool calls and produces a config that passes the CLI validator. 2. The same session with reasoning echo on. A routed model can change upstream models between turns, so I'll test `reasoning_content` replay explicitly and document the env var if it has to be off. 3. Streaming output through `chat_stream()`. 4. `pytest seatunnel-cli/tests -q`. ### Usage Scenario Users who want one key for several models in the AI CLI, with automatic fallback, or who need Europe-only or US-only processing. ### Related issues #11997 (OrcaRouter, merged), #12552 (Cheaper Inference, open). ### Are you willing to submit a PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
