Alanxtl opened a new pull request, #678:
URL: https://github.com/apache/dubbo-go-pixiu/pull/678
<!-- Thanks for sending a pull request!
-->
**What this PR does**:
- Add a field `LLMMeta` for endpoint, Allow room for later endpoint
extensions specifically for llm.
- Add the mapping from the llm provider to the request url, which increased
ease of use for llm users. The step completes the mapping when the endpoint is
built.
In the previous version, if users want to create a llm endpoint,
`conf.yaml` should be like this:
```yaml
endpoints:
- id: 1
socket_address:
domains:
- "api.deepseek.com"
```
After this PR, users can specify the LLM provider. They can do this in
`conf.yaml`. The format for this is as follows:
```yaml
endpoints:
- id: 1
llm_meta:
provider: "deepseek"
```
After this pr, we can implement the loadbalancer across apiKeys and retry
policies with `LLMMeta` field.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
