Yunfeng Zhou created FLINK-38549:
------------------------------------
Summary: Support limiting context window size for Model Functions
Key: FLINK-38549
URL: https://issues.apache.org/jira/browse/FLINK-38549
Project: Flink
Issue Type: Improvement
Components: Library / Machine Learning
Affects Versions: 2.2.0
Reporter: Yunfeng Zhou
This ticket aims to support setting a limit for the context size for Model
Function requests, so as to avoid having single large requests draining the
token quota of users.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)