Aias00 opened a new issue, #7648:
URL: https://github.com/apache/shenyu/issues/7648

   ## Goal
   Reduce remote-directory refresh latency for multiple MCP endpoints, only if 
measurements justify changing serialized discovery.
   
   ## Current evidence
   `RemoteCatalogLifecycle.build` initializes targets through `concatMap`; 
`RemoteToolDirectory.discover` also discovers targets serially and applies a 
five-second timeout. The directory already has target/page/tool bounds and 
generation cleanup rules. This task concerns catalog refresh, not steady-state 
tool invocation throughput.
   
   [Source at reviewed 
commit](https://github.com/apache/shenyu/blob/b4e115367fd57adc8aba332d655b1009932ba394/shenyu-plugin/shenyu-plugin-agent-gateway/src/main/java/org/apache/shenyu/plugin/agent/gateway/remote/RemoteCatalogLifecycle.java#L168)
   
   ## Scope and acceptance criteria
   - [ ] Establish a serial baseline for 1/4/8 targets with controlled 
handshake/list-tools delays and failures.
   - [ ] Compare small bounded concurrency values; keep cursor pagination 
sequential within each target.
   - [ ] Preserve deterministic target/tool handling, duplicate validation, 
timeout semantics and atomic directory publication.
   - [ ] Verify stale/cancelled generations close every allocated client and do 
not leak or partially publish directories.
   - [ ] Report refresh p95/p99, endpoint concurrency, allocations and impact 
on ongoing tool calls.
   - [ ] Retain serialized behavior if the improvement is within noise or 
lifecycle correctness cannot be maintained.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to