epugh commented on PR #158: URL: https://github.com/apache/solr-mcp/pull/158#issuecomment-5334080277
> Fiddled with the tool mcp-assert (https://github.com/blackwell-systems/mcp-assert) and these commands will assert the list-collections tool: > > ```shell > JAR="./build/libs/solr-mcp-1.0.0-SNAPSHOT.jar" > export SOLR_URL="http://localhost:8983/solr/"; > > mkdir -p "evals" > > cat > "evals/list-collections.yaml" <<YAML > name: list-collections returns the two seeded collections > server: > command: "java" > args: ["-jar", "$JAR"] > assert: > tool: list-collections > args: {} > expect: > not_error: true > not_empty: true > contains: ["books", "films"] > not_contains: ["nonexistent"] > min_results: 2 > timeout: 30s > YAML > > npx -y @blackwell-systems/mcp-assert run --suite "$REPO/evals/" > ``` > > The tool can also do an automated "audit", listing tools and checking that they are ok (read only) > > ```shell > npx -y @blackwell-systems/mcp-assert audit --server "java -jar ./build/libs/solr-mcp-1.0.0-SNAPSHOT.jar" > ``` This is cool, but I think we have all of this in the integration tests that do the same thing? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
