[
https://issues.apache.org/jira/browse/CAMEL-21355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892723#comment-17892723
]
Otavio Rodolfo Piske edited comment on CAMEL-21355 at 10/25/24 9:13 AM:
------------------------------------------------------------------------
I presume you are talking about, let's say, if the user pass invalid characters
to the name of the function? Or is it something different? Can you please, give
an example of how we could make that happen with Camel? Considering that we do
not get that low level into the client API ...
Additionally, it's not just a malformed response that may cause the model to
decide not to invoke anything. A model is non-deterministic by design and it
may decide not to call a tool even if the request is well-formed. Considering
this and letting the user decide what they want to do in the absence of a tool
call response is a better compromise IMHO.
And, please, I am not arguing for the sake of arguing or because of
stubbornness, but I do need an specific and concrete scenario.
was (Author: orpiske):
I presume you are talking about, let's say, if the user pass invalid characters
to the name of the function? Or is it something different? Can you please, give
an example of how we could make that happen with Camel? Considering that we do
not get that low level into the client API ...
Additionally, it's not just a malformed response that may cause the model to
decide not to invoke anything. A model is non-deterministic by design and it
may decide not to call a tool even if the request is well-formed. Considering
this and letting the user decide what they want to do in the absence is a
better compromise IMHO.
And, please, I am not arguing for the sake of arguing or because of
stubbornness, but I do need an specific and concrete scenario.
> LangChain4j Tools fails with direct LLM response
> ------------------------------------------------
>
> Key: CAMEL-21355
> URL: https://issues.apache.org/jira/browse/CAMEL-21355
> Project: Camel
> Issue Type: Bug
> Components: camel-langchain4j-tools
> Affects Versions: 4.8.0
> Reporter: Bruno Meseguer
> Assignee: Otavio Rodolfo Piske
> Priority: Major
> Fix For: 4.8.2, 4.9.0
>
>
> The Tools component is designed to provide functions to the LLM. However the
> LLM may decide not to invoke any of the given tools.
> In that scenario, the LLM replies directly instead of requesting the
> execution of a tool/function. The Camel Tools components seems unable to
> handle such use case and throws an exception.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
