Actually it's not so simple, as the line is randomly corrupted and
almost doesn't look twice the same.
I already tried to clean up the json before using JsonImport, but it's
almost impossible to use a general rule.
I would prefer to find a way to prevent this to happen, since it doesn't
happen in Terminal. So it looks like something specific to the shell
command
in LC.
For the record, I have tried with different models in LM Studio and the
problem is the same. However, I am using the same technique with the
OpenAI
API and I don't have the problem. So I suspect there is something
specific
happening when using the shell command with a local server.
Le 2024-12-30 12:11, Bob Sneidar via use-livecode a écrit :
If you are parsing in LC, you can get the first word of each line. Now
if the text returned actually contains a line break in the second line
that is producing the erroneous third line, you may have to test the
range of each line.
Bob S
On Dec 30, 2024, at 8:13 AM, jbv via use-livecode
<use-livecode@lists.runrev.com> wrote:
Hi list,
Long story short : I am using LM Studio as a local server to send
requests to an LLM model.
I use the shell command in LC 9.6 with curl on MacOS Sequoia 15.1.1.
The request looks like that :
curl http://127.0.0.1:1234/v1/embeddings \
-H "Content-Type: application/json" \
-d '{
"model": "text-embedding-granite-embedding-278m-multilingual",
"input": "some text"
}'
The response is a json file with a list of vectors.
When I execute the command in Terminal, everything works fine.
But when I use "put shell(tcurl) into myjson" in a LC script,
I get the same result, except for a line that is inserted in the
middle of the json and looks like that :
...
0.01324639841914177,
0.085932932794094
100 23374 100 23264 100 110 873k 4227 --:--:-- --:--:--
--:--:-- 913k
09,
-0.020998964086174965,
...
instead of
...
0.01324639841914177,
0.08593293279409409,
-0.020998964086174965,
...
Because of that I can't parse the json and I get an error with
JsonImport.
What am I doing wrong ?
How can I fix it ?
Thank you in advance
jbv
_______________________________________________
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your
subscription preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode
_______________________________________________
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your
subscription preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode
_______________________________________________
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode
