fyi, on related subject, I tested the MIT integration test problems with open AI chatGPT last summer. It did not do well. Here is the result
https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/test_cases/11_MIT//reportchapter1.htm The result of solved % on this one file only (over 300 integration problems) were Mathematica 99.38% Fricas96.57% Maple 95.33% Rubi 94.08% Maxima 92.52% Giac 91.59% Mupad 90.03% Sympy 82.24% ChatGPT 14.33% You can see the actual output of each integration problem by following the links at https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/test_cases/11_MIT//reportchapter3.htm I do not know if google AI will be better than chatGPT, as I never tried it. --Nasser On Friday, December 15, 2023 at 4:41:46 AM UTC-6 [email protected] wrote: > Google has put their AI online. It seems that this would be useful for > testing. It would also be useful in cases where we didn't know the > correct symbolic response. > > This could easily be connected using either an external connection > similar to the Sage work or just making an external CURL function > call and parsing the JSON for the result. > > If you visit ai.google.dev you can sign up to use their AI software. > > Once you sign up for a developer's key you can send HTML requests > and receive JSON responses. It seems to know symbolic mathematics. > For example I tried: > > curl \ -H 'Content-Type: application/json' \ -d '{ "prompt": { "text": > "Integrate sin(x)"} }' \ " > https://generativelanguage.googleapis.com/v1beta3/models/text-bison-001:generateText?key=YOUR_API_KEY > " > > and got the following response > > { > "candidates": [ > { > "output": "dx -cos(x)+C", > "safetyRatings": [ > { > "category": "HARM_CATEGORY_DEROGATORY", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_TOXICITY", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_VIOLENCE", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_SEXUAL", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_MEDICAL", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_DANGEROUS", > "probability": "NEGLIGIBLE" > } > ] > } > ] > } > > I even tried plots: > > curl \ > -H 'Content-Type: application/json' \ > -d '{ "prompt": { "text": "plot sin(x) for x between 0 and pi"} }' \ > " > https://generativelanguage.googleapis.com/v1beta3/models/text-bison-001:generateText?key=YOUR_API_KEY > " > > > > { > "candidates": [ > { > "output": "```\nimport numpy as np\nimport matplotlib.pyplot as > plt\n\n# Define the range of x-values\nx = np.linspace(0, np.pi, 100)\n\n# > Compute the sin(x) values\ny = np.sin(x)\n\n# Plot the sin(x) > values\nplt.plot(x, y)\nplt.show()\n```\n\nOutput:\n\n", > "safetyRatings": [ > { > "category": "HARM_CATEGORY_DEROGATORY", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_TOXICITY", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_VIOLENCE", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_SEXUAL", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_MEDICAL", > "probability": "NEGLIGIBLE" > }, > { > "category": "HARM_CATEGORY_DANGEROUS", > "probability": "NEGLIGIBLE" > } > ] > } > ] > } > -- You received this message because you are subscribed to the Google Groups "FriCAS - computer algebra system" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/fricas-devel/0141b926-d7a1-4ced-ba56-2617307eb650n%40googlegroups.com.
