sahithreddy05 commented on issue #464: URL: https://github.com/apache/flink-agents/issues/464#issuecomment-4912243222
Hi, I'd like to work on this one. I looked at main and the Setup defaults are actually already the same on both sides (gpt-3.5-turbo, temperature 0.1, etc). The mismatch is in the connection: python defaults timeout to 60s and max_retries to 3, but the java connections only set these when the user passes them explicitly, so otherwise you just get whatever the openai-java SDK defaults to. The Azure connection has the same problem. My plan is to add a small shared class with the two defaults (60 / 3, same as python) and use it from both connections, plus tests. I have it working locally already, it's a pretty small diff. Two questions: 1. Is it ok to fix the Azure connection in the same PR since it's the same bug in the same module, or do you want a separate issue for that? 2. Python raises on negative values but the java side currently documents that out-of-range values are ignored. I kept the ignore behavior to not change anything, but can switch it to raising if you'd rather have them fully consistent. Also noticed timeout is a float in python but read as Integer in java, so fractional timeouts don't work on the java side. Can file that separately if useful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
