Ryan Thompson created BEAM-14208: ------------------------------------ Summary: Add batch_size back off in RunInferenceBase Key: BEAM-14208 URL: https://issues.apache.org/jira/browse/BEAM-14208 Project: Beam Issue Type: Sub-task Components: sdk-py-core Reporter: Ryan Thompson
Add batch_size back off in the case there are functional reasons large batch sizes cannot be handled. -- This message was sent by Atlassian Jira (v8.20.1#820001)