carloea2 opened a new issue, #8233: URL: https://github.com/apache/texera/issues/8233
### Current behavior `MainLoop._process_data_element` catches per-element runtime failures and writes only a worker log. It never updates the exception manager, so failed rows can disappear from a batch while the workflow continues and may report success with a short result. Before: row processing fails -> worker log only -> workflow can complete with missing rows After: row processing fails -> exception is reported -> remaining batch rows are attempted -> worker enters exception handling ### Steps to reproduce Process a two-row `DataElement` while making input statistics update raise for each row. Both rows are attempted, but the exception manager remains empty. Observed on `70c21145887920528d7d5540e3fb790b43e8b759`: ```text attempted_rows=[0, 1] logged_failures=2 exception_manager_has_exception=False ``` The focused regression failed with: ```text assert main_loop.context.exception_manager.has_exception() E assert False ``` ### Expected behavior Every per-element runtime failure should use the normal exception reporting path so the workflow cannot silently succeed with missing output rows. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
