sollhui opened a new pull request, #65553:
URL: https://github.com/apache/doris/pull/65553

   ### What problem does this PR solve?
   
   PR #55666 added the first data quality error to load responses, but Routine 
Load was not covered. Routine Load transaction attachments only propagated the 
error log URL, so users still had to open the URL to inspect the actual error.
   
   Routine Load tasks may also succeed with filtered rows when the configured 
error thresholds are not exceeded. Previously, the first error message was only 
saved when task execution failed, causing it to be lost for successful tasks 
containing filtered data.
   
   This PR:
   
   - Captures the first data quality error for both successful and failed 
Routine Load tasks.
   - Propagates `first_error_msg` through the Routine Load Thrift transaction 
attachment.
   - Preserves the field through the cloud protobuf transaction attachment.
   - Appends the first error message after the corresponding URL in `SHOW 
ROUTINE LOAD` output.
   - Adds `FIRST_ERROR_MSG` to `information_schema.routine_load_jobs`.
   - Adds a Kafka regression test covering a successful Routine Load task 
containing both valid and filtered rows.
   
   Example `ErrorLogUrls` output:
   
   ```text
   http://127.0.0.1:8040/api/_load_error_log?file=xxx. first_error_msg: no 
partition for this tuple. Src line: 100|bad_row
   ```
   
   The first error can also be queried directly:
   ```
   SELECT ERROR_LOG_URLS, FIRST_ERROR_MSG
   FROM information_schema.routine_load_jobs
   WHERE JOB_NAME = 'job_name';
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to