Hello everyone, Currently when using Dataflow, Stackdriver Logs are essentially the first and last line of defence for debugging a job. After a burst of exceptions, stacktraces are actually dropped and finding the source of an error quickly devolves into finding a needle in a haystack.
We should provide an API to register a callback for handling uncaught exceptions to enable reporting them to services such as Airbrake, Stackdriver Error Reporting, Sentry, Bugsnag, etc. Google Doc for discussion: https://docs.google.com/document/d/1o2VXwCL97k3G-1BR9RSKNc6XtJTIA6SEKPMne91S67Y/edit?usp=sharing