pyspark python exceptions / py4j exceptions

[Patrick Donovan]

Hello,

I'm trying to write a python function that does something like:

def foo(line):
    try:
        return stuff(line)
    except Exception:
        raise MoreInformativeException(line)

and then use it in a map like so:

rdd.map(foo)

and have my MoreInformativeException make it back if/when something goes
wrong, but all I can get back are errors like:

Py4JJavaError(u'An error occurred while calling o50.saveAsTextFile.\n',
JavaObject id=o51)

Is there any way to recover my MoreInformativeException back in python
land? If I reach into java via py4j can I get it back somehow? If so, how?

Thanks!