I have an external catalog that has additional information on my Parquet files
that I want to match up with the parsed filters from the plan to prune the list
of files included in the scan. I’m looking at doing this using the Spark 2.2.0
SparkSession extensions similar to the built in partition
Hi,
I've been working on this issue, and I would like to get your feedback on
the following approach. The idea is that instead of failing in
`TaskSetManager.abortIfCompletelyBlacklisted`, when a task cannot be
scheduled in any executor but dynamic allocation is enabled, we will
register this task
