Hey guys, Databricks released higher order functions as part of their runtime 3.0 beta (https://databricks.com/blog/2017/05/24/working-with-nested-data-using-higher-order-functions-in-sql-on-databricks.html), which helps working with array within SQL statements.
* As a heavy user of complex data types I was wondering if there was any plan to push those changes upstream? * In addition, I was wondering if as part of this change it also tries to solve the column pruning / filter pushdown issues with complex datatypes? Thanks! --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
