How to change the attributes order in Apache SparkSQL `Project` operator ?

2018-02-04 Thread parana
See below my queryExecution.optimizedPlan before apply my Rule.01 Project [x#9, p#10, q#11, if (isnull(q#11)) null else UDF(q#11) AS udfB_10#28, if (isnull(p#10)) null else UDF(p#10) AS udfA_99#93]02 +- InMemoryRelation [x#9, p#10, q#11], true, 1, StorageLevel(disk, memory, deserialized, 1 repl

How to change the attributes order in Apache SparkSQL `Project` operator ?

2018-02-04 Thread parana
See below my queryExecution.optimizedPlan before apply my Rule. 01 Project [x#9, p#10, q#11, if (isnull(q#11)) null else UDF(q#11) AS udfB_10#28, if (isnull(p#10)) null else UDF(p#10) AS udfA_99#93]02 +- InMemoryRelation [x#9, p#10, q#11], true, 1, StorageLevel(disk, memory, deserialized, 1 rep

Re: How to change the attributes order in Apache SparkSQL `Project` operator ?

2018-02-10 Thread parana
Additionally I include a question in StackOverflow to add more details. https://stackoverflow.com/questions/48612353/how-to-change-the-attributes-order-in-apache-sparksql-project-operator

Re: How to change the attributes order in Apache SparkSQL `Project` operator ?

2018-02-20 Thread parana
Resolved using information from this post https://developer.ibm.com/code/2017/11/30/learn-extension-points-apache-spark-extend-spark-catalyst-optimizer/ -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ ---