Hi,
I've been playing with LocalTableScanExec and noticed that it
defines numOutputRows metric, but I couldn't find it in the diagram in web
UI's Details for Query in SQL tab. Why?
scala> spark.version
res1: String = 2.3.0-SNAPSHOT
scala> val hello = udf { s: String => s"Hello $s" }
hello: org.apache.spark.sql.expressions.UserDefinedFunction =
UserDefinedFunction(<function1>,StringType,Some(List(StringType)))
scala> Seq("Jacek").toDF("name").select(hello($"name")).show
+-----------+
| UDF(name)|
+-----------+
|Hello Jacek|
+-----------+
http://localhost:4040/SQL/execution/?id=0 shows no metrics for
LocalTableScan. Is this intended?
Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski
