Gérald Quintana created SPARK-38915:
---------------------------------------

             Summary: Log executed SQL queries
                 Key: SPARK-38915
                 URL: https://issues.apache.org/jira/browse/SPARK-38915
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.2.1
            Reporter: Gérald Quintana


When Spark issues an SQL query to the database through JDBC, log (at debug or 
info level) this query in order to be able to grab it. This is useful to check 
the performance of this query, running a SQL explain plan with the appropriate 
tool.
As SQL queries are sometimes generated, it is sometimes hard to predict what 
query Spark will sent to the database.

Example: I would like to watch this query 
[https://github.com/apache/spark/blob/v3.2.1/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala#L352]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to