Ángel Álvarez Pascua created SPARK-51264:
--------------------------------------------
Summary: JDBC write keeps driver connection open unnecessarily
Key: SPARK-51264
URL: https://issues.apache.org/jira/browse/SPARK-51264
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.5.0, 3.4.0, 3.3.0, 3.2.0, 3.1.0, 3.0.0, 2.4.0, 2.3.0,
2.2.0, 2.1.0, 4.0.0
Reporter: Ángel Álvarez Pascua
A JDBC connection is created in
{{org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider}} to
truncate, drop, or create the table. However, this connection remains open and
idle throughout the entire save process, which can last minutes or hours.
This causes unnecessary resource consumption on both the Spark driver and the
database. Additionally, the idle connection is at risk of being dropped by the
database, firewall, or proxy. Best practices recommend releasing resources as
soon as they are no longer needed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
