[ 
https://issues.apache.org/jira/browse/SPARK-46518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

melin updated SPARK-46518:
--------------------------
    Attachment: image-2023-12-27-09-44-19-292.png

> Support for copy from write compatible postgresql databases (pg, redshift, 
> snowflake, gauss)
> --------------------------------------------------------------------------------------------
>
>                 Key: SPARK-46518
>                 URL: https://issues.apache.org/jira/browse/SPARK-46518
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 4.0.0
>            Reporter: melin
>            Priority: Major
>         Attachments: image-2023-12-27-09-44-19-292.png
>
>
> Now many databases are compatible with pg syntax and support copy from 
> syntax. The copy form import performance is 10 times higher than that of jdbc 
> batch.
> [https://github.com/melin/datatunnel/blob/master/connectors/jdbc/src/main/scala/com/superior/datatunnel/plugin/jdbc/support/CopyHelper.scala]
> Supports upsert data import: 
> [https://github.com/melin/datatunnel/blob/master/connectors/jdbc/src/main/scala/com/superior/datatunnel/plugin/jdbc/support/DataTunnelJdbcRelationProvider.scala]
> !image-2023-12-27-09-43-01-529.png!
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to