Re: Custom JdbcConnectionProvider

2020-10-28 Thread rafaelkyrdan
Thank you Gabor Somogyi for highlighting the issue. I cannot compile the example because 3.1.0-SNAPSHOT is not available in maven. What resolvers do you use? I tried one which suggested in SBT documentation SBT documentation b

Re: Custom JdbcConnectionProvider

2020-10-28 Thread rafaelkyrdan
I cloned your example and it is also cannot be compiled [ERROR] C:\Users\Rafael_Kyrdan\projects\spark-jdbc-connection-provider\src\main\scala\com\spark\ExampleJdbcConnectionProvider.scala:23: error

Re: Custom JdbcConnectionProvider

2020-10-28 Thread rafaelkyrdan
Thank you for a quick response. Your example is clear but I wasn't able to extend *JdbcConnectionProvider * in my application. I'm getting compile errors: /[error] C:\Users\Rafael_Kyrdan\projects\tdm_engine2\src\main\scala\com\tdm\engine\connection\BasicConnectionProvider.scala:10:39: not found:

Custom JdbcConnectionProvider

2020-10-27 Thread rafaelkyrdan
Guys do you know how I can use the custom implementation of JdbcConnectionProvider? As far as I understand in the spark jdbc we can use custom Driver, like this: *val jdbcDF = spark.read .format("jdbc") .option("url", "jdbc:postgresql:dbserver").option("driver", "my.drivier") * And we need a m

Re: How to migrate DataSourceV2 into Spark 3.0.0

2020-10-25 Thread rafaelkyrdan
Sorry for late response. I was able to migrate my project to Spark 3.0.0 Here some hints what I did: https://gist.github.com/rafaelkyrdan/2bea8385aadd71be5bf67cddeec59581 -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com