Storing a JDBC-based table in a catalog for direct use in Spark SQL

Hi all, I'm trying to figure out how to persist a table definition in a catalog that can be used from different sessions. Something along the lines of --- CREATE TABLE spark_catalog.default.test_table ( name string ) USING jdbc OPTIONS ( driver 'com.mysql.cj.jdbc.Driver'

Re: GraphFrames' ConnectedComponentSuite test 'two components and two dangling vertices' fails with OutOfMemoryError: Java heap space

Merged, thanks guys! Russ On Sun, Jan 12, 2025 at 2:23 PM Bjørn Jørgensen wrote: > I tested stuff in this PR > https://github.com/graphframes/graphframes/pull/477 and then I made this > PR https://github.com/graphframes/graphframes/pull/478 > > søn. 12. jan. 2025 kl. 23:10 skrev Ángel : > >> Hi