Thanks Xuyang for your answer. I, however, can't find a way to create a filesystem catalog except by using Hive which seems to require an external Hive installation. I was hoping to find a solution that doesn't require external dependencies. Is that possible?
Vinay On Thu, Dec 26, 2024 at 10:30 PM Xuyang <xyzhong...@163.com> wrote: > Hi. > > In Java/Scala code, using `registerTable` and then querying in the SQL > client will not work, as registerTable only creates a temporal table. > > To fulfill your requirements, you may need to use a persistent catalog[1] > (such as a filesystem catalog) where you can create tables in your > Java/Scala code. Once the table is created under that catalog, you can then > query it from the SQL client within the same catalog[2]. For example: > > To avoid creating and using the same catalog twice in both Java/Scala code > and the SQL client, you can leverage a catalog store(In higher versions > only)[3]. > > [1] > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/catalogs/#using-java-scala-or-python > > [2] > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/catalogs/#using-sql-ddl > > [3] > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/catalogs/#catalog-store > > > -- > Best！ > Xuyang > > > At 2024-12-27 01:28:38, "Vinay Agarwal" <vink...@gmail.com> wrote: > > Hello, > > I am looking for an elaboration, or work around, of an old answer to this > question here ( > https://stackoverflow.com/questions/56049472/create-sql-table-from-a-datastream-in-a-java-scala-program-and-query-it-from-sql) > which mentions that registering the table can make it visible to the SQL > client. > > I am using Flink 1.8.1 with Java 11. I downloaded Flink 1.8.1 bundle, put > its `bin` folder in path, and started the cluster using `start-cluster.sh`. > > I created a simple Flink job that generates stream of random integers and > creates a table as follows: > > ```Java > final StreamExecutionEnvironment env = > StreamExecutionEnvironment.getExecutionEnvironment(); > StreamTableEnvironment tableEnv = StreamTableEnvironment.create(env); > // Create a DataStream of random integers > DataStream<Integer> intStream = env.addSource(new > RandomIntegerSource()); > // Convert DataStream to Table > Table table = tableEnv.fromDataStream(intStream, "number"); > // Register the table > tableEnv.registerTable("RandomNumbers", table); > // Execute the job > env.execute("Random Integer Job"); > > ``` > Then, I started `sql-client.sh` and queried as follows > ```SQL > Flink SQL> show catalogs; > +-----------------+ > | catalog name | > +-----------------+ > | default_catalog | > +-----------------+ > 1 row in set > > Flink SQL> USE CATALOG default_catalog; > [INFO] Execute statement succeed. > > Flink SQL> SHOW databases; > +------------------+ > | database name | > +------------------+ > | default_database | > +------------------+ > 1 row in set > > Flink SQL> USE default_database; > [INFO] Execute statement succeed. > > Flink SQL> SHOW tables; > Empty set > ``` > As can be seen, I don't see `RandomNumbers` table. > > How can I make that table visible to SQL client? > >
