Hi Som, You can have a look at ths documentation: https://ci.apache.org/projects/flink/flink-docs-master/dev/table/common.html#create-a-tableenvironment It describe how to create differnet TableEnvironments based on EnvironmentSettings. EnvironmentSettings is a setting to setup a table's environment. ExecutionEnvironment is the entry point of DataSet, and StreamExecutionEnvironment is the entry point of DataStream. So they have nothing to do with EnvironmentSettings.
Hi Lucas, I'm sorry that the documentation misses the piece of how to develop connectors for SQL DDL. The docs will be refined once the new connector API is ready before 1.11 release. If you want to develop a OpenTSDB source for SQL DDL, you should also develop a factory implements TableSourceFactory, and add the full class path into `META_INF/services/org.apache.flink.table.factories.TableFactory` file to make it can be discovered by framework. You can take `KafkaTableSourceSinkFactory` [1] as an example. Please let me know if you have other problems. Best, Jark [1]: https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/KafkaTableSourceSinkFactory.java On Wed, 22 Apr 2020 at 17:51, Som Lima <somplastic...@gmail.com> wrote: > For sake of brevity the code example does not show the complete code for > setting up the environment using EnvironmentSettings class > > EnvironmentSettings settings = EnvironmentSettings.newInstance()... > > > As you can see comparatively the same protocol is not followed when > showing setting up the environment. > > > StreamExecutionEnvironment env = > StreamExecutionEnvironment.getExecutionEnvironment(); > > or > > ExecutionEnvironment env = > ExecutionEnvironment.getExecutionEnvironment();BatchTableEnvironment tEnv = > BatchTableEnvironment.create(env); > > or > > ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); > > Is there a complete code somewhere ? > Please give me link. > > > [2] > https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/create.html > > > On Wed, 22 Apr 2020, 09:36 Marta Paes Moreira, <ma...@ververica.com> > wrote: > >> Hi, Lucas. >> >> There was a lot of refactoring in the Table API / SQL in the last >> release, so the user experience is not ideal at the moment — sorry for >> that. >> >> You can try using the DDL syntax to create your table, as shown in [1,2]. >> I'm CC'ing Timo and Jark, who should be able to help you further. >> >> Marta >> >> [1] https://flink.apache.org/news/2020/02/20/ddl.html >> [2] >> https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/create.html >> >> On Tue, Apr 21, 2020 at 7:02 PM Lucas Kinne < >> lucas.ki...@stud-mail.uni-wuerzburg.de> wrote: >> >>> Hey guys, >>> >>> in a university project we are storing our collected sensor data in an >>> OpenTSDB >>> <http://opentsdb.net/>database. >>> I am now trying to use this database as a source in Apache Flink, but I >>> can't seem to figure out how to do it. >>> >>> I have seen that there is no existing connector for this Database, but I >>> read in the docs >>> <https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/sourceSinks.html> >>> that is is possible to implement a custom (Batch/Streaming)TableSource. >>> There is a Java client for OpenTSDB >>> <http://opentsdb.net/docs/javadoc/net/opentsdb/core/TSDB.html>, which >>> could be used for that. >>> >>> So I created a new Java Class "OpenTSDBTableSource" that implements >>> "StreamTableSource", "DefinedProctimeAttribute", "DefinedRowtimeAttribute" >>> and "LookupableTableSource", as suggested in the docs. >>> However, I have no idea how to register this TableSource. The >>> "StreamExecutionEnvironment.addSource" requires a "SourceFunction" >>> parameter instead of my "TableSource" and the >>> "StreamTableEnvironment.registerTableSource"-Method is deprecated. There is >>> a link to the topic "register a TableSource" on linked docs page, but the >>> link seems to be dead, hence I found no other method on how to register a >>> TableSource. >>> >>> I could also write a "SourceFunction" myself, pull the OpenTSDB database >>> in there and return the DataStream from the fetched Collection, but I am >>> not sure whether this is an efficient way. >>> And if I did it this "manual" way, how do I avoid pulling the whole >>> database everytime? >>> >>> Any help is much appreciated, even if it is just a small pointer to the >>> right direction. >>> >>> Thanks in advance! >>> >>> Sincerely, >>> Lucas >>> >>
