Hi, Lucas. There was a lot of refactoring in the Table API / SQL in the last release, so the user experience is not ideal at the moment — sorry for that.
You can try using the DDL syntax to create your table, as shown in [1,2]. I'm CC'ing Timo and Jark, who should be able to help you further. Marta [1] https://flink.apache.org/news/2020/02/20/ddl.html [2] https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/create.html On Tue, Apr 21, 2020 at 7:02 PM Lucas Kinne < lucas.ki...@stud-mail.uni-wuerzburg.de> wrote: > Hey guys, > > in a university project we are storing our collected sensor data in an > OpenTSDB > <http://opentsdb.net/>database. > I am now trying to use this database as a source in Apache Flink, but I > can't seem to figure out how to do it. > > I have seen that there is no existing connector for this Database, but I > read in the docs > <https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/sourceSinks.html> > that is is possible to implement a custom (Batch/Streaming)TableSource. > There is a Java client for OpenTSDB > <http://opentsdb.net/docs/javadoc/net/opentsdb/core/TSDB.html>, which > could be used for that. > > So I created a new Java Class "OpenTSDBTableSource" that implements > "StreamTableSource", "DefinedProctimeAttribute", "DefinedRowtimeAttribute" > and "LookupableTableSource", as suggested in the docs. > However, I have no idea how to register this TableSource. The > "StreamExecutionEnvironment.addSource" requires a "SourceFunction" > parameter instead of my "TableSource" and the > "StreamTableEnvironment.registerTableSource"-Method is deprecated. There is > a link to the topic "register a TableSource" on linked docs page, but the > link seems to be dead, hence I found no other method on how to register a > TableSource. > > I could also write a "SourceFunction" myself, pull the OpenTSDB database > in there and return the DataStream from the fetched Collection, but I am > not sure whether this is an efficient way. > And if I did it this "manual" way, how do I avoid pulling the whole > database everytime? > > Any help is much appreciated, even if it is just a small pointer to the > right direction. > > Thanks in advance! > > Sincerely, > Lucas >
