Re: Flink application with HBase

2015-12-30 Thread Stephan Ewen
The OutputFormats (such as the HBaseOutputFormat) come originally from the DataSet API. The work with DataStream, but the main difference to the SinkFunction is that have no way to let you implement custom checkpointing hooks. Since sinks interact with the outside works (side effect), they are by

Re: Flink application with HBase

2015-12-22 Thread Márton Balassi
Hi Thomas, You can use both of the suggested solutions. The benefit that you might get from HBaseOutputformat that it is already tested and integrated with Flink as opposed to you having to connect to HBase in a general SinkFunction. Best, Marton On Dec 22, 2015 1:04 PM, "Thomas Lamirault" wro

Flink application with HBase

2015-12-22 Thread Thomas Lamirault
Hello everybody, I am using Flink (0.10.1) with a streaming source (Kafka) , and I write results of flatMap/keyBy/timeWindow/reduce to a HBase table. I have try with a class (Sinkclass) who implements SinkFunction, and a class (HBaseOutputFormat) who implements OutputFormat. For you, it's bett