Re: Read from HBase flink-0.9.0-milestone-1-bin-hadoop2

2015-05-29 Thread Hilmi Yildirim
I solved the problem. The problem was that I created an HBase table only on 1 machine. 13 machines requested data from this sigle machine which lead to a bottleneck. Now, I have split the table on 13 machines and it is working now. It continues to throw UnknownScannerExceptions but it is workin

Re: Read from HBase flink-0.9.0-milestone-1-bin-hadoop2

2015-05-28 Thread Flavio Pompermaier
The unknown scanner exception is just a warning due to the fact that the table scan is not eager but lazy..so between two consecutive getNextRecord() call the Habase server timeouts the scanner resource's..In the house extension I just recreate the scanner from the last read key. This is a worka

Re: Read from HBase flink-0.9.0-milestone-1-bin-hadoop2

2015-05-28 Thread Stephan Ewen
Can you look into the Flink and HBase logs if it locks some exception there? On Thu, May 28, 2015 at 10:24 AM, Hilmi Yildirim wrote: > Hi, > I also tried to read from HBase using the > flink-0.9.0-milestone-1-bin-hadoop2 version. It works great and it uses the > config declared in the hbase-si

Read from HBase flink-0.9.0-milestone-1-bin-hadoop2

2015-05-28 Thread Hilmi Yildirim
Hi, I also tried to read from HBase using the flink-0.9.0-milestone-1-bin-hadoop2 version. It works great and it uses the config declared in the hbase-site.xml. I configured a flink cluster with 2 machines. For that I deployed the flink folder with the corresponding configurations on each mac