Re: Spark Hbase job taking long time

2014-08-12 Thread Amit Singh Hora
Hi , Today i created a table with 3 regions and 2 jobtrackers but still the spark job is taking lot of time I also noticed one thing that is the memory of client was increasing linearly is it like spark job was first bringing the complete data in memory? On Thu, Aug 7, 2014 at 7:31 PM, Ted Yu [vi

Re: Spark Hbase job taking long time

2014-08-07 Thread Ted Yu
Forgot to include user@ Another email from Amit indicated that there is 1 region in his table. This wouldn't give you the benefit TableInputFormat is expected to deliver. Please split your table into multiple regions. See http://hbase.apache.org/book.html#d3593e6847 and related links. Cheers