Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Furkan KAMACI
Hi Ted, You can check full stack trace log from the attachment at Jira: https://issues.apache.org/jira/browse/GORA-386 Kind Regards, Furkan KAMACI On Wed, Aug 26, 2015 at 6:55 PM, Ted Yu wrote: > My understanding is that people on this mailing list who are interested to > help can log comment

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Ted Yu
My understanding is that people on this mailing list who are interested to help can log comments on the GORA JIRA. HBase integration with Spark is proven to work. So the intricacies should be on Gora side. On Wed, Aug 26, 2015 at 8:08 AM, Furkan KAMACI wrote: > Btw, here is the source code of Go

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Furkan KAMACI
Btw, here is the source code of GoraInputFormat.java : https://github.com/kamaci/gora/blob/master/gora-core/src/main/java/org/apache/gora/mapreduce/GoraInputFormat.java 26 Ağu 2015 18:05 tarihinde "Furkan KAMACI" yazdı: > I'll send an e-mail to Gora dev list too and also attach my patch into my

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Furkan KAMACI
I'll send an e-mail to Gora dev list too and also attach my patch into my GSoC Jira issue you mentioned and then we can continue at there. Before I do that stuff, I wanted to get Spark dev community's ideas to solve my problem due to you may have faced such kind of problems before. 26 Ağu 2015 17:

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Ted Yu
I found GORA-386 Gora Spark Backend Support Should the discussion be continued there ? Cheers On Wed, Aug 26, 2015 at 7:02 AM, Ted Malaska wrote: > Where is the input format class. When every I use the search on your > github it says "We couldn’t find any issues matching 'GoraInputFormat'" >

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Ted Malaska
Where is the input format class. When every I use the search on your github it says "We couldn’t find any issues matching 'GoraInputFormat'" On Wed, Aug 26, 2015 at 9:48 AM, Furkan KAMACI wrote: > Hi, > > Here is the MapReduceTestUtils.testSparkWordCount() > > > https://github.com/kamaci/gora

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Furkan KAMACI
Hi, Here is the MapReduceTestUtils.testSparkWordCount() https://github.com/kamaci/gora/blob/master/gora-core/src/test/java/org/apache/gora/mapreduce/MapReduceTestUtils.java#L108 Here is SparkWordCount https://github.com/kamaci/gora/blob/8f1acc6d4ef6c192e8fc06287558b7bc7c39b040/gora-core/src/e

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Ted Malaska
Where can I find the code for MapReduceTestUtils.testSparkWordCount? On Wed, Aug 26, 2015 at 9:29 AM, Furkan KAMACI wrote: > Hi, > > Here is the test method I've ignored due to Connection Refused problem > failure: > > > https://github.com/kamaci/gora/blob/master/gora-hbase/src/test/java/org/apa

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Furkan KAMACI
Hi, Here is the test method I've ignored due to Connection Refused problem failure: https://github.com/kamaci/gora/blob/master/gora-hbase/src/test/java/org/apache/gora/hbase/mapreduce/TestHBaseStoreWordCount.java#L65 I've implemented a Spark backend for Apache Gora as GSoC project and this is th

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Ted Malaska
I've always used HBaseTestingUtility and never really had much trouble. I use that for all my unit testing between Spark and HBase. Here are some code examples if your interested --Main HBase-Spark Module https://github.com/apache/hbase/tree/master/hbase-spark --Unit test that cover all basic co

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Ted Yu
Can you log the contents of the Configuration you pass from Spark ? The output would give you some clue. Cheers > On Aug 26, 2015, at 2:30 AM, Furkan KAMACI wrote: > > Hi Ted, > > I'll check Zookeeper connection but another test method which runs on hbase > without Spark works without any

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Furkan KAMACI
Hi Ted, I'll check Zookeeper connection but another test method which runs on hbase without Spark works without any error. Hbase version is 0.98.8-hadoop2 and I use Spark 1.3.1 Kind Regards, Furkan KAMACI 26 Ağu 2015 12:08 tarihinde "Ted Yu" yazdı: > The connection failure was to zookeeper. > >

Re: Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Ted Yu
The connection failure was to zookeeper. Have you verified that localhost:2181 can serve requests ? What version of hbase was Gora built against ? Cheers > On Aug 26, 2015, at 1:50 AM, Furkan KAMACI wrote: > > Hi, > > I start an Hbase cluster for my test class. I use that helper class: >

Spark Cannot Connect to HBaseClusterSingleton

2015-08-26 Thread Furkan KAMACI
Hi, I start an Hbase cluster for my test class. I use that helper class: https://github.com/apache/gora/blob/master/gora-hbase/src/test/java/org/apache/gora/hbase/util/HBaseClusterSingleton.java and use it as like that: private static final HBaseClusterSingleton cluster = HBaseClusterSingleton.