I also need good docs on this. Especially integrating pyspark with hive
reading tables from hbase.
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
I wrote a simple program to read data from HBase, the program works find in
Cloudera backed by HDFS. The program works fine on SPARK RUNTIME 1.6 on
Cloudera. But does NOT work on EMR with Spark Runtime 2.2.1.
But getting an exception while testing data on EMR with S3.
// Spark conf
Spar
Dear All,
Greetings !
I needed some best practices for integrating Spark
with HBase. Would you be able to point me to some useful resources / URL's
to your convenience please.
Thanks,
Debu
Hi Ram, Thanks very much it worked.
Puneet
From: ram kumar [mailto:ramkumarro...@gmail.com]
Sent: Thursday, July 07, 2016 6:51 PM
To: Puneet Tripathi
Cc: user@spark.apache.org
Subject: Re: Spark with HBase Error - Py4JJavaError
Hi Puneet,
Have you tried appending
--jars $SPARK_HOME/lib/spark
gt;
>
>
> *From:* Puneet Tripathi [mailto:puneet.tripa...@dunnhumby.com]
> *Sent:* Thursday, July 07, 2016 12:42 PM
> *To:* user@spark.apache.org
> *Subject:* Spark with HBase Error - Py4JJavaError
>
>
>
> Hi,
>
>
>
> We are running Hbase in fully distributed mode.
Guys, Please can anyone help on the issue below?
Puneet
From: Puneet Tripathi [mailto:puneet.tripa...@dunnhumby.com]
Sent: Thursday, July 07, 2016 12:42 PM
To: user@spark.apache.org
Subject: Spark with HBase Error - Py4JJavaError
Hi,
We are running Hbase in fully distributed mode. I tried to
Hi,
We are running Hbase in fully distributed mode. I tried to connect to Hbase via
pyspark and then write to hbase using saveAsNewAPIHadoopDataset , but it failed
the error says:
Py4JJavaError: An error occurred while calling
z:org.apache.spark.api.python.PythonRDD.saveAsHadoopDataset.
: java
ng the same. Can someone
> please guide me through the steps to accomplish this. Thanks a lot for
> Helping
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-with-HBase-tp20226.html
> Sent from t
ng the same. Can someone
> please guide me through the steps to accomplish this. Thanks a lot for
> Helping
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-with-HBase-tp20226.html
> Sent from the Apache Spark
You could go through these to start with
http://www.vidyasource.com/blog/Programming/Scala/Java/Data/Hadoop/Analytics/2014/01/25/lighting-a-spark-with-hbase
http://stackoverflow.com/questions/25189527/how-to-process-a-range-of-hbase-rows-using-spark
Thanks
Best Regards
On Wed, Dec 3, 2014 at
.n3.nabble.com/Spark-with-HBase-tp20226.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h
this two posts should be good for setting up spark+hbase environment and use
the results of hbase table scan as RDD
settings
http://www.abcn.net/2014/07/lighting-spark-with-hbase-full-edition.html
some samples:
http://www.abcn.net/2014/07/spark-hbase-result-keyvalue-bytearray.html
--
View
( the version is quiet old)
Attached is a piece of Code (Spark Java API) to connect to HBase.
Thanks
Best Regards
On Thu, Aug 7, 2014 at 1:48 PM, Deepa Jayaveer
wrote:
> Hi
> I read your white paper about " " . We wanted to do a Proof of Concept on
> Spark with HBase.
Hi
I read your white paper about " " . We wanted to do a Proof of Concept on
Spark with HBase. Documents
are not much available to set up the spark cluster in Hadoop 2
environment. If you have any,
can you please give us some reference URLs
Also, some sample program to connect to H
Hi,
I want to use Spark with HBase and I'm confused about how to ingest my data
using HBase' HFileOutputFormat. It recommends calling
configureIncrementalLoad which does the following:
- Inspects the table to configure a total order partitioner
- Uploads the partitions file to t
ll facing this issue...
> We could able to connect to HBase with independent code, but getting issue
> with Spark integration.
>
> Thx,
> Ravi
>
> --
> From: nvn_r...@hotmail.com
> To: u...@spark.incubator.apache.org; user@spark.apache.org
&g
Hi,
Any update on the solution? We are still facing this issue...
We could able to connect to HBase with independent code, but getting issue with
Spark integration.
Thx,
Ravi
From: nvn_r...@hotmail.com
To: u...@spark.incubator.apache.org; user@spark.apache.org
Subject: RE: Spark with HBase
+user@spark.apache.org
From: nvn_r...@hotmail.com
To: u...@spark.incubator.apache.org
Subject: Spark with HBase
Date: Sun, 29 Jun 2014 15:28:43 +0530
I am using follwoing versiongs ..
spark-1.0.0-bin-hadoop2
hbase-0.96.1.1-hadoop2
When executing Hbase Test , i am facing
I am using follwoing versiongs ..
spark-1.0.0-bin-hadoop2
hbase-0.96.1.1-hadoop2
When executing Hbase Test , i am facing following exception. Looks like some
version incompatibility, can you please help on it.
NERAVI-M-70HY:spark-1.0.0-bin-hadoop2 neravi$ ./bin/run-example
org.apache.spark.ex
> wrote:
>
>> Any one who has used spark this way or has faced similar issue, please
>> help.
>>
>> Thanks,
>> -Vibhor
>>
>>
>> On Wed, May 28, 2014 at 6:03 PM, Vibhor Banga
>> wrote:
>>
>>
Thanks,
> -Vibhor
>
>
> On Wed, May 28, 2014 at 6:03 PM, Vibhor Banga wrote:
>
>> Hi all,
>>
>> I am facing issues while using spark with HBase. I am getting
>> NullPointerException at org.apache.hadoop.hbase.TableName.valueOf
>> (TableName.java:288)
>>
Any one who has used spark this way or has faced similar issue, please help.
Thanks,
-Vibhor
On Wed, May 28, 2014 at 6:03 PM, Vibhor Banga wrote:
> Hi all,
>
> I am facing issues while using spark with HBase. I am getting
> NullPointerException at org.apache.hadoop.hbase.Table
Hi all,
I am facing issues while using spark with HBase. I am getting
NullPointerException at org.apache.hadoop.hbase.TableName.valueOf
(TableName.java:288)
Can someone please help to resolve this issue. What am I missing ?
I am using following snippet of code -
Configuration config
23 matches
Mail list logo
