, January 06, 2015 1:12 PM
To: Max Xu
Cc: user@spark.apache.org
Subject: Re: Saving data to Hbase hung in Spark streaming application with
Spark 1.2.0
I doubt anyone would deploy hbase 0.98.x on hadoop-1
Looks like hadoop2 profile should be made the default.
Cheers
On Tue, Jan 6, 2015 at 9:49 AM
8.7-hadoop1
>
>
>
>
>
>
>
> *From:* Ted Yu [mailto:yuzhih...@gmail.com]
> *Sent:* Tuesday, January 06, 2015 12:39 PM
> *To:* Max Xu
> *Cc:* user@spark.apache.org
> *Subject:* Re: Saving data to Hbase hung in Spark streaming application
> with Spark 1.2.0
>
0.98.7-hadoop1
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Tuesday, January 06, 2015 12:39 PM
To: Max Xu
Cc: user@spark.apache.org
Subject: Re: Saving data to Hbase hung in Spark streaming application with
Spark 1.2.0
Default profile is hbase-hadoop1 so you need to specify
away. I’ll try to run
> the app again after rebuild Spark 1.2.0 with 0.98.8-hadoop2.
>
>
>
> *From:* Ted Yu [mailto:yuzhih...@gmail.com]
> *Sent:* Tuesday, January 06, 2015 11:56 AM
> *To:* Max Xu
> *Cc:* user@spark.apache.org
> *Subject:* Re: Saving data to Hbase hung in S
: user@spark.apache.org
Subject: Re: Saving data to Hbase hung in Spark streaming application with
Spark 1.2.0
I assume hbase-site.xml is in the classpath.
Can you try the code snippet in standalone program to see if the problem
persists ?
Cheers
On Tue, Jan 6, 2015 at 6:42 AM, Max Xu
I assume hbase-site.xml is in the classpath.
Can you try the code snippet in standalone program to see if the problem
persists ?
Cheers
On Tue, Jan 6, 2015 at 6:42 AM, Max Xu wrote:
> Hi all,
>
>
>
> I have a Spark streaming application that ingests data from a Kafka topic
> and persists rece
Hi all,
I have a Spark streaming application that ingests data from a Kafka topic and
persists received data to Hbase. It works fine with Spark 1.1.1 in YARN cluster
mode. Basically, I use the following code to persist each partition of each RDD
to Hbase:
@Override
void call(It
