Re: Spark 1.6 (CDH 5.7) and Phoenix 4.7 (CLABS)

2016-06-27 Thread Benjamin Kim
e Cloudera Labs packaging of Apache Phoenix, you should > first seek help on the vendor-specific community forums, to ensure the issue > isn't specific to the vendor: > > http://community.cloudera.com/t5/Cloudera-Labs/bd-p/ClouderaLabs > > -busbey > > On 2016-06-27 15

Spark 1.6 (CDH 5.7) and Phoenix 4.7 (CLABS)

2016-06-27 Thread Benjamin Kim
Anyone tried to save a DataFrame to a HBase table using Phoenix? I am able to load and read, but I can’t save. >> spark-shell —jars >> /opt/cloudera/parcels/CLABS_PHOENIX/lib/phoenix/lib/phoenix-spark-4.7.0-clabs-phoenix1.3.0.jar,/opt/cloudera/parcels/CLABS_PHOENIX/lib/phoenix/phoenix-4.7.0-clab

Re: phoenix on non-apache hbase

2016-06-25 Thread Benjamin Kim
.com>> wrote: > >> is phoenix client also affect by this? or does phoenix server isolate the >> client? >> >> is it reasonable to expect a "stock" phoenix client to work against a custom >> phoenix server for cdh 5.x? (with of course the phoe

Re: phoenix on non-apache hbase

2016-06-12 Thread Benjamin Kim
: > >> is phoenix client also affect by this? or does phoenix server isolate the >> client? >> >> is it reasonable to expect a "stock" phoenix client to work against a custom >> phoenix server for cdh 5.x? (with of course the phoenix client and server

Re: phoenix on non-apache hbase

2016-06-09 Thread Benjamin Kim
tree/4.7-HBase-1.0-cdh5.5?files=1> > > > It's a personal project of mine, not something supported by the community. > Sounds like I should look at what to do with CDH 5.6 and 5.7. > > On Jun 9, 2016, at 7:37 PM, Benjamin Kim <mailto:bbuil...@gmail.com>> w

Re: phoenix on non-apache hbase

2016-06-09 Thread Benjamin Kim
This interests me too. I asked Cloudera in their community forums a while back but got no answer on this. I hope they don’t leave us out in the cold. I tried building it too before with the instructions here https://issues.apache.org/jira/browse/PHOENIX-2834. I could get it to build, but I coul

CDH 5.7.0

2016-05-16 Thread Benjamin Kim
Has anyone got Phoenix to work with CDH 5.7.0? I tried manually patching and building the project using https://issues.apache.org/jira/browse/PHOENIX-2834 as a guide. I followed the instructions to install the components detailed in the top se

Re: Spark Plugin Information

2016-04-09 Thread Benjamin Kim
oenix using JDBC, you should be able to take > the JDBC url, pop off the 'jdbc:phoenix:' prefix and use it as the 'zkUrl' > option. > > Josh > > On Fri, Apr 8, 2016 at 6:47 PM, Benjamin Kim <mailto:bbuil...@gmail.com>> wrote: > Hi Josh, > >

Re: Spark Plugin Information

2016-04-08 Thread Benjamin Kim
oenix project at large, you may find this > Docker image useful as a configuration reference: > https://github.com/jmahonin/docker-phoenix/tree/phoenix_spark > <https://github.com/jmahonin/docker-phoenix/tree/phoenix_spark> > > Good luck! > > Josh > > On Fri, Apr

Spark Plugin Information

2016-04-08 Thread Benjamin Kim
I want to know if there is a update/patch coming to Spark or the Spark plugin? I see that the Spark plugin does not work because HBase classes are missing from the Spark Assembly jar. So, when Spark does reflection, it does not look for HBase client classes in the Phoenix Plugin jar but only in

Spark Plugin Information

2016-04-08 Thread Benjamin Kim
I want to know if there is a update/patch coming to Spark or the Spark plugin? I see that the Spark plugin does not work because HBase classes are missing from the Spark Assembly jar. So, when Spark does reflection, it does not look for HBase client classes in the Phoenix Plugin jar but only in

Re: Problem Updating Stats

2016-03-19 Thread Benjamin Kim
36', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 1 row(s) in 0.0280 seconds Thanks, Ben > On Mar 15, 2016, at 11:59 PM, Ankit Singhal wrote: > > Yes it seems t

Re: Problem Updating Stats

2016-03-19 Thread Benjamin Kim
ld client to connect with it. > "Update statistics" command and guideposts will not work with old client > after upgradation to 4.7, you need to use the new client for such operations. > > On Wed, Mar 16, 2016 at 10:55 PM, Benjamin Kim <mailto:bbuil...@gmail.com>> wrot

Re: Problem Updating Stats

2016-03-18 Thread Benjamin Kim
t; command and guideposts will not work with old client > after upgradation to 4.7, you need to use the new client for such operations. > > On Wed, Mar 16, 2016 at 10:55 PM, Benjamin Kim <mailto:bbuil...@gmail.com>> wrote: > |

Problem Updating Stats

2016-03-15 Thread Benjamin Kim
When trying to run update status on an existing table in hbase, I get error: Update stats: UPDATE STATISTICS "ops_csv" ALL error: ERROR 504 (42703): Undefined column. columnName=REGION_NAME Looks like the meta data information is messed up, ie. there is no column with name REGION_NAME in this tabl

Re: Cloudera and Phoenix

2016-02-21 Thread Benjamin Kim
n on Cloudera without modifications (someone was doing unofficial > Phoenix/Cloudera releases but I'm not sure if they still are or not). > > > > On Sun, Feb 21, 2016 at 6:39 AM, Dor Ben Dov <mailto:dor.ben-...@amdocs.com>> wrote: > > Hi All, > >

Re: Spark Phoenix Plugin

2016-02-20 Thread Benjamin Kim
] https://issues.apache.org/jira/browse/SPARK-1867 > <https://issues.apache.org/jira/browse/SPARK-1867> > > On Fri, Feb 19, 2016 at 2:18 PM, Benjamin Kim <mailto:bbuil...@gmail.com>> wrote: > Hi Josh, > > When I run the following code in spark-shell for spark 1.6: >

Re: Spark Phoenix Plugin

2016-02-19 Thread Benjamin Kim
gt; haven't run into any problems: > https://github.com/jmahonin/docker-phoenix/tree/phoenix_spark > <https://github.com/jmahonin/docker-phoenix/tree/phoenix_spark> > > On Fri, Feb 19, 2016 at 12:40 PM, Benjamin Kim <mailto:bbuil...@gmail.com>> wrote: > Al

Re: Spark Phoenix Plugin

2016-02-19 Thread Benjamin Kim
4.7.0 using Spark 1.6? Thanks, Ben > On Feb 12, 2016, at 6:33 AM, Benjamin Kim wrote: > > Anyone know when Phoenix 4.7 will be officially released? And what Cloudera > distribution versions will it be compatible with? > > Thanks, > Ben > >> On Feb 10, 2

Re: Spark Phoenix Plugin

2016-02-12 Thread Benjamin Kim
Anyone know when Phoenix 4.7 will be officially released? And what Cloudera distribution versions will it be compatible with? Thanks, Ben > On Feb 10, 2016, at 11:03 AM, Benjamin Kim wrote: > > Hi Pierre, > > I am getting this error

Re: Spark Phoenix Plugin

2016-02-10 Thread Benjamin Kim
ck for building the artifacts from > https://github.com/chiastic-security/phoenix-for-cloudera > <https://github.com/chiastic-security/phoenix-for-cloudera>. Hopefully it > helps. > > Regards > Ravi . > > On Tue, Feb 9, 2016 at 10:04 AM, Benjamin Kim <mailto

Re: Spark Phoenix Plugin

2016-02-09 Thread Benjamin Kim
an wrote: > > Hi Pierre, > > Try your luck for building the artifacts from > https://github.com/chiastic-security/phoenix-for-cloudera > <https://github.com/chiastic-security/phoenix-for-cloudera>. Hopefully it > helps. > > Regards > Ravi . >

Re: Spark Phoenix Plugin

2016-02-09 Thread Benjamin Kim
issue/SPARK-1867> > On Tue, 9 Feb 2016, 04:58 Benjamin Kim <mailto:bbuil...@gmail.com>> wrote: > Pierre, > > I got it to work using phoenix-4.7.0-HBase-1.0-client-spark.jar. But, now, I > get this error: > > org.apache.spark.SparkException: Job aborted due to

Re: Spark Phoenix Plugin

2016-02-08 Thread Benjamin Kim
> > On Mon, 8 Feb 2016, 22:29 Benjamin Kim <mailto:bbuil...@gmail.com>> wrote: > Hi Josh, > > I tried again by putting the settings within the spark-default.conf. > > spark.driver.extraClassPath=/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar > spark.ex

Re: Spark Phoenix Plugin

2016-02-08 Thread Benjamin Kim
be a useful > reference for you as well [2]. > > Good luck, > > Josh > > [1] https://phoenix.apache.org/phoenix_spark.html > <https://phoenix.apache.org/phoenix_spark.html> > [2] https://github.com/jmahonin/docker-phoenix/tree/phoenix_spark > <https://github.

Re: Spark Phoenix Plugin

2016-02-08 Thread Benjamin Kim
Skellig House, Custom House, Lower Mayor street, Dublin 1, Ireland > Phone : +353879128708 > > On Fri, Feb 5, 2016 at 9:28 PM, Benjamin Kim <mailto:bbuil...@gmail.com>> wrote: > Hi Pierre, > > When will I be able to download this version? > > Thanks, >

Re: Spark Phoenix Plugin

2016-02-05 Thread Benjamin Kim
use, Custom House, Lower Mayor street, Dublin 1, Ireland > Phone : +353879128708 > > On Fri, Feb 5, 2016 at 6:17 PM, Benjamin Kim > wrote: > >> I cannot get this plugin to work in CDH 5.4.8 using Phoenix 4.5.2 and >> Spark 1.6. When I try to launch spark-she

Spark Phoenix Plugin

2016-02-05 Thread Benjamin Kim
I cannot get this plugin to work in CDH 5.4.8 using Phoenix 4.5.2 and Spark 1.6. When I try to launch spark-shell, I get: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient I continue on and run the