Re: Spark SQL Thriftserver with HBase

e response times are just too long. Thanks, Ben On Oct 8, 2016, at 10:53 AM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: Ben, I'm not sure I'm following completely. Is your goal to use Spark to create or access tables in HBASE? If so the link below and several pac

Re: Spark SQL Thriftserver with HBase

:47 AM, Mich Talebzadeh >>>> wrote: >>>> >>>> Like any other design what is your presentation layer and end users? >>>> >>>> Are they SQL centric users from Tableau background or they may use >>>> spark functional programming. &

Re: Spark SQL Thriftserver with HBase

t;> monetary damages arising from such loss, damage or destruction. >>>>>>>>> >>>>>>>>> >>>>>>>>>> On 8 October 2016 at 20:15, Benjamin Kim wrote: >>>>>>>>>> Mich,

Re: Spark SQL Thriftserver with HBase

Without naming specifics, there are at least 4 or 5 different implementations of HBASE sources, each at varying level of development and different requirements (HBASE release version, Kerberos support etc) _____________ From: Benjamin Kim mailto:bbuil...@gmail.

Re: Spark SQL Thriftserver with HBase

a...@gmail.com>>, Felix Cheung mailto:felixcheun...@hotmail.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Subject: Re: Spark SQL Thriftserver with HBase Instead of (or additionally to) saving results somewhere, you just star

Re: Spark SQL Thriftserver with HBase

mailto:felixcheun...@hotmail.com>> wrote: I wouldn't be too surprised Spark SQL - JDBC data source - Phoenix JDBC server - HBASE would work better. Without naming specifics, there are at least 4 or 5 different implementations of HBASE sources, each at varying level of develo

Re: Spark SQL Thriftserver with HBase

erent requirements (HBASE release version, Kerberos support etc) _____ From: Benjamin Kim mailto:bbuil...@gmail.com>> Sent: Saturday, October 8, 2016 11:26 AM Subject: Re: Spark SQL Thriftserver with HBase To: Mich Talebzadeh mailto:mich.talebza...@gmail.com>&

Re: Spark SQL Thriftserver with HBase

ey will connected to a located database >>>>>>>> server using JDBC. Either way, by using JDBC everywhere, it simplifies >>>>>>>> and unifies the code on the JDBC industry standard. >>>>>>>> >>>>>>>> Does this make sense? &g

Re: Spark SQL Thriftserver with HBase

cted to a located database >>>>>> server using JDBC. Either way, by using JDBC everywhere, it simplifies >>>>>> and unifies the code on the JDBC industry standard. >>>>>> >>>>>> Does this make sense? >>>>>>

Re: Spark SQL Thriftserver with HBase

;> LinkedIn * >>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>> >>> >>> http://talebzadehmich.wordpress.com >>>

Re: Spark SQL Thriftserver with HBase

er 17, 2016 at 1:53 PM > *To: *Benjamin Kim > *Cc: *Michael Segel , Jörn Franke < > jornfra...@gmail.com>, Mich Talebzadeh , Felix > Cheung , "user@spark.apache.org" < > user@spark.apache.org> > > *Subject: *Re: Spark SQL Thriftserver with HBase > > > > I

Re: Spark SQL Thriftserver with HBase

Talebzadeh , Felix Cheung , "user@spark.apache.org" Subject: Re: Spark SQL Thriftserver with HBase Instead of (or additionally to) saving results somewhere, you just start a thriftserver that expose the Spark tables of the SQLContext (or SparkSession now). That means you can implement any

Re: Spark SQL Thriftserver with HBase

>> JDBC directly within the same data-center. When not colocated in the same >>>>> data-center, they will connected to a located database server using JDBC. >>>>> Either way, by using JDBC everywhere, it simplifies and unifies the code >>>>> on >>>>> the JDB

Re: Spark SQL Thriftserver with HBase

t 8, 2016, at 11:47 AM, Mich Talebzadeh >>>> wrote: >>>> >>>> Like any other design what is your presentation layer and end users? >>>> >>>> Are they SQL centric users from Tableau background or they may use >>>> spark funct

Re: Spark SQL Thriftserver with HBase

On Oct 8, 2016, at 11:47 AM, Mich Talebzadeh >>>>> <mailto:mich.talebza...@gmail.com>> wrote: >>>>>> >>>>>> Like any other design what is your presentation layer and end users? >>>>>> >>>>>> Are they SQL cent

Re: Spark SQL Thriftserver with HBase

AS "Day's Low", >>>> "open" AS "Day's Open", "ticker", "volume", >>>> (to_number("low")+to_number("high"))/2 >>>> AS "AverageDailyPrice" from "tsco" where to_numb

Re: Spark SQL Thriftserver with HBase

nt and different requirements (HBASE release version, Kerberos support etc) _ From: Benjamin Kim mailto:bbuil...@gmail.com>> Sent: Saturday, October 8, 2016 11:26 AM Subject: Re: Spark SQL Thriftserver with HBase To: Mich Talebzadeh mailto:mich.talebza..

Re: Spark SQL Thriftserver with HBase

;> "open" AS "Day's Open", "ticker", "volume", >>>> (to_number("low")+to_number("high"))/2 AS "AverageDailyPrice" from "tsco" >>>> where to_number("volume") > 0

Re: Spark SQL Thriftserver with HBase

es >> arising from such loss, damage or destruction. >> >> >> >> On 8 October 2016 at 19:40, Felix Cheung >> wrote: >> >>> I wouldn't be too surprised Spark SQL - JDBC data source - Phoenix JDBC >>> server - HBASE would work better. >>>

Re: Spark SQL Thriftserver with HBase

from relying on this email's technical content is explicitly disclaimed. >>>> The author will in no case be liable for any monetary damages arising from >>>> such loss, damage or destruction. >>>> >>>> >>>>> On 8 October 2016 at 19:40, Felix Cheung >>>>> wrot

Re: Spark SQL Thriftserver with HBase

>> server - HBASE would work better. >> >> Without naming specifics, there are at least 4 or 5 different >> implementations of HBASE sources, each at varying level of development and >> different requirements (HBASE release version, Kerberos support etc) >> &g

Re: Spark SQL Thriftserver with HBase

d work better. >> >> Without naming specifics, there are at least 4 or 5 different >> implementations of HBASE sources, each at varying level of development and >> different requirements (HBASE release version, Kerberos support etc) >> >> >> ___

Re: Spark SQL Thriftserver with HBase

aming specifics, there are at least 4 or 5 different implementations > of HBASE sources, each at varying level of development and different > requirements (HBASE release version, Kerberos support etc) > > > _____ > From: Benjamin Kim mailto:bbuil...

Re: Spark SQL Thriftserver with HBase

ease version, Kerberos support etc) > > > _ > From: Benjamin Kim > Sent: Saturday, October 8, 2016 11:26 AM > Subject: Re: Spark SQL Thriftserver with HBase > To: Mich Talebzadeh > Cc: , Felix Cheung > > > > Mich, > > Are you talking about the Phoenix JDBC Server? If s

Re: Spark SQL Thriftserver with HBase

rsion, Kerberos support etc) _ From: Benjamin Kim mailto:bbuil...@gmail.com>> Sent: Saturday, October 8, 2016 11:26 AM Subject: Re: Spark SQL Thriftserver with HBase To: Mich Talebzadeh mailto:mich.talebza...@gmail.com>> Cc: mailto:user@spark.apache.or

Re: Spark SQL Thriftserver with HBase

gt; loss, damage or destruction. > > > On 8 October 2016 at 19:05, Felix Cheung <mailto:felixcheun...@hotmail.com>> wrote: > Great, then I think those packages as Spark data source should allow you to > do exactly that (replace org.apache.spark.sql.jdbc with HBASE o

Re: Spark SQL Thriftserver with HBase

experience with this! > > > _ > From: Benjamin Kim mailto:bbuil...@gmail.com>> > Sent: Saturday, October 8, 2016 11:00 AM > Subject: Re: Spark SQL Thriftserver with HBase > To: Felix Cheung <mailto:felixcheun...@hotmail.com>> > Cc: m

Re: Spark SQL Thriftserver with HBase

or destruction. On 8 October 2016 at 19:05, Felix Cheung wrote: > Great, then I think those packages as Spark data source should allow you > to do exactly that (replace org.apache.spark.sql.jdbc with HBASE one) > > I do think it will be great to get more examples around this thoug

Re: Spark SQL Thriftserver with HBase

! _ From: Benjamin Kim mailto:bbuil...@gmail.com>> Sent: Saturday, October 8, 2016 11:00 AM Subject: Re: Spark SQL Thriftserver with HBase To: Felix Cheung mailto:felixcheun...@hotmail.com>> Cc: mailto:user@spark.apache.org>> Felix, My goal is to use Spark SQL JDBC Thri

Re: Spark SQL Thriftserver with HBase

Thrift Server (with USING, > http://spark.apache.org/docs/latest/sql-programming-guide.html#tab_sql_10 > <http://spark.apache.org/docs/latest/sql-programming-guide.html#tab_sql_10>). > > > _ > From: Benjamin Kim mailto:bbuil...@gmail.com>&

Re: Spark SQL Thriftserver with HBase

tab_sql_10). _ From: Benjamin Kim mailto:bbuil...@gmail.com>> Sent: Saturday, October 8, 2016 10:40 AM Subject: Re: Spark SQL Thriftserver with HBase To: Felix Cheung mailto:felixcheun...@hotmail.com>> Cc: mailto:user@spark.apache.org>> Felix, The only alternative way is to create

Re: Spark SQL Thriftserver with HBase

Felix, The only alternative way is to create a stored procedure (udf) in database terms that would run Spark scala code underneath. In this way, I can use Spark SQL JDBC Thriftserver to execute it using SQL code passing the key, values I want to UPSERT. I wonder if this is possible since I cann

Re: Spark SQL Thriftserver with HBase

HBase has released support for Spark hbase.apache.org/book.html#spark And if you search you should find several alternative approaches. On Fri, Oct 7, 2016 at 7:56 AM -0700, "Benjamin Kim" mailto:bbuil...@gmail.com>> wrote: Does anyone know if Spark