Re: 答复: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

d > use Gets as much as possible. > > > > Thanks, > > > > > > *发件人:* Ted Malaska [mailto:ted.mala...@cloudera.com] > *发送时间:* 2015年8月12日 9:14 > *收件人:* Yan Zhou.sc > *抄送:* dev@spark.apache.org; Bing Xiao (Bing); Ted Yu; user > *主题:* RE: 答复: 答复: Package Rel

答复: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

); Ted Yu; user 主题: RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro" There a number of ways to bulk load. There is bulk put, partition bulk put, mr bulk load, and now hbase-14150 which is spark shuffle bulk load. Let me know if I have missed a bulk loading option. A

RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

> > My understanding is that 14181 does not run Spark execution engine at all, > but will make use of Spark Dataframe semantic and/or logic planning to pass > a logic (sub-)plan to the HBase. If true, it might > > be desirable to directly support Dataframe in HBase. > > > >

RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

@spark.apache.org; Ted Yu; Bing Xiao (Bing); user Subject: RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro" The bulk load code is 14150 if u r interested. Let me know how it can be made faster. It's just a spark shuffle and writing hfiles. Unless astro wrote it

RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

d/or logic planning to pass > a logic (sub-)plan to the HBase. If true, it might > > be desirable to directly support Dataframe in HBase. > > > > Thanks, > > > > > > *From:* Ted Malaska [mailto:ted.mala...@cloudera.com] > *Sent:* Wednesday, August 12, 2015 7:28 AM

RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

To: Yan Zhou.sc Cc: user; dev@spark.apache.org; Bing Xiao (Bing); Ted Yu Subject: RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro" Hey Yan, I've been the one building out this spark functionality in hbase so maybe I can help clarify. The hbase-spark module is

RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

t > of querying string columns in HBase as integers from Astro. > > > > Thanks, > > > > *From:* Ted Yu [mailto:yuzhih...@gmail.com] > *Sent:* Wednesday, August 12, 2015 7:02 AM > *To:* Yan Zhou.sc > *Cc:* Bing Xiao (Bing); dev@spark.apache.org; u...@spark.apach

RE: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

Subject: Re: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro" Yan: Where can I find performance numbers for Astro (it's close to middle of August) ? Cheers On Tue, Aug 11, 2015 at 3:58 PM, Yan Zhou.sc mailto:yan.zhou...@huawei.com>> wrote: Finally I can take a lo

Re: 答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

rformance comparisons when HBase-14181 is > ready. > > > > Thanks, > > > > > > *From:* Ted Yu [mailto:yuzhih...@gmail.com] > *Sent:* Tuesday, August 11, 2015 3:28 PM > *To:* Yan Zhou.sc > *Cc:* Bing Xiao (Bing); dev@spark.apache.org; u...@spark.apache.org >

答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

.apache.org<mailto:dev@spark.apache.org>; u...@spark.apache.org<mailto:u...@spark.apache.org>; Yan Zhou.sc 主题: Re: Package Release Annoucement: Spark SQL on HBase "Astro" Yan / Bing: Mind taking a look at HBASE-14181<https://issues.apache.org/jira/browse/HBASE-14181> 

答复: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

[mailto:yuzhih...@gmail.com] 发送时间: 2015年8月11日 15:28 收件人: Yan Zhou.sc 抄送: Bing Xiao (Bing); dev@spark.apache.org; u...@spark.apache.org 主题: Re: 答复: Package Release Annoucement: Spark SQL on HBase "Astro" HBase will not have query engine. It will provide better support to query engines. Cheers On Au

Re: 答复: Package Release Annoucement: Spark SQL on HBase "Astro"

oprocessor, custom filter, …, etc., which allows for loosely-coupled query > engines > built on top of it. > > Thanks, > > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2015年8月11日 8:54 > 收件人: Bing Xiao (Bing) > 抄送: dev@spark.apache.org; u...@spark.apache.org; Yan Zhou.

答复: Package Release Annoucement: Spark SQL on HBase "Astro"

om] 发送时间: 2015年8月11日 8:54 收件人: Bing Xiao (Bing) 抄送: dev@spark.apache.org; u...@spark.apache.org; Yan Zhou.sc 主题: Re: Package Release Annoucement: Spark SQL on HBase "Astro" Yan / Bing: Mind taking a look at HBASE-14181<https://issues.apache.org/jira/browse/HBASE-14181> 'Add

Re: Package Release Annoucement: Spark SQL on HBase "Astro"

Yan / Bing: Mind taking a look at HBASE-14181 'Add Spark DataFrame DataSource to HBase-Spark Module' ? Thanks On Wed, Jul 22, 2015 at 4:53 PM, Bing Xiao (Bing) wrote: > We are happy to announce the availability of the Spark SQL on HBase 1.0.0

RE: Package Release Annoucement: Spark SQL on HBase "Astro"

...@spark.apache.org; Yan Zhou.sc Subject: Re: Package Release Annoucement: Spark SQL on HBase "Astro" When I tried to compile against hbase 1.1.1, I got: [ERROR] /home/hbase/ssoh/src/main/scala/org/apache/spark/sql/hbase/SparkSqlRegionObserver.scala:124: overloaded method next needs result t

Re: Package Release Annoucement: Spark SQL on HBase "Astro"

When I tried to compile against hbase 1.1.1, I got: [ERROR] /home/hbase/ssoh/src/main/scala/org/apache/spark/sql/hbase/SparkSqlRegionObserver.scala:124: overloaded method next needs result type [ERROR] override def next(result: java.util.List[Cell], limit: Int) = next(result) Is there plan to s

Re: Package Release Annoucement: Spark SQL on HBase "Astro"

; > *From:* Debasish Das [mailto:debasish.da...@gmail.com] > *Sent:* Monday, July 27, 2015 10:02 PM > *To:* Yan Zhou.sc > *Cc:* Bing Xiao (Bing); dev; user > *Subject:* RE: Package Release Annoucement: Spark SQL on HBase "Astro" > > > > Hi Yan, > > Is it pos

RE: Package Release Annoucement: Spark SQL on HBase "Astro"

imizer-> HBase Scans/Gets -> … -> HBase Region server Regards, Yan From: Debasish Das [mailto:debasish.da...@gmail.com] Sent: Monday, July 27, 2015 10:02 PM To: Yan Zhou.sc Cc: Bing Xiao (Bing); dev; user Subject: RE: Package Release Annoucement: Spark SQL on HBase "Astro" H

RE: Package Release Annoucement: Spark SQL on HBase "Astro"

esday, July 22, 2015 7:36 PM > *To:* Bing Xiao (Bing) > *Cc:* user; dev; Yan Zhou.sc > *Subject:* Re: Package Release Annoucement: Spark SQL on HBase "Astro" > > > > Does it also support insert operations ? > > On Jul 22, 2015 4:53 PM, "Bing Xiao (Bing)"

RE: Package Release Annoucement: Spark SQL on HBase "Astro"

Yes, but not all SQL-standard insert variants . From: Debasish Das [mailto:debasish.da...@gmail.com] Sent: Wednesday, July 22, 2015 7:36 PM To: Bing Xiao (Bing) Cc: user; dev; Yan Zhou.sc Subject: Re: Package Release Annoucement: Spark SQL on HBase "Astro" Does it also support insert

Re: Package Release Annoucement: Spark SQL on HBase "Astro"

Does it also support insert operations ? On Jul 22, 2015 4:53 PM, "Bing Xiao (Bing)" wrote: > We are happy to announce the availability of the Spark SQL on HBase > 1.0.0 release. > http://spark-packages.org/package/Huawei-Spark/Spark-SQL-on-HBase > > The main features in this package, dubbed “As

Package Release Annoucement: Spark SQL on HBase "Astro"

We are happy to announce the availability of the Spark SQL on HBase 1.0.0 release. http://spark-packages.org/package/Huawei-Spark/Spark-SQL-on-HBase The main features in this package, dubbed "Astro", include: * Systematic and powerful handling of data pruning and intelligent scan, based