We are planning to support HBase as a "native" data source to Spark SQL in 1.3 
(SPARK-3880). 
More details will come soon.


-----Original Message-----
From: Ted Yu [mailto:yuzhih...@gmail.com] 
Sent: Monday, January 05, 2015 7:37 AM
To: tgbaggio
Cc: dev@spark.apache.org
Subject: Re: python converter in HBaseConverter.scala(spark/examples)

In my opinion this would be useful - there was another thread where returning 
only the value of first column in the result was mentioned.

Please create a SPARK JIRA and a pull request.

Cheers

On Mon, Jan 5, 2015 at 6:42 AM, tgbaggio <gen.tan...@gmail.com> wrote:

> Hi,
>
> In  HBaseConverter.scala
> <
> https://github.com/apache/spark/blob/master/examples/src/main/scala/or
> g/apache/spark/examples/pythonconverters/HBaseConverters.scala
> >
> , the python converter HBaseResultToStringConverter return only the 
> value of first column in the result. In my opinion, it limits the 
> utility of this converter, because it returns only one value per row 
> and moreover it loses the other information of record, such as 
> column:cell, timestamp.
>
> Therefore, I would like to propose some modifications about 
> HBaseResultToStringConverter which will be able to return all records 
> in the hbase with more complete information: I have already written 
> some code in pythonConverters.scala < 
> https://github.com/GenTang/spark_hbase/blob/master/src/main/scala/exam
> ples/pythonConverters.scala
> >
> and it works
>
> Is it OK to modify the code in HBaseConverters.scala, please?
> Thanks a lot in advance.
>
> Cheers
> Gen
>
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/python-conve
> rter-in-HBaseConverter-scala-spark-examples-tp10001.html
> Sent from the Apache Spark Developers List mailing list archive at 
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For 
> additional commands, e-mail: dev-h...@spark.apache.org
>
>

Reply via email to