Re: pyspark get column family and qualifier names from hbase table

2014-11-12 Thread freedafeng
w how to do that...sorry... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-get-column-family-and-qualifier-names-from-hbase-table-tp18613p18749.html Sent from the Apache Spark User List mailing list archive at Nabbl

Re: pyspark get column family and qualifier names from hbase table

2014-11-12 Thread freedafeng
a PR probably later today. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-get-column-family-and-qualifier-names-from-hbase-table-tp18613p18744.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: pyspark get column family and qualifier names from hbase table

2014-11-11 Thread Nick Pentreath
d you write > HBaseResultToStringConverter to do what you wanted it to do? > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-get-column-family-and-qualifier-names-from-hbase-table-tp18613p18650.html > Sent from the Apache Spark User Li

Re: pyspark get column family and qualifier names from hbase table

2014-11-11 Thread alaa
e.com/pyspark-get-column-family-and-qualifier-names-from-hbase-table-tp18613p18650.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For addit

Re: pyspark get column family and qualifier names from hbase table

2014-11-11 Thread freedafeng
just wrote a custom convert in scala to replace HBaseResultToStringConverter. Just couple of lines of code. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-get-column-family-and-qualifier-names-from-hbase-table-tp18613p18639.html Sent from the

Re: pyspark get column family and qualifier names from hbase table

2014-11-11 Thread freedafeng
e is a big limitation. Converting from the 'list()' from the 'Result' is more general and easy to use. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-get-column-family-and-qualifier-names-from-hbase-table-tp18613p18619.html Sent from the

pyspark get column family and qualifier names from hbase table

2014-11-11 Thread freedafeng
tToStringConverter", conf=conf2) output = hbase_rdd.collect() for (k, v) in output: print (k, v) I only see (u'row1', u'value1') (u'row2', u'value2') What I really want is (row_id, column family:column qualifier, value) tuples. Any comments?