Re: HBaseContext with Spark

2017-01-27 Thread Chetan Khatri
storage handler bulk load: SET hive.hbase.bulk=true; INSERT OVERWRITE TABLE users SELECT … ; But for now, you have to do some work and issue multiple Hive commands Sample source data for range partitioning Save sampling results to a file Run CLUSTER BY query using HiveHFileOutputFormat and TotalOr

Re: HBaseContext with Spark

2017-01-27 Thread Chetan Khatri
@Ted, I dont think so. On Thu, Jan 26, 2017 at 6:35 AM, Ted Yu wrote: > Does the storage handler provide bulk load capability ? > > Cheers > > On Jan 25, 2017, at 3:39 AM, Amrit Jangid > wrote: > > Hi chetan, > > If you just need HBase Data into Hive, You can use Hive EXTERNAL TABLE > with > >

CFP for Spark Summit San Francisco closes on Feb. 6

2017-01-27 Thread Scott walent
In June, the 10th Spark Summit will take place in San Francisco at Moscone West. We have expanded our CFP to include more topics and deep-dive technical sessions. Take center stage in front of your fellow Spark enthusiasts. Submit your presentation and join us for the big ten. The CFP closes on Fe

Re: Issue creating row with java.util.Map type

2017-01-27 Thread Richard Xin
try Row newRow = RowFactory.create(row.getString(0), row.getString(1), row.getMap(2)); On Friday, January 27, 2017 10:52 AM, Ankur Srivastava wrote: + DEV Mailing List On Thu, Jan 26, 2017 at 5:12 PM, Ankur Srivastava wrote: Hi, I am trying to map a Dataset with rows which have a ma