Spark Worker in different machine doesnt work

2014-04-06 Thread subacini Arunkumar
Hi All, I am using spark-0.9.0 and am able to run my program successfully if spark master and worker are in same machine. If i run the same program in spark master in Machine A and worker in Machine B, I am getting below exception I am running program with java -cp "..." instead of scala command

Shark Table for >22 columns

2014-03-21 Thread subacini Arunkumar
Hi, I am able to successfully create shark table with 3 columns and 2 rows. val recList = List((" value A1", "value B1","value C1"), ("value A2", "value B2","value c2")); val dbFields =List ("Col A", "Col B","Col C") val rdd = sc.parallelize(recList)

RDDToTable

2014-02-28 Thread subacini Arunkumar
Hi, I am able create rdd from table using below code in shark. val rdd = sc.sql2rdd("SELECT * FROM TABLEXYZ") Could you please tell me how to create table from RDD using shark 0.8.1 RDDToTable? Thanks in advance, Subacini

RDDToTable

2014-02-28 Thread subacini Arunkumar
Hi, I am able create rdd from table using below code in shark. val rdd = sc.sql2rdd("SELECT * FROM TABLEXYZ") Could you please tell me how to create table from RDD using shark 0.8.1 RDDToTable? Thanks in advance, Subacini