Twitter.
Regards,
Vasu C
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-pass-parameters-to-a-spark-jobserver-Scala-class-tp21671p21727.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Hi Sasi,
Forgot to mention job server uses Typesafe Config library. The input is
JSON, you can find syntax in below link
https://github.com/typesafehub/config
Regards,
Vasu C
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-pass-parameters-to
the values.
The examples are shown here
https://github.com/spark-jobserver/spark-jobserver
Regards,
Vasu C
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-pass-parameters-to-a-spark-jobserver-Scala-class-tp21671p21692.html
Sent from the Apache
sqlContext = new org.apache.spark.sql.SQLContext(sc)
val jsonRdd = sqlContext.jsonRDD(results)
val parquetTable = sqlContext.parquetFile(parquetFilePath)
parquetTable.registerTempTable(tableName)
jsonRdd.insertInto(tableName)
Regards,
Vasu C
Hi Arthur,
May I know what is the solution., I have similar requirements.
Regards,
Vasu C
On Sun, Oct 26, 2014 at 12:09 PM, arthur.hk.c...@gmail.com <
arthur.hk.c...@gmail.com> wrote:
> Hi,
>
> I have already found the way about how to “insert into HIVE_TABLE values
>
xt.start(); // Start the computation
context.awaitTermination();
}
}
Regards,
Vasu C
On Thu, Nov 6, 2014 at 1:33 PM, Sean Owen wrote:
> No, not the same thing then. This just means you accidentally have a
> reference to the unserializable enclosing test class in your code.
> Just m
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Regards,
Vasu C
On Thu, Nov 6, 2014 at 1:14 PM, Sean Owen wrote:
> You didn't say what isn't serializable or where the exception occurs,
> but, is it the same as this issue?
> https://issues.apache.org/jira/browse/SPARK-4196
>
> On Th
Dear All,
I am getting java.io.NotSerializableException for below code. if
jssc.checkpoint(HDFS_CHECKPOINT_DIR); is blocked there is not exception
Please help
JavaStreamingContextFactory contextFactory = new
JavaStreamingContextFactory() {
@Override
public JavaStreamingContext create() {
SparkC
