We have a json feed of spark application interface that we use for easier
instrumentation & monitoring. Has that been considered/found relevant?
Already sent as a pull request to 0.9.0, would that work or should we
update it to 1.0.0?
Mayur Rustagi
Ph: +1 (760) 203 3257
http://www.sigmoidanalytic
Hi,
scenario : Read data from HDFS and apply hive query on it and the result
is written back to HDFS.
Scheme creation, Querying and saveAsTextFile are working fine with
following mode
- local mode
- mesos cluster with single node
- spark cluster with multi node
Schema creation and q
Can you look at the logs from the executor or in the UI? They should
give an exception with the reason for the task failure. Also in the
future, for this type of e-mail please only e-mail the "user@" list
and not both lists.
- Patrick
On Sat, May 31, 2014 at 3:22 AM, prabeesh k wrote:
> Hi,
>
>
One other consideration popped into my head:
5. Shading our dependencies could mess up our external API's if we
ever return types that are outside of the spark package because we'd
then be returned shaded types that users have to deal with. E.g. where
before we returned an o.a.flume.AvroFlumeEvent
On Sat, May 31, 2014 at 10:45 AM, Patrick Wendell
wrote:
> One other consideration popped into my head:
>
> 5. Shading our dependencies could mess up our external API's if we
> ever return types that are outside of the spark package because we'd
> then be returned shaded types that users have to
Hello,
Following the instructions for building spark 1.0.0, I encountered the
following error:
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-antrun-plugin:1.7:run (default) on project
spark-core_2.10: An Ant BuildException has occured: Please set the
SCALA_HOME (or SCALA_LIBRARY_P
Spark currently supports two build systems, sbt and maven. sbt will
download the correct version of scala, but with Maven you need to supply it
yourself and set SCALA_HOME.
It sounds like the instructions need to be updated-- perhaps create a JIRA?
best,
Colin
On Sat, May 31, 2014 at 7:06 PM,
