Re: Cannot build master with sbt

2016-05-25 Thread Yiannis Gkoufas
8dfa53d > (since > I don't see any branches or tags in the github repo for different > versions), and sbt publishLocal to get the dependency locally. > > On Wed, 25 May 2016 at 15:13 Yiannis Gkoufas wrote: > >> Hi there, >> >> I have cloned the latest versio

Cannot build master with sbt

2016-05-25 Thread Yiannis Gkoufas
Hi there, I have cloned the latest version from github. I am using scala 2.10.x When I invoke build/sbt clean package I get the exceptions because for the sbt-antlr library: [warn] module not found: com.simplytyped#sbt-antlr4;0.7.10 [warn] typesafe-ivy-releases: tried [warn] https://re

SparkOscope: Enabling Spark Optimization through Cross-stack Monitoring and Visualization

2016-02-03 Thread Yiannis Gkoufas
Hi all, I just wanted to introduce some of my recent work in IBM Research around Spark and especially its Metric System and Web UI. As a quick overview of our contributions: We have a created a new type of Sink for the metrics ( HDFSSink ) which captures the metrics into HDFS, We have extended the