Yiannis,
I'm interested in what you've done here as I was looking for ways to allow
the Spark UI to display custom metrics in a pluggable way without having to
modify the Spark source code. It would be good to see if we could have
modify your code to add extension points into the UI so we could co
> On 4 Feb 2016, at 23:11, Ted Yu wrote:
>
> Assuming your change is based on hadoop-2 branch, you can use 'mvn install'
> command which would put artifacts under 2.8.0-SNAPSHOT subdir in your local
> maven repo.
>
> Here is an example:
> ~/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.8.0-S
> On 4 Feb 2016, at 23:11, Ted Yu wrote:
>
> Assuming your change is based on hadoop-2 branch, you can use 'mvn install'
> command which would put artifacts under 2.8.0-SNAPSHOT subdir in your local
> maven repo.
>
+ generally, unless you want to run all the hadoop tests, set the -DskipTes
I am trying to run following code using yarn-client mode in but getting slow
readprocessor error mentioned below but the code works just fine in the local
mode. Any pointer is really appreciated.
Line of code to receive data from the Kafka Queue:
JavaPairReceiverInputDStream messages =
KafkaU
Hi everyone,
When using raw RDDs, it is possible to have a map() operation indicate that the
partitioning for the RDD would be preserved by the map operation. This makes it
easier to reduce the overhead of shuffles by ensuring that RDDs are
co-partitioned when they are joined.
When I'm using D
