Fw: How Spark Choose Worker Nodes for respective HDFS block

2014-06-13 Thread anishs...@yahoo.co.in
Hi All

Is there any communication between Spark MASTER node and Hadoop NameNode while 
distributing work to WORKER nodes, like we have in MapReduce.

Please suggest

TIA

-- 
Anish Sneh
"Experience is the best teacher."
http://in.linkedin.com/in/anishsneh



Cloudera's Hive on Spark vs AmpLab's Shark

2014-07-08 Thread anishs...@yahoo.co.in
Hi All

I read somewhere that Cloudera announced Hive on Spark, since AmpLab already 
have Shark. I was trying to understand is it rebranding of Shark or they are 
planning something new altogether.

Please suggest.

-- 
Anish Sneh
"Experience is the best teacher."
http://in.linkedin.com/in/anishsneh



Data Locality In Spark

2014-07-08 Thread anishs...@yahoo.co.in
Hi All

My apologies for very basic question, do we have full support of data locality 
in Spark MapReduce.

Please suggest.

-- 
Anish Sneh
"Experience is the best teacher."
http://in.linkedin.com/in/anishsneh