o HDFS when the master node does the job way much faster
> > then the slaves (15s for each block as opposed to 1.2 min for the
> slaves).
> >
> > Any suggestion what the reason might be?
> >
> > thanks,
> >
> >
> >
> > --
> > View th
other 2
nodes
-Original Message-
From: Sean Owen [mailto:so...@cloudera.com]
Sent: Monday, April 20, 2015 12:57 PM
To: jamborta
Cc: user@spark.apache.org
Subject: Re: writing to hdfs on master node much faster
What machines are HDFS data nodes -- just your master? that would explain it
n the slaves (15s for each block as opposed to 1.2 min for the slaves).
>
> Any suggestion what the reason might be?
>
> thanks,
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/writing-to-hdfs-on-master-node-much-fa
://apache-spark-user-list.1001560.n3.nabble.com/writing-to-hdfs-on-master-node-much-faster-tp22570.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
