Spark is computing engine, I don't think it is suitable for spark to do the input large file transferring.
On Thu, Jul 30, 2015 at 4:18 PM, Akhil Das <[email protected]> wrote: > You can achieve this with a Network File System, create an NFS on the > cluster and mount it to your local machine. > > Thanks > Best Regards > > On Wed, Jul 29, 2015 at 9:32 AM, Anh Hong <[email protected]> > wrote: > >> Hi, >> >> I'm using spark-submit cluster mode to submit a job from local to >> spark cluster. There are input files, output files, and job log files that >> I need to transfer in and out between local machine and spark cluster. >> Any recommendation methods to use file transferring. Is there any future >> plan that spark will support file transferring from cluster to local and >> vice versa. >> Any help is appreciated. >> >> Thanks. >> > > -- Best Regards Jeff Zhang
