Re: How can I read ftp

We have solved it using an orchestrator, which copied data from FTP to HDFS. But of course, you can just use a Java FTP client to just read files, put them somewhere, and then read with Spark. пн, 9 авг. 2021 г. в 06:39, Sean Owen : > FTP is definitely not supported. Read the files to distributed

Re: How can I read ftp

FTP is definitely not supported. Read the files to distributed storage first then read from there. On Sun, Aug 8, 2021, 10:18 PM igyu wrote: > val ftpUrl = "ftp://ftpuser:ftpuser@10.3.87.51:21/sparkftp/"; > > val schemas = StructType(List( > new StructField("name", DataTypes.StringType,

How can I read ftp

val ftpUrl = "ftp://ftpuser:ftpuser@10.3.87.51:21/sparkftp/"; val schemas = StructType(List( new StructField("name", DataTypes.StringType, true), new StructField("age", DataTypes.IntegerType, true), new StructField("remk", DataTypes.StringType, true))) val DF = sparkSess