can it load successfully if the format is invalid? 

----- 原始邮件 -----

发件人: "Ahmed Nawar" <ahmed.na...@gmail.com> 
收件人: user@spark.apache.org 
发送时间: 星期一, 2015年 3 月 23日 下午 4:48:54 
主题: Data/File structure Validation 

Dears, 

Is there any way to validate the CSV, Json ... Files while loading to 
DataFrame. 
I need to ignore corrupted rows.(Rows with not matching with the schema). 


Thanks, 
Ahmed Nawwar 



-- 


--------------------------------------------------------------------------- 

Thanks & Best regards 

李涛涛 Taotao · Li | Fixed Income@Datayes | Software Engineer 

地址:上海市浦东新区陆家嘴西路 99 号万向大厦8 楼, 200120 
Address :Wanxiang Towen 8 F, Lujiazui West Rd. No.99, Pudong New District, 
Shanghai, 200120 

电话 |Phone : 021-60216502 手机 |Mobile: +86-18202171279 

Reply via email to