hi everyone! a question:
someone knows if it's possible to read a lzo compressed file from hdfs to 
pyspark dataframe directly. In a splitable way?
Something like :    spark.read.csv("codec...", file.lzo)

all the options I've seen use rdd instead of a DF, and then toDF to get a 
dataframe

Thanks!!




Reply via email to