hi everyone! a question: someone knows if it's possible to read a lzo compressed file from hdfs to pyspark dataframe directly. In a splitable way? Something like : spark.read.csv("codec...", file.lzo)
all the options I've seen use rdd instead of a DF, and then toDF to get a dataframe Thanks!!