I have read gzip files from S3 successfully. It sounds like a file is corrupt or not a valid gzip file.
Does it work with fewer gzip files? How are you reading the files? ----- Madhu https://www.linkedin.com/in/msiddalingaiah -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/count-ing-gz-files-gives-java-io-IOException-incorrect-header-check-tp5768p6149.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
