Fokko closed issue #2943: Remove support for Hadoop <3.3
URL: https://github.com/apache/parquet-java/issues/2943
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
steveloughran commented on issue #2943:
URL: https://github.com/apache/parquet-java/issues/2943#issuecomment-2498259487
Think this can be resolve now; I will do some independent followups
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
steveloughran commented on issue #2943:
URL: https://github.com/apache/parquet-java/issues/2943#issuecomment-2478727692
w.r.t format testing, got some more thoughts there which would actually be
* make some/all the benchmark tests subclass of the (stable) hadoop fs
contract tests in h
steveloughran commented on issue #2943:
URL: https://github.com/apache/parquet-java/issues/2943#issuecomment-2474766905
I've actually been thinking about having a format-test module in Hadoop,
which contains basic Parquet, avro &c tests which and then we run against
object stores through th
Fokko commented on issue #2943:
URL: https://github.com/apache/parquet-java/issues/2943#issuecomment-2473209827
> One thing to consider here is actually dropping the hadoop 3 version to
3.3.0 to guarantee all API/tests are against that version. Avoids any
accidental use of newer classes/met
steveloughran commented on issue #2943:
URL: https://github.com/apache/parquet-java/issues/2943#issuecomment-2473200382
+1; will submit both.
One thing to consider here is actually dropping the hadoop 3 version to
3.3.0 to guarantee all API/tests are against that version. Avoids any
acci
Fokko commented on issue #2943:
URL: https://github.com/apache/parquet-java/issues/2943#issuecomment-2472790250
Hey @steveloughran! As a first PR, I'd love to remove the Hadoop 2 profile
and the error-prone reflection. Next, we can do incremental cleanup.
--
This is an automated message f
steveloughran commented on issue #2943:
URL: https://github.com/apache/parquet-java/issues/2943#issuecomment-2471303873
I'm going to propose this is done with a cull of the hadoop-2 profile, with
other cleanup code done more incrementally.
Or would you want `HadoopStreams` cleaned up
