Re: [DISCUSS] Integration Testing for Parquet Implementations

2025-01-30 Thread Andrew Lamb
This is a great idea. There is a previous discussion about a similar idea here[1] Specifically, I think Alkis's sketch of the "carpenter" program would have caught this situation. In my opinion, improving interoperability testing like this is a key step towards being able to reliably evolve the

[DISCUSS] Integration Testing for Parquet Implementations

2025-01-29 Thread Bryce Mecum
Hello Parquet community, The Arrow project recently fixed a bug [1] in its C++ Parquet implementation that was causing compliant Parquet files written by recent versions of parquet-rs [2] to be unreadable by the C++ implementation due to differences in the implementation of Parquet’s SizeStatistic