Hi Team,

Lately I have seen these flaky tests 
(TestHiveIcebergStorageHandler*.testJoinTables* / 
TestHiveIcebergStorageHandler*.testScanTable*):

> org.apache.iceberg.mr.hive.TestHiveIcebergStorageHandlerWithHiveCatalog > 
> testJoinTablesParquet FAILED
>    java.lang.IllegalArgumentException: Failed to executeQuery Hive query SHOW 
> TABLES: Error while compiling statement: FAILED: SemanticException 
> org.apache.thrift.transport.TTransportException: java.net.SocketException: 
> Broken pipe (Write failed)
>        Caused by:
>        org.apache.hive.service.cli.HiveSQLException: Error while compiling 
> statement: FAILED: SemanticException 
> org.apache.thrift.transport.TTransportException: java.net.SocketException: 
> Broken pipe (Write failed)
>            Caused by:
>            org.apache.hadoop.hive.ql.parse.SemanticException: 
> org.apache.thrift.transport.TTransportException: java.net.SocketException: 
> Broken pipe (Write failed)
>                Caused by:
>                org.apache.hadoop.hive.ql.metadata.HiveException: 
> org.apache.thrift.transport.TTransportException: java.net.SocketException: 
> Broken pipe (Write failed)
>                    Caused by:
>                    org.apache.thrift.transport.TTransportException: 
> java.net.SocketException: Broken pipe (Write failed)
>                        Caused by:
>                        java.net.SocketException: Broken pipe (Write failed)


We increased the test Heap size, since I have seen that there were 
OutOfMemoryException-s in the log.
https://github.com/apache/iceberg/blob/04d03bcf43d488acf2e98e4facf946e871a16719/build.gradle#L476
 
<https://github.com/apache/iceberg/blob/04d03bcf43d488acf2e98e4facf946e871a16719/build.gradle#L476>

If you still see the problem appear please link here the failing tests, so we 
can further investigate.

Thanks,
Peter

Reply via email to