Hi Tomas, thanks for reporting this bug!
Is it possible to share your dataset so that other people can reproduce and
debug it?
On Thu, Apr 8, 2021 at 7:52 AM Tomas Bartalos
wrote:
> when I try to do a Broadcast Hash Join on a bigger table (6Mil rows) I get
> an incorrect result of 0 rows.
>
> v
when I try to do a Broadcast Hash Join on a bigger table (6Mil rows) I get
an incorrect result of 0 rows.
val rightDF = spark.read.format("parquet").load("table-a")
val leftDF = spark.read.format("parquet").load("table-b")
//needed to activate dynamic pruning subquery
.where('part_ts === 2021
