[
https://issues.apache.org/jira/browse/HIVE-29656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated HIVE-29656:
--------------------------------
Description:
faced problems in negative tests qout in precommit CI
# export QTEST_LEAVE_FILES=true
# run qtest
# check files under
{{apache/hive/itests/qtest/target/qfile-results/clientnegative}}
# {{orig}} files are generated while running the tests, and they are
transformed by QOutProcessor to form the final result, which is then compared
to the golden
I compared the orig files with the final, and I saw strange stuff:
the masking should make the stack trace disappear, but apparently, not only the
stack trace disappeared...I'm afraid that the regex replace is not
deterministic, and can vary depending on my computer and CI environment
!Screenshot 2026-06-10 at 14.41.58.png|width=932,height=257!
in the orig file, there is {{{color:#de350b}vertexName=Reducer 8 ...{color} }},
in the final file, it became{{ {color:#00875a}Masked{color}}}
this can maybe cause qout difference in CI precommit which cannot be reproduced
locally, which is bad:
!Screenshot 2026-06-10 at 14.49.46.png|width=752,height=260!
was:
(this is a hunch, not yet proved)
faced problems in negative tests qout in precommit CI
# export QTEST_LEAVE_FILES=true
# run qtest
# check files under
{{apache/hive/itests/qtest/target/qfile-results/clientnegative}}
# {{orig}} files are generated while running the tests, and they are
transformed by QOutProcessor to form the final result, which is then compared
to the golden
I compared the orig files with the final, and I saw strange stuff:
the masking should make the stack trace disappear, but apparently, not only the
stack trace disappeared...I'm afraid that the regex replace is not
deterministic, and can vary depending on my computer and CI environment
!Screenshot 2026-06-10 at 14.41.58.png|width=932,height=257!
this can maybe cause qout difference in CI precommit which cannot be reproduced
locally, which is bad:
!Screenshot 2026-06-10 at 14.49.46.png|width=752,height=260!
> Non-deterministic regex replace in q.out orig file
> --------------------------------------------------
>
> Key: HIVE-29656
> URL: https://issues.apache.org/jira/browse/HIVE-29656
> Project: Hive
> Issue Type: Bug
> Reporter: László Bodor
> Priority: Major
> Attachments: Screenshot 2026-06-10 at 14.41.58.png, Screenshot
> 2026-06-10 at 14.49.46.png
>
>
> faced problems in negative tests qout in precommit CI
>
> # export QTEST_LEAVE_FILES=true
> # run qtest
> # check files under
> {{apache/hive/itests/qtest/target/qfile-results/clientnegative}}
> # {{orig}} files are generated while running the tests, and they are
> transformed by QOutProcessor to form the final result, which is then compared
> to the golden
>
> I compared the orig files with the final, and I saw strange stuff:
> the masking should make the stack trace disappear, but apparently, not only
> the stack trace disappeared...I'm afraid that the regex replace is not
> deterministic, and can vary depending on my computer and CI environment
> !Screenshot 2026-06-10 at 14.41.58.png|width=932,height=257!
> in the orig file, there is {{{color:#de350b}vertexName=Reducer 8 ...{color}
> }}, in the final file, it became{{ {color:#00875a}Masked{color}}}
>
> this can maybe cause qout difference in CI precommit which cannot be
> reproduced locally, which is bad:
> !Screenshot 2026-06-10 at 14.49.46.png|width=752,height=260!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
