https://bugs.kde.org/show_bug.cgi?id=492382
Bug ID: 492382
Summary: Nondeterministic results found for DHAT tool reports
and Valgrind-produced DHAT log
Classification: Developer tools
Product: valgrind
Version: 3.18.1
Platform: Ubuntu
OS: Linux
Status: REPORTED
Severity: normal
Priority: NOR
Component: dhat
Assignee: jsew...@acm.org
Reporter: jo.al...@outlook.com
Target Milestone: ---
Created attachment 173108
--> https://bugs.kde.org/attachment.cgi?id=173108&action=edit
ZIP file that contains two files -- the two individual DHAT reports and the
file comparisons between the Valgrind-produced logs of two runs
Hi Valgrind Maintainers and Team!
I have been using Valgrind as a tool to check for nondeterministic behaviors
and I know that there are multiple subtools that Valgrind's suite comes with. I
would like to inquire about the DHAT subtool in analyzing some of the reports
generated after each run against a binary. This nondeterminism concerns the
tool generated report and the Valgrind generated report. We noted that 14/41
repositories showed nondeterministic results, where 4/14 repositories showed
flakiness in DHAT's generated report and 10/14 occurring from Valgrind's
generated report on DHAT (specifically, Valgrind's summary section printed for
DHAT).
Thank you very much!
STEPS TO REPRODUCE
1. Use a GitHub Actions runner with Ubuntu 22.04 + Valgrind 3.18.1 pulled from
the Ubuntu package manager
2. Run your executable with DHAT enabled.
3. Obtain the Valgrind report + view the DHAT results through the dh_view.html
program
OBSERVED RESULT
When viewing the DHAT generated results, I noticed that one of the binaries had
a significant difference in the number of children nodes that DHAT produced for
two of the same runs under the same conditions. When viewing the Valgrind log
for DHAT for another binary, I noticed that the summary sections contained in
the Valgrind log for DHAT are different across runs.
ADDITIONAL INFORMATION
Within the ZIP file, you'll find two files: the two individual DHAT reports
viewed through the DHAT Viewing tool + the file comparison between the Valgrind
logs of two runs.
--
You are receiving this mail because:
You are watching all bug changes.
