Bug 74642

Summary: crashes during subtests are unreported, as are all subsequent subtests in the same test
Product: piglit Reporter: Daniel Kurtz <djkurtz>
Component: infrastructureAssignee: Eric Anholt <eric>
Status: RESOLVED MOVED QA Contact: Eric Anholt <eric>
Severity: normal    
Priority: medium    
Version: unspecified   
Hardware: Other   
OS: All   
Whiteboard:
i915 platform: i915 features:

Description Daniel Kurtz 2014-02-07 01:46:42 UTC
I happened to be watching the screen during a recent piglit run and saw a stacktrace fly by.  However, when the test run completed, I did not have any "crashes" in my summary.

It turns out that the crash was during the "spec/!OpenGL 1.0/gl-1.0-beginend-coverage/glPixelMapfv" - the glPixelMapfv subtest of gl-1.0-beginend-coverage.

The crash terminated gl-1.0-beginend-coverage.  However piglit processes each (completed) subtest as a separate test.  Each of the subtests that passed gets the result "pass", with their own identical 'info', 'command', 'time', 'subtest' and 'returncode' fields.  Note that the "returncode" field in this case is -6 for all of them (all of the passing subtests), since the master test process crashed.
However, there is no separate test item for the master test, to mark the "crash" result.  Similarly, since piglit really has no way of knowing how many subtests the master test should run, it doesn't even know which subtest crashed, nor which subtests didn't even get run.
Comment 1 Fabian Bieler 2018-01-16 19:38:16 UTC
938ec48e2575b78defd06d169f704ed8d4f11bce logs a subtest named 'unknown' with result crashed if a test with subtests crashes.

Since the name of the crashing subtest still isn't recorded and subsequent subests aren't logged as not-run, I'm leaving this bug open for now.
Comment 2 GitLab Migration User 2019-03-06 15:46:51 UTC
-- GitLab Migration Automatic Message --

This bug has been migrated to freedesktop.org's GitLab instance and has been closed from further activity.

You can subscribe and participate further through the new bug through this link to our GitLab instance: https://gitlab.freedesktop.org/mesa/piglit/issues/1.

Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.